China Automotive Human-Machine Interaction (HMI) Research Report, 2020
Automotive HMI refers to the process of information exchange between humans and the car through interaction means such as voice, gesture, face, AR, holographic display and fingerprint recognition.
Over a decade of development, in-car voice interaction was installed to 28.7% of vehicles and even a higher share of new models on the market in the first half of 2019. Voice interaction is extending from infotainment (navigation, multimedia, etc.) to body control (windows, sunroof, lights, wipers, trunk, etc.) and life services (car-home connectivity, in-car shopping, etc.), and voice technology is getting through to infotainment protocols and in-car ecology.
Gesture recognition was first found in BMW model in 2015, and has been successively available in China-made models such as the Traum SEEK 5, Chery 5X, Xpeng G3 Premium, etc. It is mainly used to control the display system in the car, such as music play, volume regulation, map zoom, etc., as a supplementary interactive mode in a quiet environment.
Face recognition, unveiled in China in 2018, has been seen in Leapmotor S01, Chery’s EXEED TX, WEY VV6, WM Motor’s EX5, Geely Xing Yue and other models, showing a rosy prospect. Face recognition is mostly for personalized settings (seat position, ambient light preference, rearview mirror position, music recommendation, etc.) and driver status detection. EXEED TX supports to buy movie tickets by face scanning and heads toward face payment.
In addition, new interactive modes like window interaction (WM Motor's EX5), body interaction (BAIC BJEV's LITE), vein recognition (Leapmotor SO1), fingerprint recognition (Hyundai’s New SantaFe), and AR navigation (Roewe Marvel X) have been available onto production vehicles.
Foreign automotive HMI systems include BMW iDrive, Mercedes-Benz MBUX, Audi MMI, Ford SYNC +, etc. Among them, BMW iDrive has iterated to 7.0, with 6 interaction modes covering button, knob, touch, gesture, voice and cellphone. BMW iDrive is the first system in the world that adds gesture interaction, which can control phone calls, music playback, volume, map, menu, etc.
Chinese automotive HMI systems mainly embrace Geely GKUI, BYD DiLink, GAC ADiGO, SAIC Banma, Chery Lion, NextEV NIO OS, Xpeng Xmart OS, etc. Among them, Geely GKUI has been upgraded to GKUI2019 with 8 interaction modes via button, knob, touch, voice, cellphone, HUD, face recognition, and smart watch, where unique features are watch interaction (mainly ideal for remote car control and vehicle information inquiry like mobile phone interaction) and face recognition (FACE ID personalized settings).
In short, automotive HMI has entered the multi-modal (voice, gesture, face, etc.) interaction stage and is heading toward functional enrichment and multi-modal fusion. Moreover, HMI will transfer from in-vehicle interaction to multi-scenario interaction, from "passive interaction" to "active interaction".
China Automotive Human-Machine Interaction (HMI) Research Report, 2020 highlights the followings:
HMI (definition and development history), automotive HMI (design, development course, etc.);
Automotive HMI modes (voice interaction, face recognition, gesture recognition, and display inside and outside the vehicle);
Development history and modes of HMI systems of automakers at home and abroad, such as BMW iDrive, Mercedes-Benz MBUX, Audi MMI, Geely GKUI, SAIC Banma SmartDrive, Chery Lion, BYD DiLink, GAC ADiGO, NextEV NIO OS, etc.
Development trends of automotive HMI.
Research on Zonal Architecture: Smart Actuators (Micro-motors) and Application Trends in Sub-scenarios, 2026
Smart Actuator and Micro-motor Research: Under Zonal Architecture, Actuators Are Developing towards Edge Computing, 48V, and Brushless Motors.
The core components of automotive zonal architecture mai...
China Passenger Car Navigate on Autopilot (NOA) Industry Report, 2025
In 2025, NOA standardization was popularized, refined and deepened in parallel. In 2026, core variables will be added to the competitive landscape.
The evolution of autonomous driving follows a clear...
Smart Car OTA Industry Report, 2025-2026
Automotive OTA Research: In the Era of Mandatory Standards, OTA Transforms from a "Function Channel" to a New Stage of "Full Lifecycle Management"
Driven by the development and promotion of AI and so...
Automotive AI Box Research Report, 2026
Automotive AI Box Research: A new path of edge AI accelerates
This report studies the current application status of automotive AI Box from the aspects of scenario demand, product configuration, and i...
Automotive Fragrance and Air Conditioning System Research Report, 2025
Automotive Fragrance and Air Purification Research: Intelligent Fragrance Equipment to Exceed 4 Million Units by 2030, "All-in-One" Integrated Purification Becomes Mainstream
The "Automotive Fragranc...
Intelligent Vehicle Cockpit-driving Integration (Cockpit-driving-parking) Industry Report, 2025
Cockpit-Driving Integration Research: 36% CAGR by 2030, Single-Chip Cockpit-driving integration Solutions Enter Mass Production
ResearchInChina releases the "Intelligent Vehicle Cockpit-driving Integ...
Research Report on Overseas Layout of Chinese Passenger Car OEMs and Supply Chain Companies, 2025
Automotive Overseas Expansion Research: Accelerated Release of OEM Overseas Production Capacity, Chinese Intelligent Supply Chain Goes Global
This report conducts an in-depth analysis of the current ...
Passenger Car Intelligent Steering Industry Research Report, 2025-2026
Intelligent steering research: Rear-wheel steering prices drop to RMB200,000-250,000
1. Rear-wheel steering installations increased by 36.5% year-on-year.
From January to October 2025, the number of...
Global Autonomous Driving Policies & Regulations and Automotive Market Access Research Report, 2025-2026
Research on Intelligent Driving Regulations and Market Access: New Energy Vehicle Exports Double, and "Region-Specific Policies" Adapt to Regulatory Requirements of Various Countries in A Refined Mann...
Two-wheeler Intelligence and Industry Chain Research Report, 2025-2026
Two-Wheeler Electric Vehicle Research: New National Standard Drives Intelligent Popularization, AI Agent Makes Its Way onto Vehicles
ResearchInChina releases the "Two-wheeler Intelligence and Industr...
China Smart Door and Electric Tailgate Market Research Report, 2025
Smart Door Research: Driven by Automatic Doors, Knock-Knock Door Opening, etc., the Market Will Be Worth Over RMB100 Billion in 2030.
This report analyzes and researches the installation, market size...
New Energy Vehicle Thermal Management System Industry Research Report, 2025-2026
Policy and Regulation Drive: Promoting the Development of Electric Vehicle Thermal Management Systems towards Environmental Compliance, Active Safety Protection, and Thermal Runaway Management
Accord...
Intelligent Vehicle Redundant Architecture Design and ADAS Redundancy Strategy Research Report, 2025-2026
Research on Redundant Systems: Septuple Redundancy Architecture Empowers High-Level Intelligent Driving, and New Products Such as Corner Modules and Collision Unlock Modules Will Be Equipped on Vehicl...
Passenger Car Mobile Phone Wireless Charging Research Report, 2025
Automotive Wireless Charging Research: Domestic Installation Rate Will Exceed 50%, and Overseas Demand Emerges as Second Growth Driver.
The Passenger Car Mobile Phone Wireless Charging Research Repor...
Automotive 4D Radar Industry Research Report 2025
4D radar research: From "optional" to "essential," 4D radar's share will exceed 50% by 2030.
1. 4D imaging radar has transformed from an "optional" to a "must-have" sensor.
4D radar adds the detecti...
China Automotive Multimodal Interaction Development Research Report, 2025
Research on Automotive Multimodal Interaction: The Interaction Evolution of L1~L4 Cockpits
ResearchInChina has released the "China Automotive Multimodal Interaction Development Research Report, 2025"...
Automotive Vision Industry Report, 2025
Automotive Vision Research: Average Camera Installation per Vehicle Reaches 5.2 Units, and Front-View Tricam Installation Exceeds 1.2 Million Sets.
From January to September 2025, the total installa...
Automotive Infrared Night Vision System Research Report, 2025
Automotive night vision research: The rise of infrared AEB, with automotive infrared night vision experiencing a 384.7% year-on-year increase from January to September.
From January to September 2025...