China Automotive Human-Machine Interaction (HMI) Research Report, 2020
Automotive HMI refers to the process of information exchange between humans and the car through interaction means such as voice, gesture, face, AR, holographic display and fingerprint recognition.
Over a decade of development, in-car voice interaction was installed to 28.7% of vehicles and even a higher share of new models on the market in the first half of 2019. Voice interaction is extending from infotainment (navigation, multimedia, etc.) to body control (windows, sunroof, lights, wipers, trunk, etc.) and life services (car-home connectivity, in-car shopping, etc.), and voice technology is getting through to infotainment protocols and in-car ecology.
Gesture recognition was first found in BMW model in 2015, and has been successively available in China-made models such as the Traum SEEK 5, Chery 5X, Xpeng G3 Premium, etc. It is mainly used to control the display system in the car, such as music play, volume regulation, map zoom, etc., as a supplementary interactive mode in a quiet environment.
Face recognition, unveiled in China in 2018, has been seen in Leapmotor S01, Chery’s EXEED TX, WEY VV6, WM Motor’s EX5, Geely Xing Yue and other models, showing a rosy prospect. Face recognition is mostly for personalized settings (seat position, ambient light preference, rearview mirror position, music recommendation, etc.) and driver status detection. EXEED TX supports to buy movie tickets by face scanning and heads toward face payment.
In addition, new interactive modes like window interaction (WM Motor's EX5), body interaction (BAIC BJEV's LITE), vein recognition (Leapmotor SO1), fingerprint recognition (Hyundai’s New SantaFe), and AR navigation (Roewe Marvel X) have been available onto production vehicles.
Foreign automotive HMI systems include BMW iDrive, Mercedes-Benz MBUX, Audi MMI, Ford SYNC +, etc. Among them, BMW iDrive has iterated to 7.0, with 6 interaction modes covering button, knob, touch, gesture, voice and cellphone. BMW iDrive is the first system in the world that adds gesture interaction, which can control phone calls, music playback, volume, map, menu, etc.
Chinese automotive HMI systems mainly embrace Geely GKUI, BYD DiLink, GAC ADiGO, SAIC Banma, Chery Lion, NextEV NIO OS, Xpeng Xmart OS, etc. Among them, Geely GKUI has been upgraded to GKUI2019 with 8 interaction modes via button, knob, touch, voice, cellphone, HUD, face recognition, and smart watch, where unique features are watch interaction (mainly ideal for remote car control and vehicle information inquiry like mobile phone interaction) and face recognition (FACE ID personalized settings).
In short, automotive HMI has entered the multi-modal (voice, gesture, face, etc.) interaction stage and is heading toward functional enrichment and multi-modal fusion. Moreover, HMI will transfer from in-vehicle interaction to multi-scenario interaction, from "passive interaction" to "active interaction".
China Automotive Human-Machine Interaction (HMI) Research Report, 2020 highlights the followings:
HMI (definition and development history), automotive HMI (design, development course, etc.);
Automotive HMI modes (voice interaction, face recognition, gesture recognition, and display inside and outside the vehicle);
Development history and modes of HMI systems of automakers at home and abroad, such as BMW iDrive, Mercedes-Benz MBUX, Audi MMI, Geely GKUI, SAIC Banma SmartDrive, Chery Lion, BYD DiLink, GAC ADiGO, NextEV NIO OS, etc.
Development trends of automotive HMI.
Autonomous Driving Domain Controller and Central Computing Unit (CCU) Industry Report, 2026
Autonomous Driving Domain Controller (ADCU) Research: One-Chip CCU solutions are quickly available in vehicles
In China's passenger car market, autonomous driving systems involved in mass production ...
Automotive EMS and ECU Industry Research Report, 2026
Automotive EMS Research: The boundaries between EMS providers and Tier1 suppliers are becoming blurred, and the supply chain model is evolving from a linear chain to a networked structure
Mainstream ...
Automotive Microcontroller Unit (MCU) and Application Scenario Research Report, 2026
Automotive MCU Research: Increased demand for redundant security drives ASIL D-compliant MCU shipments to exceed 100 million units
In a vehicle EEA, MCUs are widely distributed in various functional ...
China Intelligent Cockpit Patent Analysis Report, 2026
Intelligent Cockpit Patent Research: Cockpit AI, In?vehicle Health, and Infotainment Are Upgrade to Scenario?based and Proactive Functions
From a patent perspective, this report explores the cutting?...
Research Report on Application of VLA Large Model in Automobiles and Robots, 2026
Research on Automotive and Robot VLA: Hybrid Architectures Become Mainstream, VLA Integrates with General World Models, and Reinforcement Learning Serves as Core Engine
Vision?Language?Action (VLA) m...
China Charging Infrastructure (Supercharging, Battery Swapping, V2G, etc.) and High-Performance Supercharging Battery Research Report, 2026
Charging and battery swapping research: as 5C+ supercharging vehicle models go into mass production, the pace of OEMs self-building supercharging networks quickens
800-1000V high-voltage platforms ar...
China Passenger Car Electronic Controlled Suspension Industry Report, 2026
Electronic Controlled Suspension Industry Research: As the First Year of Full Active Suspension Unfolds, Three Technical Routes Race Forward
1. Penetration Rate Surges Three Times, and Electronic Con...
Intelligent Driving SoC Research Report, 2026
Research on Intelligent Driving SoCs: Competition Focus Shifts to L3/L4 Embedded Hardware, and Computing Power of Flagship Vehicle Models Exceeds 1,000 TOPS
In terms of intelligent driving system in...
Automotive AI Large Model Technology Research Report, 2026
Automotive AI Large Model Research: Competition Shifts from "Who Has the Stronger Model" to "Who Boasts Higher Link Efficiency"
ResearchInChina released the Automotive AI Large Model Technology Resea...
Intelligent Vehicle Cockpit Domain Controller Research Report, 2026
Cockpit domain controller research: L3 AIDV intelligent cockpit domain controllers are entering a boom period
Driven by multiple factors such as the continuous evolution of the automotive central int...
Automotive Acoustic System (Audio, Multi-Channel) Industry Report, 2026
Automotive Acoustics Research: Multiple Channels, AI Tuning, and Self-Developed Algorithms Drive the Transformation of High-End Cockpit Sound Fields
I. Automotive Audio Hardware Solutions with 6–9 S...
Autonomous Driving Sensor Chip Research Report, 2026
Research on Autonomous Driving Sensor Chips: Deeply Perceiving the Physical World, Sensor Chips Are Playing A “Leading Role” in Intelligence
In 2026, the autonomous driving sensor chip industr...
Passenger Car Corner Module and Wheel‑Side Control System Research Report, 2026
Wheel-side control research: the “last mile” chassis innovation
Wheel-side control dismantles the traditional drive, braking, steering, and suspension control of the chassis from a "centralized" styl...
Embodied Artificial Intelligence (& Humanoid Robot) MCU Research Report, 2026
Research on Humanoid Robot MCUs: Evolution from General-Purpose Control to High-Value Dedicated Chip Solutions Integrated with Edge AI Functions
MCU (Microcontroller Unit) refers to a compact integra...
Intelligent Vehicle Zone Control Unit (ZCU) Research Report, 2026
ZCU Research: Cross-domain integrated ZCUs are becoming the edge computing nodes of the next-generation zonal architecture
Currently, the mainstream zonal architecture is mainly the quasi-central + z...
Automotive Cybersecurity and Data Security Research Report, 2026
Cybersecurity & Data Security Research: Intelligent Connected Vehicles Enter the Era of “Systematic Offense-Defense and AI-Defined Security”.
Centering on the panorama of intelligent connect...
Report on Breakthrough Strategies of OEMs and ADAS Tier 1 Suppliers for Overseas Layout of Intelligent Driving, 2026
Regulatory Breakthrough, Local System Establishment, OEMs Competing for NOA Layout: Overall Trends of China’s Intelligent Driving Overseas Layout in 2026
Research on overseas intelligent driving layo...
OEMs and Tier1s’ Intelligent Cockpit Platform (Hardware and Software) Innovation Strategy Research Report, 2026
Intelligent Cockpit Platform Research: multi-dimensional cockpit system architecture reconstruction for multi-agent collaboration and proactive intelligent services
The intelligent cockpit software s...