China Automotive Human-Machine Interaction (HMI) Research Report, 2020
Automotive HMI refers to the process of information exchange between humans and the car through interaction means such as voice, gesture, face, AR, holographic display and fingerprint recognition.
Over a decade of development, in-car voice interaction was installed to 28.7% of vehicles and even a higher share of new models on the market in the first half of 2019. Voice interaction is extending from infotainment (navigation, multimedia, etc.) to body control (windows, sunroof, lights, wipers, trunk, etc.) and life services (car-home connectivity, in-car shopping, etc.), and voice technology is getting through to infotainment protocols and in-car ecology.
Gesture recognition was first found in BMW model in 2015, and has been successively available in China-made models such as the Traum SEEK 5, Chery 5X, Xpeng G3 Premium, etc. It is mainly used to control the display system in the car, such as music play, volume regulation, map zoom, etc., as a supplementary interactive mode in a quiet environment.
Face recognition, unveiled in China in 2018, has been seen in Leapmotor S01, Chery’s EXEED TX, WEY VV6, WM Motor’s EX5, Geely Xing Yue and other models, showing a rosy prospect. Face recognition is mostly for personalized settings (seat position, ambient light preference, rearview mirror position, music recommendation, etc.) and driver status detection. EXEED TX supports to buy movie tickets by face scanning and heads toward face payment.
In addition, new interactive modes like window interaction (WM Motor's EX5), body interaction (BAIC BJEV's LITE), vein recognition (Leapmotor SO1), fingerprint recognition (Hyundai’s New SantaFe), and AR navigation (Roewe Marvel X) have been available onto production vehicles.
Foreign automotive HMI systems include BMW iDrive, Mercedes-Benz MBUX, Audi MMI, Ford SYNC +, etc. Among them, BMW iDrive has iterated to 7.0, with 6 interaction modes covering button, knob, touch, gesture, voice and cellphone. BMW iDrive is the first system in the world that adds gesture interaction, which can control phone calls, music playback, volume, map, menu, etc.
Chinese automotive HMI systems mainly embrace Geely GKUI, BYD DiLink, GAC ADiGO, SAIC Banma, Chery Lion, NextEV NIO OS, Xpeng Xmart OS, etc. Among them, Geely GKUI has been upgraded to GKUI2019 with 8 interaction modes via button, knob, touch, voice, cellphone, HUD, face recognition, and smart watch, where unique features are watch interaction (mainly ideal for remote car control and vehicle information inquiry like mobile phone interaction) and face recognition (FACE ID personalized settings).
In short, automotive HMI has entered the multi-modal (voice, gesture, face, etc.) interaction stage and is heading toward functional enrichment and multi-modal fusion. Moreover, HMI will transfer from in-vehicle interaction to multi-scenario interaction, from "passive interaction" to "active interaction".
China Automotive Human-Machine Interaction (HMI) Research Report, 2020 highlights the followings:
HMI (definition and development history), automotive HMI (design, development course, etc.);
Automotive HMI modes (voice interaction, face recognition, gesture recognition, and display inside and outside the vehicle);
Development history and modes of HMI systems of automakers at home and abroad, such as BMW iDrive, Mercedes-Benz MBUX, Audi MMI, Geely GKUI, SAIC Banma SmartDrive, Chery Lion, BYD DiLink, GAC ADiGO, NextEV NIO OS, etc.
Development trends of automotive HMI.
Intelligent Driving SoC Research Report, 2026
Research on Intelligent Driving SoCs: Competition Focus Shifts to L3/L4 Embedded Hardware, and Computing Power of Flagship Vehicle Models Exceeds 1,000 TOPS
In terms of intelligent driving system in...
Automotive AI Large Model Technology Research Report, 2026
Automotive AI Large Model Research: Competition Shifts from "Who Has the Stronger Model" to "Who Boasts Higher Link Efficiency"
ResearchInChina released the Automotive AI Large Model Technology Resea...
Intelligent Vehicle Cockpit Domain Controller Research Report, 2026
Cockpit domain controller research: L3 AIDV intelligent cockpit domain controllers are entering a boom period
Driven by multiple factors such as the continuous evolution of the automotive central int...
Automotive Acoustic System (Audio, Multi-Channel) Industry Report, 2026
Automotive Acoustics Research: Multiple Channels, AI Tuning, and Self-Developed Algorithms Drive the Transformation of High-End Cockpit Sound Fields
I. Automotive Audio Hardware Solutions with 6–9 S...
Autonomous Driving Sensor Chip Research Report, 2026
Research on Autonomous Driving Sensor Chips: Deeply Perceiving the Physical World, Sensor Chips Are Playing A “Leading Role” in Intelligence
In 2026, the autonomous driving sensor chip industr...
Passenger Car Corner Module and Wheel‑Side Control System Research Report, 2026
Wheel-side control research: the “last mile” chassis innovation
Wheel-side control dismantles the traditional drive, braking, steering, and suspension control of the chassis from a "centralized" styl...
Embodied Artificial Intelligence (& Humanoid Robot) MCU Research Report, 2026
Research on Humanoid Robot MCUs: Evolution from General-Purpose Control to High-Value Dedicated Chip Solutions Integrated with Edge AI Functions
MCU (Microcontroller Unit) refers to a compact integra...
Intelligent Vehicle Zone Control Unit (ZCU) Research Report, 2026
ZCU Research: Cross-domain integrated ZCUs are becoming the edge computing nodes of the next-generation zonal architecture
Currently, the mainstream zonal architecture is mainly the quasi-central + z...
Automotive Cybersecurity and Data Security Research Report, 2026
Cybersecurity & Data Security Research: Intelligent Connected Vehicles Enter the Era of “Systematic Offense-Defense and AI-Defined Security”.
Centering on the panorama of intelligent connect...
Report on Breakthrough Strategies of OEMs and ADAS Tier 1 Suppliers for Overseas Layout of Intelligent Driving, 2026
Regulatory Breakthrough, Local System Establishment, OEMs Competing for NOA Layout: Overall Trends of China’s Intelligent Driving Overseas Layout in 2026
Research on overseas intelligent driving layo...
OEMs and Tier1s’ Intelligent Cockpit Platform (Hardware and Software) Innovation Strategy Research Report, 2026
Intelligent Cockpit Platform Research: multi-dimensional cockpit system architecture reconstruction for multi-agent collaboration and proactive intelligent services
The intelligent cockpit software s...
Automotive AIOS Research Report, 2026
Automotive AIOS Research: Mass Production Solutions Are Implemented
Mass Production Solutions Are Implemented on A Small Scale.
In 2026, AIOS starts small-scale implementation, helping to improve v...
Automotive Telematics Service Provider (TSP) Research Report, 2026
TSP Research: Leading providers collectively turn to AI agents to provide all-scenario active services
Telematics Service Providers (TSPs) are the core hub of the telematics industry chain, connectin...
Automotive Smart Interior Research Report, 2026
Smart Interior Research: As Technologies like Interactive Starlight Headliner, Hidden Display and Surface Projection Are Launched, Automotive Interiors Become Ever More Intelligent
The Automotive Sma...
Research Report on AI Applications in Cockpits, 2026
AI Application in Cockpits: AI Services Become More Comprehensive, Convenient, and Refined.
In the first half of 2026, cockpit AI functions underwent initial upgrades across multiple dimensions, inc...
Software-Defined Vehicles in 2026: OEM Software Development and Supply Chain Deployment Strategy Research Report
Research on OEMs’ Software Strategies: R&D Focus, Development Strategies and Supplier Building Models of 30 OEMs
In this paper, we adopt a research framework covering 13 subsystems and 48 sub-di...
Passenger Car Chassis Domain Control and Chassis Cross-Domain Integration Research Report, 2026
Chassis Control Research: Mass Production of Full Chassis-by-Wire Solutions Starts
1. A Cluster of Full Chassis-by-Wire Solutions Make Their Debut, and EMB Enters Mass Production and Adoption for the...
Central Domain Control (Powertrain, Chassis, Body) and Motion Controller Research Report, 2026
Central Domain Control and Motion Control Research: XYZ Coordinated Control and Full X-by-Wire Actuation System
With the gradual penetration of L3+ autonomous driving, the chassis control system is ...