AI Foundation Models’ Impacts on Vehicle Intelligent Design and Development Research Report, 2024
AI foundation models are booming. The launch of ChapGPT and SORA is shocking. Scientists and entrepreneurs at AI frontier point out that AI foundation models will rebuild all walks of life, especially tech-related fields. As a technological product, how will intelligent vehicles be changed by AI foundation models?
How foundation models will rebuild intelligent vehicles?
Following the "Automotive AI Foundation Model Technology and Application Trends Report, 2023-2024", a report which discusses impacts of AI foundation models on automotive industry from a macro perspective, ResearchInChina released the "AI Foundation Models’ Impacts on Vehicle Intelligent Design and Development Research Report, 2024", the second report which researches the impacts of AI foundation models on vehicle intelligent design and development in the such aspects as hardware, operating system, application function, and cloud big data.
In 2023, Changan Automobile added AI edge and AI service layer to the original software-driven architecture (SDA) that includes L1-L6 layers. It can be seen that AI technology has affected most layers of intelligent vehicles: L3 EEA layer, L4 vehicle OS layer, L6 vehicle function application layer (including cockpit, connectivity and intelligent driving), L7 cloud big data layer, etc. The chassis part of L1 mechanical layer and the battery part of L2 power layer have actually involved AI application.
Currently, OEMs and Tier1s apply foundation models to part of vehicle intelligence, or to some link in the development process.
When viewing the general application trend of AI foundation models in vehicles, we also need to find an idea in the evolution of foundation models. According to the results of Tencent Research Institute, AI will evolve from the brain to AI Agent, and from CoPilot to autonomous driving.
So, what is AI Agent?
Will foundation model/AI Agent replace OS/APP?
ResearchInChina accepts the view: AI foundation model is the OS, and AI Agent is the application. The development paradigm of intelligent products will be changed from conventional OS-APP ecosystem paradigm to AI foundation model-AI Agent ecosystem paradigm.
What is AI Agent? It is an artificial intelligence (AI) system beyond simple text generation. AI Agent uses a large language model (LLM) as its core computing engine, so that it can make conversations, perform tasks, make inferences, and have a degree of autonomy. In short, AI Agent is a system with complex reasoning capabilities, memory and task execution methods. It is thus clear that NOMI GPT in NIO’s cockpit and Tesla FSD V12 are AI Agents in the cockpit domain and intelligent driving domain, respectively.
AI foundation models, a platform-level AI technology, include those launched by first-tier technology companies, such as ChatGPT and ERNIE Bot. Platform-level AI can serve as the technological foundation to empower operating systems in all aspects. It is regarded as the new kernel of next-generation operating systems. The kernel of conventional operating systems is mainly responsible for managing and scheduling the system's hardware resources like GPU and memory to ensure normal operation and efficient utilization of system. Yet with increasing user demand, AI systems need to parse many human-related personalized experiences.
For personal knowledge base, people's location and status awareness, people's habits and hobbies and other personalization factors, conventional operating systems fall short of effective calculation and processing. We thus need a brand-new kernel to meet these requirements. The strength of platform-level AI foundation models is that they can manage and process multiple personal factors and help the operating system accurately recognize user intents. With such capabilities, fire-new operating systems can bring everyone an intelligent experience of “guess what you want and understand what you need.”
In automotive cockpit applications, to achieve true personalization, automakers also need to further customize the AI foundation model according to the features of their own vehicle models and services, that is, AI Agent based on platform-level AI foundation model. We can see that Geely models (such as Jiyue and Galaxy) are based on Baidu ERNIE Bot-based cockpit systems, and Mercedes-Benz's in-car voice assistant are actually an AI Agent after being connected to ChatGPT.
At present, intelligent driving AI Agent and cockpit AI Agent are separate. As cockpit-driving integration develops, they will tend to be integrated. However when considering cockpit-driving integration, OEMs and Tier1s cannot only consider integration at the hardware level, but also need to take into account operating system and vehicle system architecture, especially rapid evolution of foundation models/AI Agent models.
Foundation model/AI Agent is currently a part of an operating system/APP ecosystem. Will it replace operating systems/APP models in the future? We think it's possible.
Foundation model-based agents will not only allow everyone to have an exclusive intelligent assistant with enhanced capabilities, but also change the mode of human-machine cooperation and bring broader human-machine fusion. There are three human-AI cooperation modes: Embedding, Copilot, and Agent.
In intelligent driving, the Embedding mode is equivalent to L1-L2 autonomous driving; the Copilot mode, L2.5 and highway NOA; the Agent mode, urban NOA and L3 autonomous driving.
In the Agent mode, humans set goals and provide necessary resources (e.g., computing power), then AI independently undertakes most of tasks, and finally humans supervise the process and evaluate the final results. In this mode, AI fully embodies the interactive, autonomous and adaptable characteristics of Agents and is close to an independent actor, while humans play more of a supervisor and evaluator role.
A large number of interactive operations that were originally enabled via IVI APP can now be achieved through natural interactions (voice, gesture, etc.) in the AI Agent mode. AI Agent even actively observes the inside and outside of the vehicle, makes a request inquiry, and can perform a task after being confirmed by the user.
Therefore, the development of AI Agent is bound to make a mass of previous apps unnecessary and will have a disruptive impact on the development and application of intelligent cockpit and intelligent driving.
The current AI foundation models are not an operating system, but a paradigm and architecture of AI models, focusing on how to enable machines to process multimodal data (text, image, video, etc.). AI Agent is more similar to an AI application or application layer, which requires the support of the underlying operating system and hardware for operation. It is not in itself responsible for the basic management and resource scheduling of the computer system. In the future, AI foundation models are likely to be combined with OS to become AIOS.
AI foundation models and AI Agent development have the following impacts on future operating systems:
Applets will disappear or evolve into AI Agent that calls foundation models;
OS may evolve into the foundation model + computing chip core cluster OS architecture;
AI foundation models as a platform redefine and empower all kinds of industrial application scenarios, and give rise to more human-computer interaction-centric native applications, including autonomous vehicles, robots and digital twin applications.
Analysis on Xpeng’s Layout in Electrification, Connectivity, Intelligence and Sharing, 2023
Research on Xpeng’s layout in electrification, connectivity, intelligence and sharing: in the innovation-driven rapid development, secured orders for 100 flying cars.
NIO, Xp...
Automotive Cockpit SoC Research Report, 2024
Automotive Cockpit SoC Research: Automakers quicken their pace of buying SoCs, and the penetration of domestic cockpit SoCs will soar
Mass production of local cockpit SoCs is accelerating, and the l...
Automotive Integrated Die Casting Industry Report, 2024
Integrated Die Casting Research: adopted by nearly 20 OEMs, integrated die casting gains popularity.
Automotive Integrated Die Casting Industry Report, 2024 released by ResearchInChina summari...
China Passenger Car Cockpit Multi/Dual Display Research Report, 2023-2024
In intelligent cockpit era, cockpit displays head in the direction of more screens, larger size, better looking, more convenient interaction and better experience. Simultaneously, the conventional “on...
Automotive Microcontroller Unit (MCU) Industry Report, 2024
With policy support, the localization rate of automotive MCU will surge.
Chinese electric vehicle companies are quickening their pace of purchasing domestic chips to reduce their dependence on impor...
Automotive Digital Key Industry Trends Research Report, 2024
Automotive Digital Key Industry Trends Research Report, 2024 released by ResearchInChina highlights the following: Forecast for automotive digital key market;Digital key standard specifications and co...
Automotive XR (VR/AR/MR) Industry Report, 2024
Automotive XR (Extended Reality) is an innovative technology that integrates VR (Virtual Reality), AR (Augmented Reality) and MR (Mixed Reality) technologies into vehicle systems. It can bring drivers...
OEMs’ Next-generation In-vehicle Infotainment (IVI) System Trends Report, 2024
OEMs’ Next-generation In-vehicle Infotainment (IVI) System Trends Report, 2024 released by ResearchInChina systematically analyzes the iteration process of IVI systems of mainstream automakers in Chin...
Global and China Automotive Lighting System Research Report, 2023-2024
Installations of intelligent headlights and interior lighting systems made steady growth.
From 2019 to 2023, the installations of intelligent headlights and interior lighting systems grew steadily. I...
Automotive Display, Center Console and Cluster Industry Report, 2024
Automotive display has become a hotspot major automakers compete for to create personalized and differentiated vehicle models. To improve users' driving experience and meet their needs for human-compu...
Global and China Passenger Car T-Box Market Report, 2024
Global and China Passenger Car T-Box Market Report, 2024 combs and summarizes the overall global and Chinese passenger car T-Box markets and the status quo of independent, centralized, V2X, and 5G T-B...
AI Foundation Models’ Impacts on Vehicle Intelligent Design and Development Research Report, 2024
AI foundation models are booming. The launch of ChapGPT and SORA is shocking. Scientists and entrepreneurs at AI frontier point out that AI foundation models will rebuild all walks of life, especially...
Analysis on Geely's Layout in Electrification, Connectivity, Intelligence and Sharing
Geely, one of the leading automotive groups in China, makes comprehensive layout in electrification, connectivity, intelligence and sharing.
Geely boasts more than ten brands. In 2023, it sold a tota...
48V Low-voltage Power Distribution Network (PDN) Architecture Industry Report, 2024
Automotive low-voltage PDN architecture evolves from 12V to 48V system.
Since 1950, the automotive industry has introduced the 12V system to power lighting, entertainment, electronic control units an...
Automotive Ultrasonic Radar and OEMs’ Parking Route Research Report, 2024
1. Over 220 million ultrasonic radars will be installed in 2028.
In recent years, the installations of ultrasonic radars in passenger cars in China surged, up to 121.955 million units in 2023, jumpin...
Automotive AI Foundation Model Technology and Application Trends Report, 2023-2024
Since 2023 ever more vehicle models have begun to be connected with foundation models, and an increasing number of Tier1s have launched automotive foundation model solutions. Especially Tesla’s big pr...
Qualcomm 8295 Based Cockpit Domain Controller Dismantling Analysis Report
ResearchInChina dismantled 8295-based cockpit domain controller of an electric sedan launched in December 2023, and produced the report SA8295P Series Based Cockpit Domain Controller Analysis and Dism...
Global and China Automotive Comfort System (Seating system, Air Conditioning System) Research Report, 2024
Automotive comfort systems include seating system, air conditioning system, soundproof system and chassis suspension to improve comfort of drivers and passengers. This report highlights seating system...