Autonomous Driving Algorithm Research: BEV Drives Algorithm Revolution, AI Large Model Promotes Algorithm Iteration
The core of the autonomous driving algorithm technical framework is divided into three parts: environment perception, decision planning, and control execution.
Environment perception: convert sensor data into machine language of the scenario where the vehicle is located, which can include object detection, recognition and tracking, environment modeling, motion estimation, etc.;
Decision planning: Based on the output results of perception algorithm, the final behavioral action instructions are given, including behavioral decisions (vehicle following, stopping and overtaking), action decisions (car steering, speed, etc.), path planning, etc.;
Control actuation: according to the output results of decision-making level, the underlying modules are mobilized to issue instructions to the core control components such as accelerator and brake, and promote vehicle to drive according to the planned route.
BEV drives algorithm revolution
In recent years, BEV perception has received extensive attention. BEV model mainly provides a unified space to facilitate the fusion of various tasks and sensors. It has following advantages:
BEV unifies the multimodal data processing dimension and makes multimodal fusion easier
The BEV perception system converts the information obtained from multiple cameras or radars to a bird's-eye view, and then do tasks such as object detection and instance segmentation, which can more intuitively display the dimension and direction of objects in BEV space.
In 2022, Peking University & Ali proposed a fusion framework of LiDAR and vision - BEVFusion. The processing of radar point clouds and image processing are carried out independently, using neural networks to encode, project to a unified BEV space, and then merge the two in BEV space.
Realize timing information fusion and build 4D space
In the 4D space, the perception algorithm can better complete the perception tasks such as speed measurement, and can transmit the results of motion prediction to the decision and control module.
PhiGent Robotics proposed BEVDet4D in 2022, which is a version based on BEVDet to increase timing fusion. BEVDet4D extends BEVDet by retaining intermediate BEV features of past frames, and then fuses features by aligning and splicing with the current frame, so that time clues can be obtained by querying two candidate features.
Imagine occluded objects to realize object prediction
In the BEV space, the algorithm can predict the occluded area based on prior knowledge, and imagine whether there are objects in the occluded area.
FIERY, proposed by Wayve in cooperation with the University of Cambridge in 2021, is an end-to-end road dynamic object instance prediction algorithm that does not rely on high-precision maps and is only based on aerial views of monocular cameras.
Promoting development of an end-to-end autonomous driving framework
In the BEV space, perception and prediction can be directly optimized end-to-end through neural networks in a unified space, and the results can be obtained at the same time. Not only the perception module, but also the BEV-based planning decision-making module is also the direction of academic research.
In 2022, autonomous driving team of Shanghai Artificial Intelligence Laboratory and the team of associate professor Yan Junchi of Shanghai Jiao Tong University collaborated on paper ST-P3 to propose a spatiotemporal feature learning solution that can simultaneously provide a set of more representative features for perception, prediction and planning tasks.
AI large model drives algorithm iteration
After 2012, deep learning algorithms are widely applied in autonomous driving field. In order to support larger and more complex AI computing needs, AI large models with the characteristics of "huge data, huge computing power, and huge algorithms" were born, which accelerated the iteration speed of algorithms.
Large Model and Intelligent Computing Center
In 2021, HAOMO.AI launched research and landing attempts on large-scale Transformer model, and then gradually applied it on a large scale in projects including multi-modal perception data fusion and cognitive model training. In December 2021, HAOMO.AI released autonomous driving data intelligence system MANA (Chinese name "Snow Lake"), which integrates perception, cognition, labeling, simulation, computing and other aspects. In January 2023, HAOMO.AI together with Volcano Engine unveiled MANA OASIS, a supercomputing center with a total computing power of 670 PFLOPS. After deploying HAOMO.AI's training platform, OASIS can run various applications including cloud large-scale model training, vehicle-side model training, annotation, and simulation. With the help of MANA OASIS, the five major models of HAOMO.AI have ushered in a new appearance and upgrade.
In August 2022, based on Alibaba Cloud intelligent computing platform, Xpeng Motors built an autonomous driving intelligent computing center "Fuyao", which is dedicated to training of autonomous driving models. In October 2022, Xpeng also announced the introduction of Transformer large model.
In November 2022, Baidu released Wenxin Big Model. Leveraging more than 1 billion parameters, it recognizes thousands of objects, helping to enlarge the scope of semantic recognition. At present, it is mainly used in three aspects: distance vision, multimodality and data mining.
Analysis on Xpeng’s Layout in Electrification, Connectivity, Intelligence and Sharing, 2023
Research on Xpeng’s layout in electrification, connectivity, intelligence and sharing: in the innovation-driven rapid development, secured orders for 100 flying cars.
NIO, Xp...
Automotive Cockpit SoC Research Report, 2024
Automotive Cockpit SoC Research: Automakers quicken their pace of buying SoCs, and the penetration of domestic cockpit SoCs will soar
Mass production of local cockpit SoCs is accelerating, and the l...
Automotive Integrated Die Casting Industry Report, 2024
Integrated Die Casting Research: adopted by nearly 20 OEMs, integrated die casting gains popularity.
Automotive Integrated Die Casting Industry Report, 2024 released by ResearchInChina summari...
China Passenger Car Cockpit Multi/Dual Display Research Report, 2023-2024
In intelligent cockpit era, cockpit displays head in the direction of more screens, larger size, better looking, more convenient interaction and better experience. Simultaneously, the conventional “on...
Automotive Microcontroller Unit (MCU) Industry Report, 2024
With policy support, the localization rate of automotive MCU will surge.
Chinese electric vehicle companies are quickening their pace of purchasing domestic chips to reduce their dependence on impor...
Automotive Digital Key Industry Trends Research Report, 2024
Automotive Digital Key Industry Trends Research Report, 2024 released by ResearchInChina highlights the following: Forecast for automotive digital key market;Digital key standard specifications and co...
Automotive XR (VR/AR/MR) Industry Report, 2024
Automotive XR (Extended Reality) is an innovative technology that integrates VR (Virtual Reality), AR (Augmented Reality) and MR (Mixed Reality) technologies into vehicle systems. It can bring drivers...
OEMs’ Next-generation In-vehicle Infotainment (IVI) System Trends Report, 2024
OEMs’ Next-generation In-vehicle Infotainment (IVI) System Trends Report, 2024 released by ResearchInChina systematically analyzes the iteration process of IVI systems of mainstream automakers in Chin...
Global and China Automotive Lighting System Research Report, 2023-2024
Installations of intelligent headlights and interior lighting systems made steady growth.
From 2019 to 2023, the installations of intelligent headlights and interior lighting systems grew steadily. I...
Automotive Display, Center Console and Cluster Industry Report, 2024
Automotive display has become a hotspot major automakers compete for to create personalized and differentiated vehicle models. To improve users' driving experience and meet their needs for human-compu...
Global and China Passenger Car T-Box Market Report, 2024
Global and China Passenger Car T-Box Market Report, 2024 combs and summarizes the overall global and Chinese passenger car T-Box markets and the status quo of independent, centralized, V2X, and 5G T-B...
AI Foundation Models’ Impacts on Vehicle Intelligent Design and Development Research Report, 2024
AI foundation models are booming. The launch of ChapGPT and SORA is shocking. Scientists and entrepreneurs at AI frontier point out that AI foundation models will rebuild all walks of life, especially...
Analysis on Geely's Layout in Electrification, Connectivity, Intelligence and Sharing
Geely, one of the leading automotive groups in China, makes comprehensive layout in electrification, connectivity, intelligence and sharing.
Geely boasts more than ten brands. In 2023, it sold a tota...
48V Low-voltage Power Distribution Network (PDN) Architecture Industry Report, 2024
Automotive low-voltage PDN architecture evolves from 12V to 48V system.
Since 1950, the automotive industry has introduced the 12V system to power lighting, entertainment, electronic control units an...
Automotive Ultrasonic Radar and OEMs’ Parking Route Research Report, 2024
1. Over 220 million ultrasonic radars will be installed in 2028.
In recent years, the installations of ultrasonic radars in passenger cars in China surged, up to 121.955 million units in 2023, jumpin...
Automotive AI Foundation Model Technology and Application Trends Report, 2023-2024
Since 2023 ever more vehicle models have begun to be connected with foundation models, and an increasing number of Tier1s have launched automotive foundation model solutions. Especially Tesla’s big pr...
Qualcomm 8295 Based Cockpit Domain Controller Dismantling Analysis Report
ResearchInChina dismantled 8295-based cockpit domain controller of an electric sedan launched in December 2023, and produced the report SA8295P Series Based Cockpit Domain Controller Analysis and Dism...
Global and China Automotive Comfort System (Seating system, Air Conditioning System) Research Report, 2024
Automotive comfort systems include seating system, air conditioning system, soundproof system and chassis suspension to improve comfort of drivers and passengers. This report highlights seating system...