Autonomous Driving Algorithm Research: BEV Drives Algorithm Revolution, AI Large Model Promotes Algorithm Iteration
The core of the autonomous driving algorithm technical framework is divided into three parts: environment perception, decision planning, and control execution.
Environment perception: convert sensor data into machine language of the scenario where the vehicle is located, which can include object detection, recognition and tracking, environment modeling, motion estimation, etc.;
Decision planning: Based on the output results of perception algorithm, the final behavioral action instructions are given, including behavioral decisions (vehicle following, stopping and overtaking), action decisions (car steering, speed, etc.), path planning, etc.;
Control actuation: according to the output results of decision-making level, the underlying modules are mobilized to issue instructions to the core control components such as accelerator and brake, and promote vehicle to drive according to the planned route.
BEV drives algorithm revolution
In recent years, BEV perception has received extensive attention. BEV model mainly provides a unified space to facilitate the fusion of various tasks and sensors. It has following advantages:
BEV unifies the multimodal data processing dimension and makes multimodal fusion easier
The BEV perception system converts the information obtained from multiple cameras or radars to a bird's-eye view, and then do tasks such as object detection and instance segmentation, which can more intuitively display the dimension and direction of objects in BEV space.
In 2022, Peking University & Ali proposed a fusion framework of LiDAR and vision - BEVFusion. The processing of radar point clouds and image processing are carried out independently, using neural networks to encode, project to a unified BEV space, and then merge the two in BEV space.
Realize timing information fusion and build 4D space
In the 4D space, the perception algorithm can better complete the perception tasks such as speed measurement, and can transmit the results of motion prediction to the decision and control module.
PhiGent Robotics proposed BEVDet4D in 2022, which is a version based on BEVDet to increase timing fusion. BEVDet4D extends BEVDet by retaining intermediate BEV features of past frames, and then fuses features by aligning and splicing with the current frame, so that time clues can be obtained by querying two candidate features.
Imagine occluded objects to realize object prediction
In the BEV space, the algorithm can predict the occluded area based on prior knowledge, and imagine whether there are objects in the occluded area.
FIERY, proposed by Wayve in cooperation with the University of Cambridge in 2021, is an end-to-end road dynamic object instance prediction algorithm that does not rely on high-precision maps and is only based on aerial views of monocular cameras.
Promoting development of an end-to-end autonomous driving framework
In the BEV space, perception and prediction can be directly optimized end-to-end through neural networks in a unified space, and the results can be obtained at the same time. Not only the perception module, but also the BEV-based planning decision-making module is also the direction of academic research.
In 2022, autonomous driving team of Shanghai Artificial Intelligence Laboratory and the team of associate professor Yan Junchi of Shanghai Jiao Tong University collaborated on paper ST-P3 to propose a spatiotemporal feature learning solution that can simultaneously provide a set of more representative features for perception, prediction and planning tasks.
AI large model drives algorithm iteration
After 2012, deep learning algorithms are widely applied in autonomous driving field. In order to support larger and more complex AI computing needs, AI large models with the characteristics of "huge data, huge computing power, and huge algorithms" were born, which accelerated the iteration speed of algorithms.
Large Model and Intelligent Computing Center
In 2021, HAOMO.AI launched research and landing attempts on large-scale Transformer model, and then gradually applied it on a large scale in projects including multi-modal perception data fusion and cognitive model training. In December 2021, HAOMO.AI released autonomous driving data intelligence system MANA (Chinese name "Snow Lake"), which integrates perception, cognition, labeling, simulation, computing and other aspects. In January 2023, HAOMO.AI together with Volcano Engine unveiled MANA OASIS, a supercomputing center with a total computing power of 670 PFLOPS. After deploying HAOMO.AI's training platform, OASIS can run various applications including cloud large-scale model training, vehicle-side model training, annotation, and simulation. With the help of MANA OASIS, the five major models of HAOMO.AI have ushered in a new appearance and upgrade.
In August 2022, based on Alibaba Cloud intelligent computing platform, Xpeng Motors built an autonomous driving intelligent computing center "Fuyao", which is dedicated to training of autonomous driving models. In October 2022, Xpeng also announced the introduction of Transformer large model.
In November 2022, Baidu released Wenxin Big Model. Leveraging more than 1 billion parameters, it recognizes thousands of objects, helping to enlarge the scope of semantic recognition. At present, it is mainly used in three aspects: distance vision, multimodality and data mining.
Emerging Carmaker Strategy Research Report, 2023 - NIO
Emerging carmaker strategy research: NIO is deploying battery swap and sub-brands for the knockout match in 2023.In 2022, the sales surged by 32.3% year on year, being concentrated in first-tier citie...
Nissan CASE (Connectivity, Automation, Sharing and Electrification) Layout Research Report, 2022-2023
Nissan CASE research: two leverages for Dongfeng Nissan to turn the tables. Introduction: since 2020, the declining sales of Dongfeng Nissan have exposed its problems in brand influence and product co...
China Automotive Gesture Interaction Development Research Report,2022-2023
Vehicle gesture interaction research: in 2022, the installations rocketed by 315.6% year on year.China Automotive Gesture Interaction Development Research Report, 2022-2023 released by ResearchInChina...
Automotive Power Management Integrated Circuits (PMIC) Industry Report, 2023
Automotive PMIC research: the process of domestic automotive PMICs replacing foreign ones in China in the “crisis of chip shortage”.
Automotive power management integrated circuits (PMIC) find broad ...
Automotive Cockpit SoC Research Report, 2023
Cockpit SoC research in 2023: Can X86 solutions returning to cockpit SoC challenge the “ARM+Google” mobile solution?
This report highlights the research on the products and plans of 9 overseas and 8 ...
AI Foundation Model and Autonomous Driving Intelligent Computing Center Research Report, 2023
New infrastructures for autonomous driving: AI foundation models and intelligent computing centers are emerging.
In recent years, the boom of artificial intelligence has actuated autonomous driving, ...
Automotive Microcontroller Unit (MCU) Industry Report, 2023
MCU Industry Research: Automotive high-end MCU will be still in short supply, and how OEMs can break the situation.
ResearchInChina has released "Automotive Microcontroller Unit (MCU) Industry Repor...
Global and China Fuel Cell Market and Trend Research Report, 2023
Fuel Cell Industry Research: Hydrogen energy has been put on the national agenda with scenario application being rolled out.The hydrogen energy industry has been included into the national energy stra...
Global and China Automotive Smart Antenna Research Report, 2022-2023
Smart antenna research: the integration of automotive antennas and intelligent connected terminals tends to accelerate.
The development trend of automotive antennas: tend to be intelligent, diversif...
Chinese Independent OEMs’ Telematics System and Entertainment Ecosystem Research Report, 2022
Vehicle telematics system research 1: the control scope is expected to expand to the entire vehicle.From January to December 2022, Chinese independent OEMs installed telematics systems in 6.42 million...
China Autonomous Shuttle Market Report, 2022-2023
Autonomous Shuttle Research: application scenarios further extend amidst policy promotion and continuous exploration
Autonomous shuttles are roughly categorized into minibuses and robobuses. Minibuse...
Intelligent Cockpit Domain Control Unit (DCU) and Head Unit Dismantling Report, 2023 (1)
Dismantling of Head Unit and Cockpit Domain Control Unit (DCU) of NIO, Toyota and Great Wall Motor The report highlights the dismantling of Toyota’s MT2712-based head unit, Fisker’s Intel A2960-based ...
Automotive Vision Algorithm Industry Research Report, 2023
Research on automotive vision algorithms: focusing on urban scenarios, BEV evolves into three technology routes.1. What is BEV?
BEV (Bird's Eye View), also known as God's Eye View, is an end-to-end t...
ADAS Domain Controller Key Component Trends Report, 2022
ResearchInChina researched and summarized China’s current mainstream high computing power ADAS domain controller products such as Huawei MDC and DJI ADAS domain controller prototype, and technical inf...
Automotive High-precision Positioning Research Report, 2023
High Precision Positioning Research: four forms of mass-produced integrated high-precision positioning products
With the continuous development of autonomous driving, the demand for high-precis...
Automotive AUTOSAR Platform Research Report, 2023
AUTOSAR research: CP + AP integration, ecosystem construction, and localization will be the key directions.
AUTOSAR standard technology keeps upgrading, and the willingness to build open cooperation ...
China Autonomous Driving Algorithm Research Report, 2023
Autonomous Driving Algorithm Research: BEV Drives Algorithm Revolution, AI Large Model Promotes Algorithm Iteration
The core of the autonomous driving algorithm technical framework is divided into th...
Dismantling Report: DJI Front View Binocular Camera and Innovusion LIDAR
Dismantling Report: DJI Front View Binocular Camera and Innovusion LIDAR
Recently, ResearchInChina selected two key components essential to current intelligent driving assistance systems - front view...