Autonomous Driving Algorithm Research: BEV Drives Algorithm Revolution, AI Large Model Promotes Algorithm Iteration
The core of the autonomous driving algorithm technical framework is divided into three parts: environment perception, decision planning, and control execution.
Environment perception: convert sensor data into machine language of the scenario where the vehicle is located, which can include object detection, recognition and tracking, environment modeling, motion estimation, etc.;
Decision planning: Based on the output results of perception algorithm, the final behavioral action instructions are given, including behavioral decisions (vehicle following, stopping and overtaking), action decisions (car steering, speed, etc.), path planning, etc.;
Control actuation: according to the output results of decision-making level, the underlying modules are mobilized to issue instructions to the core control components such as accelerator and brake, and promote vehicle to drive according to the planned route.
BEV drives algorithm revolution
In recent years, BEV perception has received extensive attention. BEV model mainly provides a unified space to facilitate the fusion of various tasks and sensors. It has following advantages:
BEV unifies the multimodal data processing dimension and makes multimodal fusion easier
The BEV perception system converts the information obtained from multiple cameras or radars to a bird's-eye view, and then do tasks such as object detection and instance segmentation, which can more intuitively display the dimension and direction of objects in BEV space.
In 2022, Peking University & Ali proposed a fusion framework of LiDAR and vision - BEVFusion. The processing of radar point clouds and image processing are carried out independently, using neural networks to encode, project to a unified BEV space, and then merge the two in BEV space.
Realize timing information fusion and build 4D space
In the 4D space, the perception algorithm can better complete the perception tasks such as speed measurement, and can transmit the results of motion prediction to the decision and control module.
PhiGent Robotics proposed BEVDet4D in 2022, which is a version based on BEVDet to increase timing fusion. BEVDet4D extends BEVDet by retaining intermediate BEV features of past frames, and then fuses features by aligning and splicing with the current frame, so that time clues can be obtained by querying two candidate features.
Imagine occluded objects to realize object prediction
In the BEV space, the algorithm can predict the occluded area based on prior knowledge, and imagine whether there are objects in the occluded area.
FIERY, proposed by Wayve in cooperation with the University of Cambridge in 2021, is an end-to-end road dynamic object instance prediction algorithm that does not rely on high-precision maps and is only based on aerial views of monocular cameras.
Promoting development of an end-to-end autonomous driving framework
In the BEV space, perception and prediction can be directly optimized end-to-end through neural networks in a unified space, and the results can be obtained at the same time. Not only the perception module, but also the BEV-based planning decision-making module is also the direction of academic research.
In 2022, autonomous driving team of Shanghai Artificial Intelligence Laboratory and the team of associate professor Yan Junchi of Shanghai Jiao Tong University collaborated on paper ST-P3 to propose a spatiotemporal feature learning solution that can simultaneously provide a set of more representative features for perception, prediction and planning tasks.
AI large model drives algorithm iteration
After 2012, deep learning algorithms are widely applied in autonomous driving field. In order to support larger and more complex AI computing needs, AI large models with the characteristics of "huge data, huge computing power, and huge algorithms" were born, which accelerated the iteration speed of algorithms.
Large Model and Intelligent Computing Center
In 2021, HAOMO.AI launched research and landing attempts on large-scale Transformer model, and then gradually applied it on a large scale in projects including multi-modal perception data fusion and cognitive model training. In December 2021, HAOMO.AI released autonomous driving data intelligence system MANA (Chinese name "Snow Lake"), which integrates perception, cognition, labeling, simulation, computing and other aspects. In January 2023, HAOMO.AI together with Volcano Engine unveiled MANA OASIS, a supercomputing center with a total computing power of 670 PFLOPS. After deploying HAOMO.AI's training platform, OASIS can run various applications including cloud large-scale model training, vehicle-side model training, annotation, and simulation. With the help of MANA OASIS, the five major models of HAOMO.AI have ushered in a new appearance and upgrade.
In August 2022, based on Alibaba Cloud intelligent computing platform, Xpeng Motors built an autonomous driving intelligent computing center "Fuyao", which is dedicated to training of autonomous driving models. In October 2022, Xpeng also announced the introduction of Transformer large model.
In November 2022, Baidu released Wenxin Big Model. Leveraging more than 1 billion parameters, it recognizes thousands of objects, helping to enlarge the scope of semantic recognition. At present, it is mainly used in three aspects: distance vision, multimodality and data mining.
Intelligent Cockpit Domain Controller and SoC Market Analysis Report, 2023Q2
Cockpit domain controller and chip in 2023Q2: by intelligent cockpit level, L1 surged by 105% on a like-on-like basis, and L2 soared by 171%.On May 17, 2023, the “White Paper on Automotive Intelligent...
Intelligent Vehicle E/E Architecture Research Report, 2023
E/E Architecture Research: How will the zonal EEA evolve and materialize from the perspective of supply chain deployment?Through the lens of development trends, automotive EEA (Electronic/electrical A...
China Passenger Car Brake-by-wire Industry Report, 2023
Passenger car brake-by-wire research: One-box solution takes an over 50% share.
China Passenger Car Brake-by-wire Industry Report, 2023 released by ResearchInChina combs through and summarizes passe...
Smart Car OTA Industry Report, 2023
Vehicle OTA Research: OTA functions tend to cover a full life cycle and feature SOA and central supercomputing.In the trend for software-defined vehicles, OTA installations are surging, and software i...
Intelligent Vehicle Multi-Domain Computing Industry Report, 2023
Multi-domain computing research: in the coming first year of cross-domain fusion, major suppliers will quicken their pace of launching new solutions.
As vehicle intelligence develops, electrical/ele...
Automotive Head-up Display (HUD) Industry Report, 2023
Automotive HUD research: in the "technology battle" in AR-HUD, who will be the champion of mass production?
Automotive head-up display (HUD) works on the optical principle for real-time display of s...
Automotive Cloud Service Platform Industry Report, 2023
Research on Automotive Cloud Services: As Dedicated Automotive Cloud Platforms Are Launched, the Market Enters A Phase of Differentiated Competition
1. The exponentially increasing amount of v...
Global and China Automotive Gateway Industry Report, 2023
Automotive gateway research: integrated gateways have become an important trend in zonal architecture.
Automotive gateway is a core component in the automotive electronic/electrical architecture. As ...
In-vehicle Communication and Network Interface Chip Industry Report, 2023
In-vehicle communication chip research: automotive Ethernet is evolving towards high bandwidth and multiple ports, and the related chip market is growing rapidly.
By communication connection form, au...
China Autonomous Driving Data Closed Loop Research Report, 2023
Data closed loop research: in the stage of Autonomous Driving 3.0, work hard on end-to-end development to control data.
At present, autonomous driving has entered the stage 3.0. Differing from the s...
ADAS and Autonomous Driving Tier 1 Research Report, 2023 - Foreign Companies
Research on foreign ADAS Tier 1 suppliers: 4D radar starts volume production, and CMS becomes a new battlefield.
1. Global Tier 1 suppliers boast complete ADAS/AD product matrix, and make continuous...
China Passenger Car Driving-parking Integrated Solution Industry Report, 2023
Research on driving-parking integration: with the declining share of the self-development model, suppliers' solutions blossom.
Local suppliers lead the driving-parking integration market.
The statis...
Passenger Car Cockpit Entertainment Research Report, 2023
Cockpit entertainment research: vehicle games will be the next hotspot.
The Passenger Car Cockpit Entertainment Research Report, 2023 released by ResearchInChina combs through the cockpit entertainme...
Smart Road - Roadside Perception Industry Report, 2023
Roadside perception research: evolution to integration, high performance and cost control.In June 2023, at a regular policy briefing of the State Council the Ministry of Industry and Information Techn...
China Passenger Car ADAS Domain Controller,Master Chip Market Data and Supplier Research Report, 2023Q1
Quarterly Report on ADAS Domain Controllers: L2+ and above ADAS Domain Controller Master Chip Market Structure This report highlights the passenger car L2+ and above (including L2+, ...
Automotive Cockpit Domain Controller Research Report, 2023
Research on cockpit domain controllers: various forms of products are mass-produced and mounted on vehicles, and product iteration speeds up.
Both quality and quantity have been improved, and the it...
Chinese Passenger Car OEMs’ Overseas Layout Research Report, 2023
OEMs’ overseas layout research: automobile exports are expected to hit 7.18 million units in 2025.
1. China’s automobile export market bucked the trend.
During 2021-2022, the global economy ...
Global and Chinese Automakers’ Modular Platform and Technology Planning Research Report, 2023
Research on modular platforms: explore intelligent evolution strategy of automakers after modular platforms become widespread.
By analyzing the planning of international automakers, Chinese conventi...