Autonomous Driving Algorithm Research: BEV Drives Algorithm Revolution, AI Large Model Promotes Algorithm Iteration
The core of the autonomous driving algorithm technical framework is divided into three parts: environment perception, decision planning, and control execution.
Environment perception: convert sensor data into machine language of the scenario where the vehicle is located, which can include object detection, recognition and tracking, environment modeling, motion estimation, etc.;
Decision planning: Based on the output results of perception algorithm, the final behavioral action instructions are given, including behavioral decisions (vehicle following, stopping and overtaking), action decisions (car steering, speed, etc.), path planning, etc.;
Control actuation: according to the output results of decision-making level, the underlying modules are mobilized to issue instructions to the core control components such as accelerator and brake, and promote vehicle to drive according to the planned route.
BEV drives algorithm revolution
In recent years, BEV perception has received extensive attention. BEV model mainly provides a unified space to facilitate the fusion of various tasks and sensors. It has following advantages:
BEV unifies the multimodal data processing dimension and makes multimodal fusion easier
The BEV perception system converts the information obtained from multiple cameras or radars to a bird's-eye view, and then do tasks such as object detection and instance segmentation, which can more intuitively display the dimension and direction of objects in BEV space.
In 2022, Peking University & Ali proposed a fusion framework of LiDAR and vision - BEVFusion. The processing of radar point clouds and image processing are carried out independently, using neural networks to encode, project to a unified BEV space, and then merge the two in BEV space.
Realize timing information fusion and build 4D space
In the 4D space, the perception algorithm can better complete the perception tasks such as speed measurement, and can transmit the results of motion prediction to the decision and control module.
PhiGent Robotics proposed BEVDet4D in 2022, which is a version based on BEVDet to increase timing fusion. BEVDet4D extends BEVDet by retaining intermediate BEV features of past frames, and then fuses features by aligning and splicing with the current frame, so that time clues can be obtained by querying two candidate features.
Imagine occluded objects to realize object prediction
In the BEV space, the algorithm can predict the occluded area based on prior knowledge, and imagine whether there are objects in the occluded area.
FIERY, proposed by Wayve in cooperation with the University of Cambridge in 2021, is an end-to-end road dynamic object instance prediction algorithm that does not rely on high-precision maps and is only based on aerial views of monocular cameras.
Promoting development of an end-to-end autonomous driving framework
In the BEV space, perception and prediction can be directly optimized end-to-end through neural networks in a unified space, and the results can be obtained at the same time. Not only the perception module, but also the BEV-based planning decision-making module is also the direction of academic research.
In 2022, autonomous driving team of Shanghai Artificial Intelligence Laboratory and the team of associate professor Yan Junchi of Shanghai Jiao Tong University collaborated on paper ST-P3 to propose a spatiotemporal feature learning solution that can simultaneously provide a set of more representative features for perception, prediction and planning tasks.
AI large model drives algorithm iteration
After 2012, deep learning algorithms are widely applied in autonomous driving field. In order to support larger and more complex AI computing needs, AI large models with the characteristics of "huge data, huge computing power, and huge algorithms" were born, which accelerated the iteration speed of algorithms.
Large Model and Intelligent Computing Center
In 2021, HAOMO.AI launched research and landing attempts on large-scale Transformer model, and then gradually applied it on a large scale in projects including multi-modal perception data fusion and cognitive model training. In December 2021, HAOMO.AI released autonomous driving data intelligence system MANA (Chinese name "Snow Lake"), which integrates perception, cognition, labeling, simulation, computing and other aspects. In January 2023, HAOMO.AI together with Volcano Engine unveiled MANA OASIS, a supercomputing center with a total computing power of 670 PFLOPS. After deploying HAOMO.AI's training platform, OASIS can run various applications including cloud large-scale model training, vehicle-side model training, annotation, and simulation. With the help of MANA OASIS, the five major models of HAOMO.AI have ushered in a new appearance and upgrade.
In August 2022, based on Alibaba Cloud intelligent computing platform, Xpeng Motors built an autonomous driving intelligent computing center "Fuyao", which is dedicated to training of autonomous driving models. In October 2022, Xpeng also announced the introduction of Transformer large model.
In November 2022, Baidu released Wenxin Big Model. Leveraging more than 1 billion parameters, it recognizes thousands of objects, helping to enlarge the scope of semantic recognition. At present, it is mainly used in three aspects: distance vision, multimodality and data mining.
China Charging Infrastructure (Supercharging, Battery Swapping, V2G, etc.) and High-Performance Supercharging Battery Research Report, 2026
Charging and battery swapping research: as 5C+ supercharging vehicle models go into mass production, the pace of OEMs self-building supercharging networks quickens
800-1000V high-voltage platforms ar...
China Passenger Car Electronic Controlled Suspension Industry Report, 2026
Electronic Controlled Suspension Industry Research: As the First Year of Full Active Suspension Unfolds, Three Technical Routes Race Forward
1. Penetration Rate Surges Three Times, and Electronic Con...
Intelligent Driving SoC Research Report, 2026
Research on Intelligent Driving SoCs: Competition Focus Shifts to L3/L4 Embedded Hardware, and Computing Power of Flagship Vehicle Models Exceeds 1,000 TOPS
In terms of intelligent driving system in...
Automotive AI Large Model Technology Research Report, 2026
Automotive AI Large Model Research: Competition Shifts from "Who Has the Stronger Model" to "Who Boasts Higher Link Efficiency"
ResearchInChina released the Automotive AI Large Model Technology Resea...
Intelligent Vehicle Cockpit Domain Controller Research Report, 2026
Cockpit domain controller research: L3 AIDV intelligent cockpit domain controllers are entering a boom period
Driven by multiple factors such as the continuous evolution of the automotive central int...
Automotive Acoustic System (Audio, Multi-Channel) Industry Report, 2026
Automotive Acoustics Research: Multiple Channels, AI Tuning, and Self-Developed Algorithms Drive the Transformation of High-End Cockpit Sound Fields
I. Automotive Audio Hardware Solutions with 6–9 S...
Autonomous Driving Sensor Chip Research Report, 2026
Research on Autonomous Driving Sensor Chips: Deeply Perceiving the Physical World, Sensor Chips Are Playing A “Leading Role” in Intelligence
In 2026, the autonomous driving sensor chip industr...
Passenger Car Corner Module and Wheel‑Side Control System Research Report, 2026
Wheel-side control research: the “last mile” chassis innovation
Wheel-side control dismantles the traditional drive, braking, steering, and suspension control of the chassis from a "centralized" styl...
Embodied Artificial Intelligence (& Humanoid Robot) MCU Research Report, 2026
Research on Humanoid Robot MCUs: Evolution from General-Purpose Control to High-Value Dedicated Chip Solutions Integrated with Edge AI Functions
MCU (Microcontroller Unit) refers to a compact integra...
Intelligent Vehicle Zone Control Unit (ZCU) Research Report, 2026
ZCU Research: Cross-domain integrated ZCUs are becoming the edge computing nodes of the next-generation zonal architecture
Currently, the mainstream zonal architecture is mainly the quasi-central + z...
Automotive Cybersecurity and Data Security Research Report, 2026
Cybersecurity & Data Security Research: Intelligent Connected Vehicles Enter the Era of “Systematic Offense-Defense and AI-Defined Security”.
Centering on the panorama of intelligent connect...
Report on Breakthrough Strategies of OEMs and ADAS Tier 1 Suppliers for Overseas Layout of Intelligent Driving, 2026
Regulatory Breakthrough, Local System Establishment, OEMs Competing for NOA Layout: Overall Trends of China’s Intelligent Driving Overseas Layout in 2026
Research on overseas intelligent driving layo...
OEMs and Tier1s’ Intelligent Cockpit Platform (Hardware and Software) Innovation Strategy Research Report, 2026
Intelligent Cockpit Platform Research: multi-dimensional cockpit system architecture reconstruction for multi-agent collaboration and proactive intelligent services
The intelligent cockpit software s...
Automotive AIOS Research Report, 2026
Automotive AIOS Research: Mass Production Solutions Are Implemented
Mass Production Solutions Are Implemented on A Small Scale.
In 2026, AIOS starts small-scale implementation, helping to improve v...
Automotive Telematics Service Provider (TSP) Research Report, 2026
TSP Research: Leading providers collectively turn to AI agents to provide all-scenario active services
Telematics Service Providers (TSPs) are the core hub of the telematics industry chain, connectin...
Automotive Smart Interior Research Report, 2026
Smart Interior Research: As Technologies like Interactive Starlight Headliner, Hidden Display and Surface Projection Are Launched, Automotive Interiors Become Ever More Intelligent
The Automotive Sma...
Research Report on AI Applications in Cockpits, 2026
AI Application in Cockpits: AI Services Become More Comprehensive, Convenient, and Refined.
In the first half of 2026, cockpit AI functions underwent initial upgrades across multiple dimensions, inc...
Software-Defined Vehicles in 2026: OEM Software Development and Supply Chain Deployment Strategy Research Report
Research on OEMs’ Software Strategies: R&D Focus, Development Strategies and Supplier Building Models of 30 OEMs
In this paper, we adopt a research framework covering 13 subsystems and 48 sub-di...