Automotive Vision Industry Chain Report (II) Binocular and Others
  • May 2020
  • Hard Copy
  • USD $3,600
  • Pages:210
  • Single User License
    (PDF Unprintable)       
  • USD $3,400
  • Code: TY003
  • Enterprise-wide License
    (PDF Printable & Editable)       
  • USD $5,000
  • Hard Copy + Single User License
  • USD $3,800
      

Visual Perception Algorithms Become Crucial

Automotive cameras are divided into perception cameras and video cameras, according to Sunny Optical.

Perception camera, used for active safety (generally for forward and inward view), captures images accurately. Video camera, suitable for passive safety (typically surround view and rear view), stores or sends the captured images to the user. They are totally different in imaging quality and temperature reliability.

For lane detection, signal light detection, road sign recognition, in-vehicle monitoring, etc., any errors in the images taken by perception cameras will issue in software calculation errors and inevitable consequences. In this sense, perception camera is less sensitive to price.

Video cameras, with not so high a demanding on performance, are very sensitive to price; there exists a price war in this market where numerous Chinese companies are fiercely scrambling for meager profits but the vast majority do not make money. As per the pattern of Chinese passenger-car-use surround-view camera OEM market in 2019, the market share of vendors is quite scattered, a sharp contrast to the top 6 players holding a combined over 90% of the front-view monocular camera market.

双目1_副本.png

Forward-view cameras require complex algorithms and chips. A forward-view monocular camera costs nearly RMB1,000, and a forward-view binocular camera over RMB1,000. Rear-view, side-view and in-built cameras has the unit price at RMB200 or so.

Breakthroughs in Binocular Camera

Chinese startups have made dramatic breakthroughs in binocular cameras, especially for commercial vehicle and special vehicle.

Smarter Eye has shipped more than 10,000 binocular cameras, mainly available in Apollo autonomous vehicles, JMC small buses, sanitation vehicles, autonomous boats, tractors, patrol vehicles, etc. Smarter Eye’s binocular cameras are typically rendered for AEBS and detection of height limiters. The bus groups in more than 30 cities have employed such cameras.

Smarter Eye pioneers in applying binocular cameras to detect height limiters. Both conventional height limiters and non-standard height limiters such as small archways and culverts in the countryside can be accurately perceived by binocular cameras that promptly warn drivers by sound and light alarms. Recreational vehicles, special vehicles, etc. have rigid demand for this function.

双目2_副本.png

In 2019, Sphyrna Technology announced it successfully developed a flexible binocular camera system which can use two separate monocular cameras to accomplish a binocular camera system, overcoming inherent defects (large size, complicated process, difficult installation, and high cost) of binocular cameras.

双目3_副本.png

The two cameras are independently fixed on the right side of the car body, needing neither rigid connection in the middle nor strict requirements on angle or spacing. The "flexible binocular cameras" lie in self-calibration technology. Even if the cameras slightly deform and move during use, Sphyrna Technology's algorithms will automatically detect and recalibrate, dispensing with regular recalibration essential to conventional binocular cameras.

In April 2020, Foresight Autonomous Holdings Ltd. announced to collaborate with FLIR Systems Inc. on the development, marketing and distribution of Foresight’s QuadSight? vision system, combined with FLIR Systems’ infrared cameras, to a wide range of prospective customers. Foresight will exclusively purchase its thermal cameras from FLIR for all systems to be commercialized worldwide. Foresight’s unique QuadSight system, comprised of four thermal and visible-light cameras, showcases the capability of FLIR thermal cameras to greatly improve ADAS and autonomous vehicle safety through improved situational awareness at night, in high-contrast scenes and in bad weather. The data fusion between the two stereo channels can effectively avoid the non-reporting or false-reporting under the extreme conditions like the tunnel entrance where light changes quickly.

Millimeter-wave radar is beating other sensors. The same is true of cameras. Many companies like MAXIEYE are attempting to replace binocular cameras or liDAR by using monocular cameras for ranging and 3D imaging.

Unlike the first-generation product -- IFVS-200 series based on machine learning solutions, MAXIEYE’s 3rd-Gen product IFVS-500 family based on deep learning technology achieves monocular ranging and 3D scanning. IFVS-500 not only allows monocular vision products to perform 3D scanning like lidar, but also resembles lidar by scanning the 3D point cloud within 50 meters, enabling direct ranging of the object and detection of both motor vehicles within 200 meters and pedestrians & small obstacles within 100 meters.

Visual Capabilities under Extreme Scenarios Heighten

Whatever vision inside or outside the car in poor lighting and even the dark requires infrared technology. ON Semiconductor's RGB-IR image sensor features near infrared (NIR) enhanced images. Israeli start-up TriEye has developed a sensor technology for short-wave infrared (SWIR) which enhances safety in vehicles fitted with assistance systems or autonomous driving functions by improving the ability to see in weather conditions where visibility is poor, such as dust, fog, murky conditions or rain, and to stay alert to the danger (like icy road) in advance.

双目4_副本.png

In April 2020, Alibaba DAMO Academy revealed that it has developed an ISP processor for in-vehicle cameras. Through the use of it, the car camera has a significant improvement in image object detection and recognition capabilities by more than 10% compared to the mainstream processor in the night, the most challenging scene, and the original obscure labeling can be clearly identified, according to the drive test results of the DAMO Academy Automated Driving Laboratory.

On May 19, 2020, OmniVision announced the expansion of its Nyxel near-infrared (NIR) technology into the automotive market with the new 2.5-megapixel OX03A2S image sensor. This ASIL-B sensor is intended for exterior imaging applications that operate in low to no ambient light conditions within 2 meters of the vehicle. It can detect and recognize objects that other image sensors would reportedly miss under extremely low lighting conditions.

双目5_副本.png
 


Visual Perception Algorithms Become Crucial

The massive data incurred by the dramatic increment of vision sensors in smart cars as well as the addition of vision sensors has brought challenges and opportunities to algorithm processing.

For the visual perception system, Mobileye, a leader of visual ADAS algorithms, gets a multitude of independent perception algorithms used simultaneously to create internal redundancy layers for both detection and measurements with higher perception accuracy and stability. Detection is to determine what object is perceived, and measurements are to infer the 3D information of the perceived object via the 2D image of the camera.

For detection, Mobileye uses 6 independent engines:

  • 3DVD or 3D Object Detection: It is the common approach of predicting a 3D bounding box using a neural network from the 2D image.
  • Full Image Detection: It deals with the common scenario where an object (such as buses cars or trucks) is extremely close and can only be partially seen. Object classification using visual signatures is used to track close up vehicles in this scenario.
  • Top View FS: It focuses on identifying and marking the unoccupied roads in the screen.
  • Features Detection: This appearance-based engine detects vehicles from reliable features, such as wheels.
  • VIDAR: It is an approach that uses multiple views of the environment to triangulate and create a depth map. That depth map is converted into a point cloud and LiDAR based processing algorithms are used on that point cloud.
  • Scene Segmentation (NSS): It is a neural network-based approach to break the scene down into free space and semantic objects (vehicle, sign, pedestrian, etc.), the pixels containing an object are treated as a detection.

双目6_副本.png

Also as a leader in visual perception algorithms, Tesla names its deep learning network as HydraNet which involves 48 different neural networks that output 1,000 distinct tensors (predictions) at each timestep; in theory, HydraNet can detect 1,000 objects simultaneously. Tesla acquired DeepScale, a Silicon Valley startup that focuses on developing computer vision technologies, in a bid to improve its algorithmic capabilities.

To catch up with Tesla and Mobileye in visual perception algorithms, OEMs and Tier1 suppliers are expanding their teams of software engineers. The algorithmic capabilities will be one of the decisive factors to the performance of visual perception.

5 Chinese Automotive Vision Companies

5.1 Smarter Eye
5.1.1 Profile
5.1.2 Products
5.1.3 Development
5.1.4 Comparison between Likewise Products
5.1.5 Production
5.1.6 Application of Binocular Stereo Vision Products
5.2 Sphyrna Technology
5.2.1 Profile
5.2.2 Products
5.2.3 Flexible Binocular System
5.2.4 Large Truck ADAS
5.3 Slightech Intelligent Technology
5.3.1 Profile
5.3.1 Core Technologies
5.3.2 Binocular Camera Depth Sereis
5.3.3 Binocular ADAS Solutions
5.3.4 Autonomous Delivery Solutions
5.4 METOAK
5.4.1 Profile
5.4.2 Solutions
5.4.3 Product Application
5.5 SinoChipAi
5.5.1 Profile
5.5.2 Vision Products
5.5.3 Binocular ADAS
5.5.4 Partners
5.6 Hisense TransTech
5.6.1 Profile
5.6.2 Solutions
5.6.3 Binocular ADAS
5.7 Zhejiang Dahua Technology
5.7.1 Profile
5.7.2 Products
5.7.3 DAHUA Binocular Application
5.7.4 DAHUA Binocular News
5.8 Foresight 
5.8.1 Profile
5.8.2 Quad-ocular Vision System
5.8.3 Binocular Vision System Eyes-On
5.8.4 Foresight Eye-Net
5.8.5 Dynamics
5.9 RICOH
5.9.1 Profile
5.9.2 Development Strategy
5.9.3 Binocular Module
5.9.4 Other Applications of Binocular Products
5.10 Other Tier 1 Suppliers’ Binocular Products
5.10.1 Continental
5.10.2 Bosch Binocular Camera
5.10.3 Denso Stereo Vision Sensor
5.10.4 ZF Binocular Camera
5.11 Summary of Binocular Product and Technologies
5.11.1 Trends of Binocular Stereo Vision Technology
5.11.2 Binocular Chip

6 Other Automotive Vision Companies

6.1 Surround-view Market Overview
6.1.1 Number of Surround-view Cameras Installed in New Cars in China, 2018-2019
6.1.2 Number of Surround-view Cameras Installed in New Cars in China by Month, 2018-2019
6.1.3 Proportion of Surround-view Cameras Installed in New Cars and Top 20 Brands in China, 2019
6.1.4 Top 20 Brands by Installation Rate of Surround-view Cameras in New Cars in China, 2019
6.1.5 Top 10 Brands by Surround-view Camera Installed in New Cars and Installation Rate (by Price) in China, 2019
6.2 TungThih Electronic
6.2.1 Profile
6.2.2 Global Presence and Product Layout
6.2.3 Cameras
6.2.4 Major Products and Clients
6.3 HSAE
6.3.1 Profile
6.3.2 Product System
6.3.3 Collaborations
6.3.4 Suppliers
6.3.5 Clients
6.4 Hikvision
6.4.1 Profile
6.4.2 Revenue
6.4.3 Automotive Electronics
6.4.4 Vision Products
6.5 Softec
6.5.1 Profile
6.5.2 Automotive Surround-view System
6.5.3 Main Cameras
6.6 oToBrite
6.6.1 Profile
6.6.2 ADAS Products
6.6.3 Core Technologies
6.6.4 Cameras
6.6.5 Automated Parking System
6.6.6 Clients and Partners
6.7 MINTH Group
6.7.1 Profile
6.7.2 Revenue
6.7.3 R&D and Design Capabilities
6.7.4 History of Camera Business
6.7.5 Surround-view Products
6.7.6 Application of ADAS Products
6.8 LG 
6.8.1 Profile
6.8.2 Automotive Electronics
6.8.3 Cameras
6.8.4 ADAS Products
6.9 Panasonic
6.9.1 Profile
6.9.2 Automotive Business Revenue
6.9.3 Automotive Electronics Families
6.9.4 Automotive Vision Products
6.10 Valeo
6.10.1 Profile
6.10.2 Revenue in 2019
6.10.3 Automotive Vision and ADAS System
6.10.4 Vision Products
6.10.5 Partners in Vision Products
6.11 Others

7 Suppliers of Key Components for Automotive Camera

7.1 ON Semiconductor
7.1.1 Profile
7.1.2 Operation and Automotive Business Layout in 2019
7.1.3 Automotive Ecosystem
7.1.4 CMOS Market Position
7.1.5 ADAS Image Sensors
7.1.6 Automotive Camera System Architecture and CMOS Product System
7.1.7 Automotive CMOS Products
7.1.8 Mergers and Acquisitions in Recent Years
7.2 Sony
7.2.1 Profile
7.2.2 Operation in 2019
7.2.3 Technical Superiority in CMOS Field
7.2.4 Cameral Module Product System
7.2.6 Development Course of Automotive CMOS
7.2.7 Automotive CMOS Pedigrees
7.2.8 Automotive CMOS Products
7.2.9 Latest Vision CMOS Products
7.3 OmniVision
7.3.1 Profile
7.3.2 Image Sensors
7.3.3 Automotive Image Sensors
7.3.4 Dynamics
7.4 PixArt Imaging Inc.
7.4.1 Profile
7.4.2 CIS and Chip Products and Planned Products
7.4.3 PixArt Product
7.4.4 Automotive Vision Application System
7.4.5 Gesture Control IC for Automotive Use
7.5 Sunny Optical
7.5.1 Profile
7.5.2 Revenue in 2019
7.5.3 Business Layout
7.5.4 Development Course of Automotive Cameras 
7.5.5 Automotive Camera Sales and Shipments
7.5.6 Latest Developments and Layout
7.6 Lianchuang Electronic Technology
7.6.1 Profile
7.6.2 Development Course and Equity Structure
7.6.3 Revenue and R&D Expenditure
7.6.4 Automotive Lenses
7.6.5 Application in Automotive Camera Field
7.6.6 Major Clients

8 Development Tendencies of Automotive Vision Industry

8.1 ToF Use in Vehicle
8.1.1 What Is the 3D Perception Technology?
8.1.2 3D Perception: Stereo Vision and Structured Light
8.1.3 3D Perception: ToF
8.1.4 Huge Potentiality of ToF
8.1.5 Comparison between Main ToF Image Sensors
8.1.6 Infineon’s and Panasonic’s ToF
8.1.7 ADI ToF
8.1.8 Panasonic’s All-new ToF Image Sensor
8.2 AI Use in Automotive Vision
8.3 Other Automotive Vision Trends
 

OEMs’ Next-generation In-vehicle Infotainment (IVI) System Trends Report, 2024

OEMs’ Next-generation In-vehicle Infotainment (IVI) System Trends Report, 2024 released by ResearchInChina systematically analyzes the iteration process of IVI systems of mainstream automakers in Chin...

Global and China Automotive Lighting System Research Report, 2023-2024

Installations of intelligent headlights and interior lighting systems made steady growth. From 2019 to 2023, the installations of intelligent headlights and interior lighting systems grew steadily. I...

Automotive Display, Center Console and Cluster Industry Report, 2024

Automotive display has become a hotspot major automakers compete for to create personalized and differentiated vehicle models. To improve users' driving experience and meet their needs for human-compu...

Global and China Passenger Car T-Box Market Report, 2024

Global and China Passenger Car T-Box Market Report, 2024 combs and summarizes the overall global and Chinese passenger car T-Box markets and the status quo of independent, centralized, V2X, and 5G T-B...

AI Foundation Models’ Impacts on Vehicle Intelligent Design and Development Research Report, 2024

AI foundation models are booming. The launch of ChapGPT and SORA is shocking. Scientists and entrepreneurs at AI frontier point out that AI foundation models will rebuild all walks of life, especially...

Analysis on Geely's Layout in Electrification, Connectivity, Intelligence and Sharing

Geely, one of the leading automotive groups in China, makes comprehensive layout in electrification, connectivity, intelligence and sharing. Geely boasts more than ten brands. In 2023, it sold a tota...

48V Low-voltage Power Distribution Network (PDN) Architecture Industry Report, 2024

Automotive low-voltage PDN architecture evolves from 12V to 48V system. Since 1950, the automotive industry has introduced the 12V system to power lighting, entertainment, electronic control units an...

Automotive Ultrasonic Radar and OEMs’ Parking Route Research Report, 2024

1. Over 220 million ultrasonic radars will be installed in 2028. In recent years, the installations of ultrasonic radars in passenger cars in China surged, up to 121.955 million units in 2023, jumpin...

Automotive AI Foundation Model Technology and Application Trends Report, 2023-2024

Since 2023 ever more vehicle models have begun to be connected with foundation models, and an increasing number of Tier1s have launched automotive foundation model solutions. Especially Tesla’s big pr...

Qualcomm 8295 Based Cockpit Domain Controller Dismantling Analysis Report

ResearchInChina dismantled 8295-based cockpit domain controller of an electric sedan launched in December 2023, and produced the report SA8295P Series Based Cockpit Domain Controller Analysis and Dism...

Global and China Automotive Comfort System (Seating system, Air Conditioning System) Research Report, 2024

Automotive comfort systems include seating system, air conditioning system, soundproof system and chassis suspension to improve comfort of drivers and passengers. This report highlights seating system...

Automotive Memory Chip and Storage Industry Report, 2024

The global automotive memory chip market was worth USD4.76 billion in 2023, and it is expected to reach USD10.25 billion in 2028 boosted by high-level autonomous driving. The automotive storage market...

Automotive AUTOSAR Platform Research Report, 2024

AUTOSAR Platform research: the pace of spawning the domestic basic software + full-stack chip solutions quickens. In the trend towards software-defined vehicles, AUTOSAR is evolving towards a more o...

China Passenger Car Electronic Control Suspension Industry Research Report, 2024

Research on Electronic Control Suspension: The assembly volume of Air Suspension increased by 113% year-on-year in 2023, and the magic carpet suspension of independent brands achieved a breakthrough ...

Global and China Hybrid Electric Vehicle (HEV) Research Report, 2023-2024

1. In 2025, the share of plug-in/extended-range hybrid electric passenger cars by sales in China is expected to rise to 40%. In 2023, China sold 2.754 million plug-in/extended-range hybrid electric p...

L3/L4 Autonomous Driving and Startups Research Report, 2024

The favorable policies for the autonomous driving industry will speed up the commercialization of L3/L4. In the second half of 2023, China introduced a range of policies concerning autonomous drivin...

Intelligent Vehicle Cockpit-driving Integration (Cockpit-driving-parking) Industry Report, 2024

At present, EEA is developing from the distributed type to domain centralization and cross-domain fusion. The trend for internal and external integration of domain controllers, especially the integrat...

Global and China Automotive Operating System (OS) Industry Report, 2023-2024

Chinese operating systems start to work hard In 2023, Chinese providers such as Huawei, Banma Zhixing, Xiaomi, and NIO made efforts in operating system market, launched different versions with competi...

2005- www.researchinchina.com All Rights Reserved 京ICP备05069564号-1 京公网安备1101054484号