In-Depth Analysis of the Automotive Camera Industry

In-Depth Analysis of the Automotive Camera Industry
Produced by | Yanzhi Automotive Industry Research

The automotive camera is hailed as the “eye” of vehicles perceiving the physical world, serving as a core sensing sensor for autonomous driving. With the increasing penetration of functions such as 360-degree surround view, lane keeping assist (LKA), pedestrian AEB, and driver monitoring systems (DMS), the average number of cameras installed per vehicle is gradually increasing, and the market size of automotive cameras is expanding. According to relevant statistics, the average number of cameras installed in China’s passenger car market was 3.0 in 2022; in the first quarter of 2023, the average number of cameras installed was 3.3, an increase of 0.5 compared to the same period last year.

In-Depth Analysis of the Automotive Camera Industry

According to CINNO Research’s forecast, in 2023, the number of cameras installed in the domestic passenger car market will further increase to 72 million, and by 2025, this number will exceed 100 million, with a compound annual growth rate of 17% from 2023 to 2025.

High resolution, de-ISP, high dynamic range, and high sensitivity will become the main lines of technological development for automotive cameras. The technological iteration of automotive cameras further strengthens their core position among sensing sensors, and the product value and application scenarios will be further expanded.

In this context, Yanzhi Automotive has launched the “Automotive Camera Industry Analysis Report,” which comprehensively analyzes the current status of the automotive camera industry chain and future application trends from various aspects such as basic analysis of automotive cameras, analysis of the automotive camera industry chain, application trends, competitive landscape, and key domestic enterprises and product layouts, providing references for industry research and enterprise development.

Due to time constraints, there may be omissions and shortcomings in the report, and we kindly ask experts, peers, and readers for criticism and correction.

1. Basic Analysis of Automotive Cameras

1.1 Basic Definition and Hardware Composition of Automotive Cameras

  • Basic Definition: Refers to the cameras installed inside or outside vehicles, serving as core sensing sensors to achieve real-time image information collection through lenses and image sensors, used to monitor the internal and external environment of the vehicle to assist the driver in safe driving.

Chart 1. Core Monitoring Targets of Automotive Cameras

Monitoring Range of Automotive Cameras

Main Detection Objects

Outside the Cabin

Large Object Detection: Vehicles, pedestrians, non-motor vehicles;

Small Object Classification: Traffic signs, traffic lights, etc.;

Passable Area Segmentation: Roads, lane markings, etc.;

Inside the Cabin

Driver, passengers, and special monitoring groups such as children and pets

  • Hardware Composition: The automotive camera module mainly includes optical lenses, image sensor CIS, image signal processor ISP, serializer, and connector components.

Chart 2. Basic Structure of Automotive Cameras (Source: ON Semiconductor)

In-Depth Analysis of the Automotive Camera Industry

1) Lens: Composed of optical lenses, filters, protective films, etc. The lens is responsible for focusing light and projecting objects in the field of view onto the imaging medium’s surface, thus generating optical images. Generally, about 70% of the optical parameters of the camera are determined by the lens.

Lens is usually composed of multiple optical lenses, with the materials mainly being plastic (P) and glass (G). Currently, automotive lenses mainly consist of two types: glass-plastic hybrid lenses and all-glass lenses. Among them, surround view and cabin cameras mostly use glass-plastic hybrid lenses, while front view, side view, and CMS cameras mostly use all-glass lenses.

2) Image Sensor CIS: Refers to the imaging medium that converts the optical signals projected onto the CIS surface by the lens into electrical signals using photoelectric conversion elements. Common image sensors are mainly divided into CCD and CMOS types.

Overall, CCD sensors outperform CMOS sensors in terms of sensitivity and image quality. However, CMOS sensors have advantages over CCD sensors in power consumption, size, and cost. Currently, automotive cameras generally use CMOS chips for image sensors.

3) Image Signal Processor ISP: Processes the RAW format data output by the image sensor CIS, with main functions including image scaling, automatic exposure (AE), automatic white balance (AWB), automatic focus (AF), image denoising, etc., ultimately converting it into formats such as RGB and YUV. There are two forms of ISP within the camera module: A- built into the CMOS; B- independent chip.

4) Serializer: Converts parallel signals into serial signals. Typically, the signals output after processing by the image sensor CMOS or image processor ISP are based on MIPI/CSI standards, with short transmission distances, so they need to be converted into serial signals suitable for long-distance transmission. Currently, common serializers are based on Maxim’s GMSL 2 standard and TI’s FPD-Link standard.

1.2 Performance Requirements for Automotive Cameras

1) Important Parameter Indicators

For automotive cameras, several important parameter indicators include: field of view (FOV), detection distance, resolution, signal-to-noise ratio, frame rate, and dynamic range.

Chart 3. Key Reference Indicators for Automotive Cameras (Source: QCT/T 1128 Automotive Cameras, Public Data Compilation)

Serial Number

Key Indicator

Simple Explanation

1

Field of View FOV

Field of view is divided into horizontal field of view (H-FOV) and vertical field of view (V-FOV); the determining factor for the field of view is the lens, with shorter focal lengths resulting in larger fields of view.

2

Detection Distance

With a constant resolution of the camera, shorter focal lengths and larger fields of view result in closer detection distances.

3

Resolution

The spatial frequency response function of the imaging device, characterizing the imaging device’s ability to resolve details of the subject. Higher resolutions yield clearer images. Common resolutions include: 1.3MP (1280*960), 2MP (1920*1080), 5MP (2560*2048), 8MP (3200*2400), etc.

4

Signal-to-Noise Ratio (dB)

The ratio of signal voltage to noise voltage; the higher the signal-to-noise ratio, the clearer the image contrast, and the better the performance in low-light environments. Generally, automotive cameras require a signal-to-noise ratio of ≥40dB.

5

Dynamic Range

The range of brightness values for the brightest and darkest objects that can be normally displayed within the same shot. A larger dynamic range indicates clearer layers in the captured image.

6

Frame Rate

The number of times the image sensor can update images per second, determining the smoothness of video recording and the camera’s ability to capture images.

2) Automotive Grade Requirements
Compared to consumer-grade cameras, automotive cameras operate in extremely harsh environments, enduring extreme conditions such as vibration, high temperatures, rain and fog, low temperatures, and drastic changes in lighting. Therefore, the automotive grade requirements for cameras are also quite stringent. Currently, the scope of automotive grade testing for cameras includes image performance, electrical performance, dust and water resistance, mechanical performance, environmental durability, electromagnetic compatibility, and durability.

Chart 4. Automotive Grade Requirements for Automotive Cameras (Source: QCT/T 1128 Automotive Cameras, Public Data Compilation)

Serial Number

Automotive Grade Requirements

Detailed Explanation

1

Image Performance

Includes frame rate, effective pixels, field of view, dynamic range, maximum illumination, minimum illumination, optical axis center accuracy, automatic gain, white balance, startup time, system delay, color reproduction, glare, ghosting, etc.

2

Electrical Performance

Includes DC supply voltage, overvoltage, superimposed AC voltage, supply voltage rise and fall, transient changes in supply voltage, reverse voltage, short interruption of power supply, open circuit, short circuit protection, insulation resistance, reference grounding, and power supply offset.

3

Dust and Water Resistance

For cameras installed outside the vehicle, the protection level requirement is: IP6K7/IPX9K, where IPX9K only applies to the exposed surface after the product is installed in the vehicle; for cameras installed inside the passenger cabin, the protection level requirement is: IP6K4.

4

Mechanical Performance

Includes mechanical vibration, mechanical shock, free fall, stone impact, lens wear resistance, harness pull-out force.

5

Environmental Durability

Includes temperature and humidity range and high-low temperature storage

6

Electromagnetic Compatibility

Resistance to electromagnetic interference caused by electrostatic discharge, resistance to interference caused by conduction and coupling, resistance to electromagnetic radiation, characteristics of radio frequency interference.

7

Durability

High-temperature durability, temperature cycling durability.

1.3 Application Scenarios

Application scenarios of automotive cameras can be divided into two categories: external applications and internal applications. External applications include parking assistance, driving assistance, CMS, DVR, etc.; internal applications include DMS, OMS, etc.

Chart 5. Main Application Scenarios of Automotive Cameras (Source: Public Data Compilation)

Application Type

Camera Type

Installation Position

Function

External

Driving

Assistance

Front View* (1~3)

Monocular/Binocular/Trinocular (2~8MP)

Front windshield

Monitoring front vehicles/pedestrians, recognizing traffic lights/lane markings, etc.

Side View *4

Wide Angle (2~3MP)

Below external rearview mirror/fender

Monitoring side front/side rear vehicles

Rear View*1

Wide Angle (2~3MP)

Above rear license plate

Rear vehicle collision prevention

Parking

Assistance

Reversing View *1

Wide Angle (1~3MP)

Above rear license plate Parking assistance

360° Surround View*4

Fish-eye (1~3MP)

Middle grille

Bottom of both external rearview mirror bases

Above rear license plate

Panoramic imaging – image stitching, panoramic display

Others

CMS*2

Wide Angle (2~3MP)

External rearview mirror

Replacing traditional external rearview mirrors

DVR*1

Wide Angle (2~8MP)

Front windshield

Driving recording

Internal

DMS*1

Wide Angle (1~5MP)

Center of the steering wheel

A-pillar

Above the internal rearview mirror

Monitoring driver status

OMS* (1~2)

Wide Angle (2~5MP)

Above the internal rearview mirror

Monitoring passenger seat occupancy, monitoring for children/pets/items left behind

1.3.1 External Scenarios

1) Driving ADAS Scenarios

a. Front View ADAS Perception

Front view solutions can be roughly divided into two categories: front view integrated machines and standalone camera modules connected to independent controllers. The functions typically include forward collision warning (FCW), pedestrian collision warning (PCW), lane departure warning (LDW), lane keeping assist (LKA), automatic emergency braking (AEB), adaptive cruise control (ACC), etc.

Front view cameras usually have resolutions between 2~8MP and are generally arranged at the front windshield position. Depending on the number of lenses, front view cameras can be categorized into monocular cameras, binocular cameras, and trinocular cameras.

Among them, monocular cameras are mainly used in mid to low-end models and often take the form of front view integrated machines. Binocular cameras can be further divided into two types: binocular stereo cameras and combinations of two monocular cameras (narrow angle + wide angle). Trinocular cameras generally do not have integrated forms and are usually composed of three camera modules with different fields of view, with data input to the intelligent driving domain controller for processing.

Chart 6. Main Types of Front View Cameras

Front View

Type

Monocular Camera

Binocular Camera

Trinocular Camera

Narrow Angle + Wide Angle

Binocular Stereo Camera

Image

Example

In-Depth Analysis of the Automotive Camera Industry

In-Depth Analysis of the Automotive Camera Industry

In-Depth Analysis of the Automotive Camera Industry

In-Depth Analysis of the Automotive Camera Industry

Installation Layout

Front windshield position

Field of View

H-FOV

110°~120°

Narrow Angle:28°~30°

Wide Angle:110°~120°

110°~120°

Narrow Angle:28°~30°

Main Angle:50°~52°

Wide Angle:110°~120°

b. Side View ADAS Perception

In high-level intelligent driving perception solutions, in addition to configuring millimeter-wave radar, side view cameras are generally also configured as heterogeneous redundant sensing sensors, mainly used for monitoring target objects on the side front and side rear during driving. The functions include blind spot monitoring, cross-vehicle collision warning, etc.

  • Side Front View Camera: Field of view is 90°~100°, with a maximum detection distance greater than 80m; usually installed on the B-pillar or external rearview mirror, mainly used for traffic sign recognition, monitoring nearby vehicles in the side front lane, monitoring vehicles/pedestrians on the left and right sides at intersections, etc.

  • Side Rear View Camera: Field of view is 90°~100°, with a maximum detection distance greater than 100m; usually installed on the front fender, mainly used for monitoring vehicles in the adjacent lane during lane changes or merging onto highways, etc.

Chart 7. Monitoring Range of Side View Cameras (Source: Tesla Official Website)

In-Depth Analysis of the Automotive Camera Industry

c. Rear View ADAS Perception

Different from reversing cameras or rear cameras used in surround view, this camera serves as a driving assistance camera, covering a 360° mid to long-range driving visual perception range together with side view and front view cameras.

Driving rear view camera: field of view is 100°~120°, with detection distance requirements of 50m~80m, used to fill the visual perception blind spot behind the vehicle that side rear view cameras cannot cover.

2) Parking ADAS Scenarios

a. Reversing View

In parking scenarios, automotive cameras were initially used to achieve reversing image functions, displaying the scene behind the vehicle on the central control display screen in the cabin through cameras installed at the rear of the vehicle, assisting the driver in parking safely.

Reversing cameras (RVC) are usually wide-angle cameras, with a horizontal field of view (H-FOV) generally around 120°~140° and a vertical field of view (V-FOV) generally ≥130°, with resolutions typically between 1MP~3MP. Currently, reversing cameras are mainly used in some low-end models, and in the future, they will be replaced by surround view cameras.

b. 360° Panoramic Surround View

At present, the visual parking assistance configuration in cars is gradually upgraded from reversing view to 360° panoramic surround view, stitching together the four partial images output by four surround view cameras using stitching algorithms, and then transmitting the stitched bird’s-eye view to the central control screen for display. In addition to imaging, surround view cameras also have perception functions — recognizing lane markings in close proximity to the vehicle and detecting nearby target objects, transmitting perceived information to the controller to achieve lane departure warning, moving object monitoring, and warning functions.

Surround view cameras (SVC) typically use fish-eye cameras, with a horizontal field of view (V-FOV) ≥170°, vertical field of view (V-FOV) ≥140°, and resolutions generally between 1MP~3MP.

3) Other Scenarios

a. Driving Recorder

Driving recorder cameras capture video and images of the vehicle during driving. They can be used not only for entertainment — capturing scenery during driving, but also as effective evidence for law enforcement in the event of traffic accidents.

  • Camera Installation Position: Front windshield

  • Video Display: Internal rearview mirror

  • Performance Requirements for Cameras: Driving recorders typically use small focal length lenses, with focal lengths generally around 2.8mm, to ensure clear images at both distant and close ranges.

b. CMS (Electronic External Rearview Mirror)

CMS (Electronic External Rearview Mirror) is a combination device based on cameras and displays that replaces traditional external rearview mirrors. It captures image information through external cameras, processes the data, and displays information from the vehicle’s side and rear on the display screen inside the cabin. Additionally, the camera can also serve perception functions for the side and rear, such as blind spot monitoring and obstacle alerts.

Chart 8. Comparison of Traditional External Rearview Mirrors and Electronic External Rearview Mirrors

Comparison Item

Traditional External Rearview Mirror

Electronic External Rearview Mirror

Field of View

Narrow: Single-side visible angle around 30°

Wide: Single-side visible angle around 80°

Night Driving

Normal

Relatively Clear

Driving in Bad Weather (Snowstorm)

Unclear

Relatively Clear

Drag Coefficient

——

CMS can reduce the overall vehicle drag coefficient by 7%~10%

Cost

Hardware cost 800~900 yuan

Total hardware cost for CMS 4000~6000 yuan

Reliability

Good

Average

Service Life

Good

Average

Function Expansion

None

Expandable Perception Functions: Blind spot monitoring, door opening warnings, etc.

  • Camera Installation Position: Position of external rearview mirror

  • Display Screen Installation Position: Generally near the A-pillar, some integrated into the door panel.

  • Performance Requirements for Cameras: High functional safety requirements; camera resolution generally ≥2MP; dynamic range needs ≥120dB; considering extreme weather conditions, integrated with heating defrosting and dehumidifying functions; high real-time requirements for video transmission, frame rate needs ≥60fps.

1.3.2 Internal Scenarios

Currently, the applications of automotive cameras inside the cabin mainly include two types: driver status monitoring (DMS) and occupant monitoring (OMS).

1) Driver Status Monitoring (DMS)

The vision-based DMS function monitors the driver using cameras arranged in front of the driver, identifying and tracking features of the eyes, eyeballs, face, and head, and processing the data through algorithms to determine whether the driver is distracted, fatigued, or engaging in dangerous driving behavior, and can provide timely reminders to the driver.

DMS cameras are commonly installed in the center of the steering wheel/above the internal rearview mirror/A-pillar/integrated into the instrument display screen, etc. DMS cameras generally use IR near-infrared cameras (black and white cameras), adopting global exposure mode, with common resolutions between 1MP~5MP, and horizontal field of view generally between 40°~70°, with frame rates generally ≥30fps.

Chart 9. Installation Position Diagram of DMS Cameras

In-Depth Analysis of the Automotive Camera Industry

2) Occupant Monitoring (OMS)

The vision-based OMS solution monitors all occupants in the cabin using cameras, mainly supporting functions such as monitoring passenger seat belt usage, live detection in the vehicle (monitoring for children, pets, etc., left behind after exiting the vehicle).

OMS cameras are commonly installed above the internal rearview mirror, above the central control display screen, etc. OMS applications generally use RGB-IR dual-mode cameras, balancing infrared facial recognition and color image quality. Additionally, OMS cameras also adopt global exposure mode, with common resolutions between 2MP~5MP, and horizontal field of view generally ≥120°.

The content is excerpted from the Automotive Camera Industry Analysis Report. The remaining chapters will be gradually pushed by Yanzhi, and we welcome everyone to follow.

In-Depth Analysis of the Automotive Camera Industry

In-Depth Analysis of the Automotive Camera IndustryAuthor WeChat

Welcome to Discuss and Exchange

Add Friends Please Note: Company + Name

Leave a Comment

×