Application of Car Cameras in Autonomous Driving

The in-car cameras is the main visual sensor of the self-driving car, and it is also the "eye of the car" with mature technology. The rear view car cameras to obtain image information, after the image is collected by the lens, the photosensitive component circuit and control component in the camera process the image and convert it into a digital signal that can be processed by the computer, and then the image information is processed on the vision processing chip through an algorithm After extracting effective information, it enters the decision-making layer for decision-making and judgment, so as to perceive and judge the road conditions around the vehicle. Vehicle-mounted cameras have the ability to recognize targets. Using image recognition technology, self-driving cars can accurately distinguish pedestrians, vehicles, traffic signs and obstacles during driving. Currently, they are mainly used in 360 panoramic images, forward collision warnings, and lane departure warnings. and pedestrian detection and other ADAS functions.

The self-driving car cameras mainly includes two parts: software and hardware. From the perspective of hardware structure, the main components of the car cameras include lens, CMOS image sensor, DSP digital processing chip, etc., 

and the overall components are assembled through modules.

According to the installation position, the car cameras can be divided into front view, side view, rear view, built-in and surround view, etc. 

Its role is as follows:

• Front-view camera: generally used as the main camera in ADAS/autonomous driving, installed above the front windshield of the car, it can realize the detection of obstacles, lane lines, curbs, traffic lights, traffic signs and drivable areas identify.

• Side view camera: Side view cameras generally have three installation positions, rearview mirror, vehicle B-pillar and vehicle rear fender, generally used for side obstacle monitoring, blind spot monitoring, etc.

• Rear view camera: generally installed on the trunk of the vehicle, it can be used to realize the parking assistance function.

• Surround-view camera: Surround-view cameras are generally installed around the vehicle body, and generally use 4 to 8 fisheye cameras to realize 360 panoramic images, parking space monitoring, and low-speed perception functions.

• Built-in camera: Common installation locations include the inside of the vehicle's A-pillar, on the steering wheel, and at the rearview mirror for functions such as monitoring pets and babies in the car, and monitoring driver fatigue.