Advancing Vehicle Safety with the RK3568 Core Board: A Breakthrough in 360° Surround View Systems

To achieve the 360° surround view functionality, the control host needs to connect multiple high-definition cameras to obtain real-time road conditions, and through processing, stitch and correct multiple images, finally presenting them on the display device. This solution further introduces AI for image recognition, assisting drivers in safe driving. However, as a traditional special vehicle manufacturer, this manufacturer lacks the development capabilities for 360° surround view and AI image recognition, requiring suppliers to provide complete surround view AI solutions. At the same time, due to the complex operating environment of special vehicles, it is also necessary to adopt shock-resistant and wide-temperature designs to withstand severe vibrations and the effects of high and low temperatures in the working environment.

During the search for solutions, they learned about Advantech’s widely used visual-related unit ROM-5880 industrial-grade core module solution. With Advantech’s mature AI algorithm development capabilities and existing vehicle surround view solutions, both parties confirmed the cooperation for this project.

Based on the above challenges, Advantech sorted out the vehicle compatibility models, device usage scenarios, and other needs of the company. After multiple rounds of communication and cooperation, both parties fully leveraged their respective advantages to jointly design a preliminary hardware solution. The hardware solution adopts the ROM-5880 core module, which can connect MIPI cameras, supports 4K H.264/H.265 video decoding, and achieves fast image processing. At the same time, it is equipped with a 1 Tops AI computing power NPU to meet image recognition needs. Additionally, the ROM-5880 core board solution can pass the 3.0Grms vibration standard test and supports -40~+85° wide temperature, ensuring stable operation of special vehicles in harsh environments.

Furthermore, Advantech provided the customer with a four-fisheye camera access solution from the front, back, left, and right, through 4-channel AHD fisheye camera data input to collect vehicle surround view image data on the ROM-5880’s MIPI-CSI, and then through Advantech’s self-developed software solution output to form 360° surround view images. In terms of AI, Advantech based on existing AI visual algorithm models and the image database provided by the customer, helped the customer complete the entire set of AI vision solution applications from AI model selection, training, to deployment. In terms of OS, Advantech’s unique Jelina meets the requirements for safe networked updates, rapid model deployment, and continuous optimization and iteration.

Advantech’s existing visual algorithms

In addition to design and development, Advantech, as a 40-year enterprise, places great importance on the verification and continuous maintenance of deliveries. Therefore, Advantech not only completed system integration and high-standard testing on schedule but also, at the customer’s request, provided long-term software maintenance services lasting up to 10 years, ensuring seamless integration of all components and effectively guaranteeing the reliability and stability of the overall solution. Currently, the customer has already installed 3000 devices, and the project is still in continuous shipment.

For more detailed information

Welcome to contact our service hotline

400-069-0308

Since you’re here, please click on ‘See’ before leaving~~~