RK3568 Core Board ROM-5880 Empowers 360° Surround View Systems

Compared to ordinary vehicles, special vehicles are taller and longer, which can easily create visual blind spots leading to traffic accidents. A certain manufacturer of special vehicles, aiming to enhance driving safety, decided to integrate new technologies for intelligent surround view on top of their already excellent mechanical performance. In pursuit of safety for special vehicles, the company decided to develop a new vehicle safety solution that integrates 360° surround view and AI image recognition.

To achieve the 360° surround view functionality, the control host needs to connect multiple high-definition cameras to obtain real-time road conditions. By processing these images, multiple images are stitched and corrected, ultimately presented on the display device. This solution further incorporates AI for image recognition, assisting drivers in safe driving. However, as a traditional manufacturer of special vehicles, this company lacks the development capabilities for 360° surround view and AI image recognition, requiring suppliers to provide a complete surround view AI solution. Additionally, the complex working environment of special vehicles necessitates the use of shock-resistant and wide-temperature designs to withstand severe vibrations and the effects of high and low temperatures.

In the process of seeking solutions, they learned about Advantech’s widely applied visual-related unit ROM-5880 industrial-grade core module solution. With Advantech’s mature AI algorithm development capabilities and existing vehicle surround view solutions, both parties established a cooperation for this project.

Based on the challenges mentioned above, Advantech sorted through the company’s vehicle compatibility models, device usage scenarios, and other requirements. After multiple rounds of communication and collaboration, both parties leveraged their respective strengths to jointly design a preliminary hardware solution. The hardware solution utilizes the ROM-5880 core module, which can connect to MIPI cameras, supports 4K H.264/H.265 video decoding, and enables rapid image processing. Additionally, it is equipped with a 1 Tops AI computing power NPU to meet image recognition requirements. The ROM-5880 core board solution has passed 3.0Grms vibration standard testing and supports -40~+85° wide temperature, ensuring stable operation of special vehicles in harsh environments.

Furthermore, Advantech provided a solution for connecting four fisheye cameras at the front, rear, left, and right. Through 4-channel AHD fisheye camera data input to the MIPI-CSI on ROM-5880, the vehicle surround view image data is collected, which is then processed by Advantech’s self-developed software solution to output a 360° surround view image. In terms of AI, Advantech utilized existing AI visual algorithm models, along with an image database provided by the customer, to help the customer complete a comprehensive AI vision solution application from AI model selection to training and deployment. Regarding the OS, Advantech’s unique JelinaOS satisfies requirements for secure online updates, rapid model deployment, and continuous optimization and iteration.

Advantech’s existing visual algorithms

In addition to design and development, Advantech, as a 40-year-old enterprise, places great emphasis on delivery verification and continuous maintenance. Therefore, Advantech not only completed system integration and high-standard testing on schedule but also, at the customer’s request, provided long-term software maintenance services for up to 10 years, ensuring seamless integration of components and effectively guaranteeing the reliability and stability of the overall solution. Currently, the customer has already installed 3000 devices, and the project is still in continuous shipment.

Advantech’s ROM-5880 Core Module is now available. For more information about the solution, please call Advantech’s embedded service hotline 400-001-9088. More exciting content can be found by registering for the Advantech AIM-Linux technical community to participate in discussions~