Background
Video encoding and streaming technology is the core of modern streaming media technology, aimed at improving transmission efficiency and adapting to different network environments through compression and encoding of video data. With the development of the internet, the application of video content in entertainment, education, surveillance, and other fields is becoming increasingly widespread, making streaming technology a key to meet these demands. By using video encoding (such as H.264), the size of video data can be significantly reduced, thereby enhancing network transmission efficiency. Streaming technology can adapt to various network conditions, support diverse devices, and ensure real-time interaction and stability. It is widely used in live broadcasting, video surveillance, on-demand content, and other scenarios, meeting the needs for real-time performance, efficiency, and diversity. As technology continues to evolve, streaming technology will play an important role in more fields.
The RK3588 is a high-performance SoC chip that, with its powerful hardware acceleration encoding capabilities, support for the H.264 video encoding standard, concurrent processing of multiple 1080P video streams, and rich interface support (such as MIPI CSI-2, HDMI 2.0, etc.), can efficiently implement video encoding and streaming, meeting the demands for real-time performance and efficiency.
Encoding and Streaming Solution
Based on the hardware encoding capabilities of the RK3588, combined with the flexibility of FFmpeg and the server support of MediaMTX, efficient H.264 RTSP encoding streaming can be achieved. The specific process includes: capturing video streams from the camera, using the hardware accelerated encoder of the RK3588 for H.264 encoding, and then using FFmpeg to push the encoded video stream to the MediaMTX server via the RTSP protocol. MediaMTX is responsible for receiving and distributing the video stream, ensuring low latency and high efficiency for real-time transmission. This method fully leverages the hardware performance of the RK3588 while utilizing the open-source tools of FFmpeg and MediaMTX to achieve a complete solution from encoding to streaming.
Effect Demonstration
We built a real-time video streaming verification platform based on the RD-RK3588 development board from Rongpin Electronics Technology. This platform captures camera video via the MIPI interface, then uses the hardware accelerated encoder of the RK3588 to compress the video data into H.264 format, and transmits the video stream based on the RTSP protocol. The MediaMTX streaming media server receives the H.264 stream data and distributes it to users. On the receiving end, we use the EasyPlayer player to display the streaming video. The following image shows the effect of the streaming. Test results indicate that our real-time video streaming link can achieve a transmission delay of approximately 150ms.
Figure 1 Streaming Test Results
Tool Usage
Usage Environment
Based on the Rongpin Electronics Technology RD-RK3588 development board, providing trial firmware on Debian 11 system (link to Baidu Netdisk provided at the end).
Main Program Interfaces
· Streaming Class
· Streaming Initialization
· Encoding Streaming Thread Start
· Input Image
· Get Number of Encoding Streaming Queue Elements
· End Streaming
Contact Us
If you are interested in using it, please feel free to contact us: [email protected]
Trial firmware on Debian 11 system – based on Rongpin Electronics Technology RD-RK3588 development board
Link:
https://pan.baidu.com/s/15NLMDaosdRhNYDGMV4uPYw Extraction code: ejvg
Statement：Copyright belongs to the original author. Please contact us for reprinting.
ABOUT
The Spark Lab research group at Southeast University focuses on edge artificial intelligence, conducting “implementable” research to enable diverse models and assist various industries.
Communication & Cooperation: [email protected]
