Rockchip’s intelligent vision chips feature multi-scene applicability, generalization, and security as their three main characteristics, equipped with high-performance NPU and unique visual processing ISP, effectively structuring video data analysis, transitioning from “post-processing” to “prediction/warning/prevention” application upgrades. Rockchip’s three categories of vision chips include the new intelligent vision solutions RV1126 and RV1109, the new AIoT platform RK3568, and high-performance edge computing platforms RK1808 and RK399Pro, meeting the computing power needs of different scenarios.
01
Intelligent Vision Solutions RV1126 & RV1109
1. Chip Performance
The CPU of RV1126 is a quad-core ARM Cortex-A7, with an NPU computing power of 2.0 Tops, equipped with a 14 million high-performance, 3-frame high dynamic ISP; the CPU of RV1109 is a dual-core ARM Cortex-A7, with an NPU of 1.2 Tops, equipped with a 5 million high-performance, 3-frame high dynamic ISP. In terms of video encoding and decoding, RV1126 supports 4K H.264/H.265, while RV1109 supports 5 million H.264/H.265, with RV1109 and RV1126 being pin-to-pin compatible for seamless product upgrades. It has the following six major advantages:
1. Clear Visibility
Equipped with multi-level noise reduction, 3-frame HDR, dynamic AE algorithms, white balance, and distortion correction technology, it can achieve clear and accurate monitoring and shooting in strong light, backlight, low light, and darkness, and supports 0.01lux “black light full color” shooting, making “clear visibility” a reality, better meeting the actual pain points in the field of intelligent vision.
2. Clear Audio
With built-in HDAEC algorithms and support for microphone voice arrays, high-definition audio collection is fully realized, enhancing sound capture and pickup distance.
3. Compact Size
Low bitrate, low latency encoding, and perceptual encoding reduce space occupancy, saving backend storage costs.
4. Efficient AI Algorithms
Heterogeneous computing, mixed quantization, comprehensive tools, and supporting AI algorithms and network model architectures enable rich functionality expansion. Meanwhile, power consumption is less than 10% of the required GPU, supporting TensorFlow, PyTorch, Caffe, MxNet, DarkNet, ONNX, etc., for direct conversion and deployment.
5. Software Defined Camera
Fast Boot, dual system architecture, and open SDK allow customers to deeply customize based on product needs, avoiding product homogenization.
6. Rich Encryption and Decryption Engines
Supports TrustZone technology, multiple encryption engines including national secret, and secure boot, ensuring data security and integrity.
2. Application Scenario Advantages
Based on Rockchip’s self-developed ISP2.0 technology and powerful NPU performance, RV1126 and RV1109 demonstrate visible advantages in five application scenarios: smart network cameras IPC, battery IPC/smart doorbells, access control/gates, smart screen cameras, and vehicle vision products.
Application Scenario 1
Smart Network Camera IPC
Solution Advantages:
1) Black light full color with minimal ghosting, clear in backlight and strong light. Supports multi-level noise reduction, 3-frame HDR, sharpness & contrast, Smart AE automatic exposure, AWB white balance, and distortion correction six major technologies.
2) Storage space doubled. Using Smart265 encoding technology, the captured image files are both high definition and half the size.
3) Comes with intelligent recognition algorithms, supporting boundary detection, live detection, license plate recognition, and other functions.
Application Scenario 2
Battery IPC/Smart Doorbell/Peep Hole
Solution Advantages:
1) Supports fast startup in standby mode, with the first frame capture speed of approximately 150ms.
2) Built-in NPU for intelligent filtering, effectively improving recognition accuracy.
3) Uses advanced processes, achieving lower power consumption with the same performance, supporting ultra-long standby.
4) Based on Rockchip’s unique ISP algorithm, it can achieve black light full color, clear in backlight, and no distortion in wide angles.
5) Uses Smart H.265 encoding technology, with the same shooting quality, real-time bandwidth usage is low, and video is smoother.
Application Scenario 3
Smart Access Control/Gate
Solution Advantages:
1) Built-in independent NPU, providing 2T high computing power, faster and more accurate recognition.
2) Supports live detection with an accuracy rate of up to 98.48%, making anti-counterfeiting more secure.
3) Clear in both backlight and black light, supporting recognition scenarios in complex lighting environments.
Application Scenario 4
Smart Screen Camera Products
Solution Advantages:
1) Supports 4K video encoding and decoding, high definition without stuttering.
2) Supports 3-frame HDR and wide-angle correction algorithms, clear without distortion.
3) Built-in independent high computing power NPU, enabling broader intelligent applications.
4) Supports intelligent voice control, no need to purchase audio algorithms separately.
Application Scenario 5
Vehicle Vision Products
Solution Advantages:
1) Vehicle recording performance doubled, supporting 8-channel 1080p video recording.
2) Built-in NPU, supporting ADAS (forward vehicle warning), DMS (driver fatigue detection), BSD (blind spot detection algorithms), etc., with higher efficiency.
3) Equipped with a unique ISP, ensuring high clarity in night shooting.
4) Storage space doubled, extending recording time.
5) Built-in hardware decompression module DECOM, faster decompression time, greatly improving device cold startup speed.
02
AIoT Platform RK3568
1. Chip Performance
The RK3568 chip is Rockchip’s next-generation AIoT computing platform, featuring a quad-core A55 architecture CPU and G52 GPU; it has a built-in NPU that provides 1T computing power. It has a unique ISP image processor, supporting 8M processing capability, with powerful HDR, supporting distortion correction, dehazing, noise elimination, and other functions. It supports 4K@60fps H.264/H.265/VP9 and various formats for high-definition decoding, and 1080p@100fps H.264 and H.265 format encoding. It supports rich display and peripheral interfaces, facilitating scene expansion.
2. Application Scenario Advantages
The RK3568 primarily targets network video recorders (NVR & XVR), cloud terminals, IoT gateways, smart gates/door access, and other fields.
Application Scenario 1
Network Video Recorder NVR & XVR
Solution Advantages:
1) Supports simultaneous access to up to 64 channels of 2 million pixel analog + network cameras.
2) Supports the latest WiFi6 and 5G standards, allowing wireless connection of monitoring products.
3) Unique adaptive frequency adjustment technology reduces overall power consumption by 20%.
4) Supports three-screen display, with the device able to carry its own screen, eliminating the need to purchase a separate monitor.
5) Comes with intelligent recognition algorithms, enabling live detection, intrusion alarms, anti-theft ringing, and other functions.
Application Scenario 2
Cloud Terminal
Solution Advantages:
1) Supports 4K 60-frame video decoding, and can simultaneously decode multiple video sources equivalently; supports dynamic bitrate adjustment, automatically switching video resolution based on network conditions to ensure smooth online classes.
2) Supports 2 Gigabit Ethernet ports, facilitating multi-machine networking, meeting high-speed network demands for multi-person classes and meetings.
3) Uses dynamic frequency and voltage adjustment technology, effectively reducing power consumption, with longer endurance.
4) Integrates rich interfaces, with strong scene expansion capabilities.
5) Supports Android and Linux systems, and can adapt to multiple mainstream domestic operating systems.
Application Scenario 3
IoT Gateway and Industrial Control
Solution Advantages:
1) Equipped with a high-performance processor, quad-core A55 GPU, with a built-in 1T computing power NPU.
2) High reliability design, supporting full-link ECC for DDR and CPU Cache.
3) Rich high-speed and low-speed peripheral interfaces, supporting PCIe 3.0 & PCIe 2.1, dual Gigabit Ethernet ports, SATA 3.0, USB 3.0, supporting 10x UART, 6x I2C, 16x PWM, 4x SPI, 3x CAN, 8x ADC.
Application Scenario 4
Live Detection Smart Gate/Gate Access
Solution Advantages:
1) Equipped with a high-performance processor, quad-core A55 GPU, with a built-in 1T computing power NPU.
2) Supports HDR, significantly reducing external camera costs.
3) Provides flexible high-speed expansion interfaces, supporting PCIe 3.0, SATA 3.0, USB 3.0.
03
High-Performance Edge Computing Platforms RK1808 & RK3399Pro
RK3399Pro and RK1808 are Rockchip’s first-generation high-performance artificial intelligence processors with built-in NPU, with computing power reaching up to 3T, applicable to various embedded smart products with high computing power requirements.
The official Rockchip AI development platform Toybrick has launched a series of edge computing platforms based on RK1808 and RK3399Pro, including TB-RK1808S0 computing stick, TB-RK1808M0 Mini-PCIE computing card, TB-RK3399ProD development board, etc., empowering developers and industry partners to quickly complete product hardware development and intelligent upgrades. Product details can be found on theToybrickofficial website http://t.rock-chips.com/ .
At the beginning of the “new hardware decade”, Rockchip aims to become a provider of “multi-scenario computing unit SoC”, relying on continuously optimized and upgraded artificial intelligence computing units and self-developed technologies and algorithms to continuously enrich application scenarios. Intelligent vision is one of Rockchip’s important technological directions, and we will continue to refine our capabilities to better and more accurately meet the needs of various AIoT industry customers.
