Recently, uSens has officially launched a globally leading gesture recognition system solution based on the Rockchip Toybrick TB-RK3399ProD development platform, which can be widely used in artificial intelligence, AIoT, smart vision, smart voice, new retail, personal consumer electronics, and other fields, attracting much attention. This is another technological upgrade following the debut of the gesture recognition solution based on the Rockchip RK1808 chip at the Rockchip Developer Spring Conference in April, meeting the diverse demands of the market for product performance and applications.
The Toybrick TB-RK3399ProD development platform adopts a big.LITTLE CPU architecture with a dual-core Cortex-A72 and a quad-core Cortex-A53, leading in overall performance and power consumption; it features a quad-core ARM high-end GPU Mali-T860, integrating more bandwidth compression technologies for excellent overall performance, with an on-chip NPU (Neural Processing Unit) computing performance reaching 3.0 Tops. It has rich external interfaces, supporting PCIE×4 + Mini PCIE, dual USB 3.0 high-speed interfaces Type-C + USB 3.0 Type-A, dual MIPI CSI, and dual ISP, with pixel processing capabilities reaching up to 1300W pixels supporting HDMI 2.1, DP 1.2 MIPI-DSI, EDP, and other display outputs; it supports 8-channel digital microphone array input. In terms of software, it comes pre-installed with Android and Linux systems, supporting dual-system boot and one-click switching; it integrates rich AI application development components, providing a friendly and simple application programming interface, seamlessly connecting to the NPU for AI computing hardware acceleration, supporting various model inference such as TensorFlow/TensorFlow Lite/Caffe.
uSens has launched two gesture recognition solutions based on the Toybrick TB-RK3399ProD development platform, namely the RGB gesture recognition control system and the infrared binocular FINGO hardware 3D gesture solution. The core technology of the RGB gesture recognition control system is to identify 22 key points of the hand and 26 degrees of freedom to recognize hand postures, achieving full gesture recognition. The system is mature and stable, with the following highlights:
-
Low environmental requirements: can accurately recognize gestures under ordinary lighting
-
Wide recognition distance range: the distance between the hand and the camera can be from 10cm to 80cm
-
Low latency: within 15ms
-
Easy installation: download the uSens gesture APK application package and install it directly for use
-
Simple interface: real-time display of background images and 3D skeletal information of gestures
-
High cost-effectiveness
Demonstration video of the RGB gesture recognition control system based on RK3399Pro
The infrared binocular FINGO hardware 3D gesture solution combines uSens’s infrared binocular hardware FINGO with RK3399Pro, equipped with two infrared cameras, allowing gestures to have depth information, enabling tracking of 3D gestures, greatly expanding the application range, meeting the needs of users who require 3D gestures, applicable in smart home, automotive, security, and other fields.
Infrared binocular FINGO hardware based on RK3399Pro
Demonstration video of the 3D gesture solution
Earlier, uSens launched the RGB gesture recognition solution based on the Rockchip RK1808 neural network processor, mainly targeting the home appliance field. By applying the uSens gesture recognition solution based on RK1808 to smart air conditioners and TVs, gesture control can replace physical remote controls, greatly enhancing the convenience of smart home control.
Demonstration video of the RGB gesture recognition solution based on RK1808
The Rockchip Toybrick development platform integrates software and hardware development, greatly assisting solution providers in accelerating the research and development process of industry applications in the field of artificial intelligence. Currently, in addition to the TB-RK3399ProD development platform, a powerful RK1808 artificial intelligence computing stick with strong deep learning inference capabilities has also been launched. Through the ultra-high computing power of the computing stick, embedded devices can build artificial intelligence algorithms at the network edge, allowing traditional embedded devices to easily complete artificial intelligence upgrades.Products on the Toybrick platform can be purchased at the official corporate store:https://dwz.cn/SrMK19s1。
uSens has leading gesture control technology globally. The gesture recognition solution based on the Rockchip Toybrick RK3399Pro and RK1808 platforms launched this time will greatly expand the application of gesture control in more scenarios, promoting the transformation of human-computer interaction methods.
About Rockchip Toybrick
Toybrick is an artificial intelligence development platform officially launched by Rockchip, integrating software and hardware development. On the hardware side, it provides multiple series of development platforms and reference designs to meet different user groups; on the software side, it provides a stable and reliable system platform, rich development tools, a series of artificial intelligence teaching cases, and an open-source community. The Toybrick platform aims to provide efficient, convenient, and stable services, allowing developers to quickly get started with AI application development and accelerate the R&D process of industry applications, improving the industry application ecosystem.
For more information, please visit the Toybrick community: http://t.rock-chips.com/forum.php. To purchase Toybrick platform products, please visit the official corporate store: https://dwz.cn/SrMK19s1.
About uSens
uSens is a global leader in gesture tracking technology, providing various leading 2D and 3D gesture solutions, including TOF, binocular infrared, monocular infrared, and RGB. As the second company in the world to implement gesture control applications in automobiles, it has provided leading gesture control technology for manufacturers such as Byton and Xiaopeng Motors, while also being widely applied in fields such as AR/VR, industrial production, and home appliances. uSens is committed to collaborating and promoting gesture recognition in automotive and other industrial fields, using its self-developed gesture technology to drive the transformation of human-computer interaction methods, and will continue to lead the future of gesture interaction technology.
Get the latest XR news first
Follow the official website of VR Gyro (vrtuoluo.cn)
Contact information for VR Gyro:
Business cooperation | Interviews | Contributions :
Xigua (WeChat ID 18659030320)
Wenjing (WeChat mutou_kiki)
Communication sharing | Tips: Anshanzi (WeChat shimotsuki_jun)
Submission email: [email protected]
Your every “look” is the motivation for us to persist in originality
