Domestic Sign Language Intelligent Robot Unveiled at High-Tech Fair: Multimodal Perception Boosts IoT Upgrades

Click the blue text to follow meSet the Internet of Things as a “star mark”

Abstract: The High-Tech Fair showcases a domestically produced robot equipped with embodied intelligence for sign language, having manually recorded over 5,000 sign language data entries, compatible with various dexterous hands. The robot achieves precise interaction through multimodal sensors, breaking the limitations of single perception in the Internet of Things, highlighting China’s technological breakthroughs in the integration of embodied intelligence and IoT.

Domestic Sign Language Intelligent Robot Unveiled at High-Tech Fair: Multimodal Perception Boosts IoT Upgrades

CCTV News: Currently, the 27th China International High-Tech Achievements Fair is underway, where embodied intelligent robots have become a focal point. On-site, when dexterous hands meet the sign language large model, the robot sign language communicator is “on duty”.

The robot equipped with China’s first sign language embodied intelligence interactive system interacts with reporters. Through its embodied intelligence model, it allows ordinary robots with dexterous hand functions to possess sign language interaction capabilities.

Lv Junzeng from the Computer Application Research Center of Harbin Institute of Technology (Shenzhen Campus) introduced that there is no publicly available dataset for sign language internationally; they manually recorded over 5,000 sign language entries for interaction between actions using a sign language synthesis system.

As a research project, the team has been designing this sign language database since 2008. With the development of embodied intelligence, they have combined this sign language database with the robot’s dexterous hands, which can now adapt to various dexterous hands with different degrees of freedom. University research achievements accelerate innovation.

Additionally, during this High-Tech Fair, over a hundred universities and research institutions showcased cutting-edge research achievements.

This colored material, called zero-power intelligent temperature control film, is a smart nano-material that can achieve “warm in winter and cool in summer.” Despite its thin layer, it has significant applications in building carbon reduction, energy-saving facilities, clothing thermal comfort, and satellite aerospace, among many other fields.

Dong Kaichen, director of the Intelligent Passive Thermal Control Technology R&D Center at Tsinghua University in Shenzhen, explained that it is an intelligent temperature control material that can dissipate excess heat outside at high temperatures. When the temperature drops, it automatically switches to a warming mode, helping the objects beneath it maintain temperature. Currently, the material’s cost can be controlled at around 100 yuan per square meter or lower.

At the Sun Yat-sen University booth, reporters saw a “comprehensive prevention and treatment artificial intelligence wearable early warning device for cardiac arrest.” It not only addresses the shortcomings of traditional devices, such as discomfort in wearing, high signal noise, and weak signals, but also accurately identifies abnormal ECG features through deep learning algorithms, predicting the risk of sudden cardiac death and providing a basis for early intervention in cardiovascular diseases.

Lei Yujian, a master’s student at the School of Biomedical Engineering at Sun Yat-sen University, introduced that traditional ECG devices have a short collection time, while their device can collect data continuously for a week instead of the original 24 hours. They have also developed a series of models to denoise ECG signals, improving the quality of the collected signals. Domestic technology products shine at the High-Tech Fair.

Currently, the 27th China International High-Tech Achievements Fair is being held. This year’s fair features a variety of domestic high-tech products, from virtual drum kits that can generate sound effects in real-time to AI design systems that can generate clothing effect diagrams with one click, showcasing China’s accelerated progress in the path of independent and controllable technology.

At this High-Tech Fair, many exhibitors showcased their “flagship products.” In front of reporters, there was actually an invisible drum rack. Staff explained that with these two sticks in the reporter’s hands and the device on their feet, a total of nine different sounds can be struck.

This is an AI clothing design software that can transform clothing design drafts into finished product effect diagrams.

It is reported that this year’s High-Tech Fair has gathered over 5,000 upstream and downstream enterprises from the global industrial chain. By systematically integrating innovative resources, breaking through the industrial chain, innovation chain, and capital chain, while building an independent and controllable technological system, it has actively cultivated new quality productivity, becoming an important platform for promoting technological self-reliance and strength.

Ultra-thin tactile gloves allow data to be “touched” instantly.

The human hand can not only transmit information but also perceive the world. To enable robots to possess sensory capabilities like humans, additional sensing devices are needed. At this High-Tech Fair, reporters experienced an ultra-thin tactile glove. What can it do?

The glove worn by the reporter is a newly unveiled technology at this year’s High-Tech Fair, a full-hand covered electronic skin tactile glove. This glove can help us better perceive the world, for example, it can record temperature, pressure, and other data. When the reporter grips the microphone tightly, the computer displays real-time feedback and changes in these data. Through such a tactile glove, robots can better perceive the world. If humans wear such gloves and perform tasks lightly, it can also help robots collect real-world data.

Dong Zhi, co-founder of Tujian Technology, explained that inside it is a thin layer of soft electronic skin. When we embed the electronic skin into the glove, it injects many new functions into the glove. The sensitivity of this glove can reach 0.01 Newton per square centimeter, and it is equipped with thousands of sensors, allowing it to acquire over 10 megabits of data per second, providing strong data support for the establishment of tactile data large models.

[Disclaimer] Some content of this article is reproduced from CCTV News, and the copyright belongs to the original author. The reproduction aims to convey more information; if there is any infringement, please contact us for deletion.

Domestic Sign Language Intelligent Robot Unveiled at High-Tech Fair: Multimodal Perception Boosts IoT Upgrades

  • Huawei’s “Dual E” solution lands in emerging markets, upgrading 5G IoT experience–IoT Morning Report 20251117
  • China Mobile IoT builds 5G in-vehicle premium connection services, empowering the development of smart connected vehicles
  • Huawei’s “Dual E” solution lands in emerging markets, upgrading 5G IoT experience
  • Huizhiwei 5G RF chips enter mass production, with revenue up 48% year-on-year in the first three quarters
  • Arm Technology releases “Zhouyi” X3, enhancing AI computing power at the IoT edge
  • Li Feifei’s team launches world model, aiding the development of spatial IoT
  • Harbin Metro fully deploys 5G-A network, supporting peak ice and snow tourism–IoT Morning Report 20251114
  • Shenzhen Guangming District builds a hundred billion-level intelligent sensor industry cluster, signing 8 key projects
  • Gaofeng Forest Farm empowers forest carbon sinks with technology, realizing marketization of ecological value
  • Su Zhou focuses on the artificial intelligence industry, proposing the OPC concept to create an innovative highland
  • Shandong Heavy Industry showcases new energy smart agricultural machinery at Hannover Fair, demonstrating China’s equipment strength
  • United Imaging Medical releases a full range of intelligent ultrasound new products, AI empowers improved diagnosis and treatment efficiency

Leave a Comment