Practical Edge AI with Python: From TinyML to NVIDIA Jetson for Edge Intelligence

Practical Edge AI with Python: From TinyML to NVIDIA Jetson for Edge Intelligence

1. Evolution of Edge AI Technology From TinyML microcontroller-level inference to NVIDIA Jetson GPU-accelerated computing, the edge AI technology stack achieves a balance between computing power and power consumption. This tutorial covers the entire link of model lightweighting → real-time inference → offline deployment, focusing on solving core challenges such as model compression, hardware heterogeneity, … Read more

A Comprehensive Guide to Running Large Model Applications on NVIDIA Jetson

A Comprehensive Guide to Running Large Model Applications on NVIDIA Jetson

We are very excited to share some amazing advancements in bringing the latest generative AI and large language models (LLMs) to edge computing. Since the introduction of Transformers and NVIDIA’s launch of the Ampere GPU in 2020, we have witnessed a rapid increase in the scale and intelligence of models, approaching human levels. This has … Read more

Robot Controllers: The Core of Intelligent Robotics

Robot Controllers: The Core of Intelligent Robotics

The controller is the key to bridging the gap in robotic intelligence and is crucial for the future commercialization of robots. Recently, there have been several catalysts: the release of the Helix model by Figure, the 1X NEO intelligent upgrade, and the NVIDIA GTC in March. The controller aspect deserves attention. Robot controllers can be … Read more

NVIDIA Jetson Empowers Suanfeng Journey to Create a New Generation of Intelligent Inspection Robots

NVIDIA Jetson Empowers Suanfeng Journey to Create a New Generation of Intelligent Inspection Robots

Suanfeng Journey is a service robot R&D and manufacturing company with full-stack design capabilities in “AI algorithms + hardware”. To date, it has independently developed multiple systems and products, including the “AI Visual Recognition System”, the Goose Inspection Robot, and the Goose Delivery Robot, providing high-performance customized inspection robots for numerous clients in various fields … Read more

NVIDIA Jetson OpenCV Development Practical Tutorial (Part 2)

NVIDIA Jetson OpenCV Development Practical Tutorial (Part 2)

This series was recorded by NVIDIA from 2015 to 2016, but for beginners of NVIDIA Jetson, learning OpenCV development is still very meaningful. A total of 9 lessons. NVIDIA Jetson OpenCV Development Practical Tutorial (Part 1) NVIDIA Jetson OpenCV Development Practical Tutorial (Part 2) 07 Lesson Seven Using a cascade classifier to detect objects in … Read more

AMR Warehouse Logistics Automation Solutions (NVIDIA Jetson)

AMR Warehouse Logistics Automation Solutions (NVIDIA Jetson)

Solution Name:AMR Warehouse Logistics Automation Solutions (NVIDIA Jetson) Applicant:Syrius Technology (Shenzhen) Co., Ltd. Application Industry:Logistics Solution Introduction Market Background Warehousing is a critical node in the logistics industry, and its operational efficiency greatly determines the company’s fulfillment capability and operational costs. The warehousing logistics industry has long been labor-intensive, inefficient, and fragmented. In the context … Read more

Implementing Generative AI with NVIDIA Jetson

Implementing Generative AI with NVIDIA Jetson

Recently, NVIDIA launched the Jetson Generative AI Lab, enabling developers to explore the endless possibilities of generative AI in the real world through NVIDIA Jetson edge devices. Unlike other embedded platforms, Jetson can run large language models (LLM), vision transformers, and stable diffusion locally, including the Llama-2-70B model running interactively on Jetson AGX Orin. Figure … Read more

Deploying LLaMA2 Model on Jetson Cluster

Deploying LLaMA2 Model on Jetson Cluster

In the group, developers often mention that they have several NVIDIA Jetson boards and wonder if they can “combine” them for use. However, I also mentioned that you cannot expect the performance of a cluster to exceed that of a single, more powerful machine, which led to some questions: Today, I saw a tutorial titled … Read more

Key Knowledge Points for Developing on NVIDIA Jetson

Key Knowledge Points for Developing on NVIDIA Jetson

This Tuesday evening, NVIDIA conducted an internal training for developers participating in the NVIDIA Jetson development competition. We have organized the highlights of the training session, focusing on several key points (especially the comparison charts of specifications, which everyone should save): NVIDIA Jetson Module Product Line: Developers who are new to NVIDIA Jetson products can … Read more

Implementing Generative AI with NVIDIA Jetson

Implementing Generative AI with NVIDIA Jetson

Recently, NVIDIA launched the Jetson Generative AI Lab, enabling developers to explore the limitless possibilities of generative AI in the real world using NVIDIA Jetson edge devices. Unlike other embedded platforms, Jetson can run large language models (LLMs), visual transformers, and stable diffusion locally, including the Llama-2-70B model running interactively on Jetson AGX Orin. Figure … Read more