NPU as Standard After GPU: How Phones and PCs Support AI Models?

NPU as Standard After GPU: How Phones and PCs Support AI Models?

2024 is destined to be an extraordinary year for the AI industry. Although we have just entered March, AI news has already repeatedly occupied the headlines. Last month, OpenAI released the text-generating video model Sora, whose realistic effects have directly cleared the market for entrepreneurs struggling in this niche. A few days later, Nvidia’s market … Read more

What Can Trainers Do in the Era of AI Large Models?

What Can Trainers Do in the Era of AI Large Models?

By | Li Dongshuo, Founder, Chairman, and President of UMU Source | Training Magazine July Issue It is not easy to elaborate on the definition of Artificial Intelligence (AI). The reason is that AI has the characteristic of phased development, forming new shapes and connotations over time. Three years ago, when people talked about AI, … Read more

Engineering Challenges Facing Edge Generative AI

When most people think of artificial intelligence (AI), they usually envision applications that can generate new text, images, or voice content. Popular text applications like ChatGPT have quickly risen in the market, attracting over 1 million users in just a few days, and are widely adopted. Mobile users frequently utilize voice search features. What do … Read more

Artificial Intelligence and Educational Transformation

Artificial Intelligence and Educational Transformation

WANG Xuenan1, LI Yongzhi2 (1.Research Institute of Digital Education,China National Academy of Educational Sciences, Beijing 100088; 2.China National Academy of Educational Sciences, Beijing 100088) The following video is sourced from Educational Technology Research [Abstract] The rapid iteration of generative artificial intelligence has attracted attention, and the field of education seems to be one of the … Read more

Artificial Intelligence and Educational Transformation

WANG Xuenan1, LI Yongzhi2 (1.Research Institute of Digital Education, China National Academy of Educational Sciences, Beijing 100088; 2.China National Academy of Educational Sciences, Beijing 100088) The following video is sourced from the Journal of Educational Technology [Abstract] The rapid iteration of generative artificial intelligence has attracted attention, and the field of education seems to be … Read more

Implementing Generative AI with NVIDIA Jetson

Implementing Generative AI with NVIDIA Jetson

Recently, NVIDIA launched the Jetson Generative AI Lab, enabling developers to explore the endless possibilities of generative AI in the real world through NVIDIA Jetson edge devices. Unlike other embedded platforms, Jetson can run large language models (LLM), vision transformers, and stable diffusion locally, including the Llama-2-70B model running interactively on Jetson AGX Orin. Figure … Read more

How NVIDIA Jetson Leverages Generative AI and Microservices for Powerful Visual Applications

How NVIDIA Jetson Leverages Generative AI and Microservices for Powerful Visual Applications

This article is based on a lecture from the 2024 NVIDIA GTC: The NVIDIA Metropolis microservices suite provides a reference application for Jetson that utilizes generative artificial intelligence. This is a set of cloud-native building blocks for developing edge AI applications and solutions. This lecture will inform you about the latest microservices offered by NVIDIA … Read more

Implementing Generative AI with NVIDIA Jetson

Implementing Generative AI with NVIDIA Jetson

Recently, NVIDIA launched the Jetson Generative AI Lab, enabling developers to explore the limitless possibilities of generative AI in the real world using NVIDIA Jetson edge devices. Unlike other embedded platforms, Jetson can run large language models (LLMs), visual transformers, and stable diffusion locally, including the Llama-2-70B model running interactively on Jetson AGX Orin. Figure … Read more

Four Emerging Trends Shaping Embedded AI

Four Emerging Trends Shaping Embedded AI

Editor’s Note: This article is translated from eetimes, and the author Jeff Bier is the president of consulting firm BDTI, founder of the Edge AI and Vision Alliance, and chairman of the Embedded Vision Summit. 1/ In recent years, embedded computer vision and broader perceptual artificial intelligence have seen tremendous growth: using sensors and embedded … Read more