ADC input

High-Speed Real-Time Tracking and Measurement Technology Based on GPU and NPU Dual-Core Collaborative Computing Model

by
High-Speed Real-Time Tracking and Measurement Technology Based on GPU and NPU Dual-Core Collaborative Computing Model

Technical Background In tasks involving high-speed motion tracking and measurement of rigid targets, visual measurement systems based on a single hardware platform typically follow a “capture – return to server – backend processing” model to sequentially complete tasks such as image acquisition, feature extraction, and target tracking. This approach suffers from high data latency and … Read more

Mid-Year Efforts | Focusing on Edge Intelligence, Developing Autonomous NPU and Software Stack

by
Mid-Year Efforts | Focusing on Edge Intelligence, Developing Autonomous NPU and Software Stack

The wind is favorable for setting sail; one does not wait for the whip to spur the horse! Time flies, and 2025 is already half over. In this half year, all staff at Zhongke Core have anchored their goals and moved forward with determination, deeply studying and implementing the spirit of the 20th National Congress … Read more

Why Google’s TPU Has Gained Popularity Recently While Huawei Abandoned NPU Solutions for GPGPU: Differences Between NPU and TPU

by
Why Google's TPU Has Gained Popularity Recently While Huawei Abandoned NPU Solutions for GPGPU: Differences Between NPU and TPU

Recently, Google’s TPU has gained significant attention, and Huawei has adjusted its chip technology roadmap. This shift is driven by the evolving demand for AI computing power and the changing scenarios for technology adaptation. First, let’s clarify the similarities and differences between NPU and TPU, and then examine the logic behind Huawei’s choice: 1. NPU … Read more

Qualcomm’s On-Device Generative AI: Innovations in Hexagon NPU Architecture Achieving 98% Performance Improvement, 0.6 Seconds Image Generation, and 20 Tokens/s LLM Inference

by
Qualcomm's On-Device Generative AI: Innovations in Hexagon NPU Architecture Achieving 98% Performance Improvement, 0.6 Seconds Image Generation, and 20 Tokens/s LLM Inference

Keywords: on-device generative AI, NPU (Neural Processing Unit), heterogeneous computing, Qualcomm AI Engine, Snapdragon, AI software stack Unlocking on-device generative AI with an NPU and heterogeneous computing https://www.qualcomm.com/content/dam/qcomm-martech/dm-assets/documents/Unlocking-on-device-generative-AI-with-an-NPU-and-heterogeneous-computing.pdf https://www.qualcomm.com/developer/artificial-intelligence This article has 13,299 words and takes 43 minutes to read, podcast 8 minutes Related ArticlesEvaluating the LLM inference performance and energy efficiency of Qualcomm 100 … Read more

Paper Interpretation | llm.npu: Achieving 43.6× Inference Acceleration on Mobile NPU with Nearly 60% Energy Efficiency Improvement

by
Paper Interpretation | llm.npu: Achieving 43.6× Inference Acceleration on Mobile NPU with Nearly 60% Energy Efficiency Improvement

Note Compilation: Wang Jiabao Paper Title: Fast On-device LLM Inference with NPUs (llm.npu) Paper Link: https://dl.acm.org/doi/abs/10.1145/3669940.3707239 Code Link: https://github.com/UbiquitousLearning/mllm Published Conference: ASPLOS 2025 Introduction The biggest challenge in deploying large language models on mobile and edge devices is the slow inference during the prefill stage, which is also very power-consuming. Even for models with around … Read more

The Three Giants of Computing: A Hard-Core Showdown Between CPU, GPU, and NPU

by
The Three Giants of Computing: A Hard-Core Showdown Between CPU, GPU, and NPU

In the realm of digital computing, three distinct “core generals” are active. Each has its own role while working in synergy to support all computing needs, from everyday office tasks to AI innovations. These three are the generalist conductor CPU, the parallel powerhouse GPU, and the AI newcomer NPU. Their emergence is not coincidental; rather, … Read more

What is an NPU?

by
What is an NPU?

With the arrival of the September school season, students will start to change their computers, and when purchasing a computer, they will inevitably encounter a new term – NPU. Computers with NPUs tend to be more expensive than those without. So, do you know what an NPU is?Let’s take a look at what an NPU … Read more

NPU Ignites a Trillion Market and the Rise of Domestic Production

by
NPU Ignites a Trillion Market and the Rise of Domestic Production

With the expansion of the artificial intelligence inference market, global tech giants are reducing their reliance on GPUs (Graphics Processing Units). They are seeking next-generation alternatives to the expensive and heat-generating GPUs. The Neural Processing Unit (NPU) is an emerging alternative, specifically designed for AI inference. This architecture, tailored for AI computation, achieves high efficiency … Read more

Is GPGPU the Solution When NPU Faces Challenges?

by
Is GPGPU the Solution When NPU Faces Challenges?

The secret is that those who follow us are industry leaders and elites. Author: Peng Cheng Source: Semiconductor Industry Overview The NPU (Neural Network Processing Unit, a dedicated chip designed for artificial intelligence computing, has a core advantage in efficiently executing neural network-related operations (such as matrix multiplication, convolution operations, activation function calculations, etc.). Compared … Read more