Differences Between DPU and GPU

Differences Between DPU and GPU

(Source: techspot) Today, hardware and software applications for artificial intelligence have evolved into systems designed specifically to optimize AI and neural network operations. This includes Neural Processing Units (NPU), whose capabilities in accelerating AI tasks are often comparable to those of Graphics Processing Units (GPU). NPUs are increasingly common hardware designed to execute cutting-edge AI/machine … Read more

Experience AI Applications with the World’s First NPU+GPU+CPU Integrated AI Accelerator – Ryzen 7 8700G

Experience AI Applications with the World's First NPU+GPU+CPU Integrated AI Accelerator - Ryzen 7 8700G

AMD recently launched the world’s first desktop AI processor: the Ryzen 8000G series, marking the official entry of desktop PCs into the AI era. The Ryzen 8000G has garnered widespread attention from gamers and is selling hotly, poised to become the next generation’s blockbuster CPU. So, how powerful is the AI functionality of the Ryzen … Read more

Who Is the Main Character of the AI PC: CPU, GPU, or NPU?

Who Is the Main Character of the AI PC: CPU, GPU, or NPU?

As we all know, the “AI PC” has become one of the hottest topics in the consumer electronics industry today. For consumers who may not be well-versed in technical details but are intrigued by this concept, they believe that the “AI PC” can assist them in completing tasks they are not skilled at or alleviate … Read more

Efficient Point Cloud Inference with TorchSparse

Efficient Point Cloud Inference with TorchSparse

Click the card below to follow the “LiteAI” public account Hi, everyone, I am Lite. Some time ago, I shared the Efficient Large Model Full-Stack Technology from Part One to Nineteen, which includes topics such as large model quantization and fine-tuning, efficient inference for LLMs, quantum computing, and generative AI acceleration. The content links are … Read more

Unveiling the Secrets Behind Mobile Chips

Unveiling the Secrets Behind Mobile Chips

On September 10, Apple and Huawei held their product launch events simultaneously, inviting scrutiny from the market. The two tech giants—Huawei and Apple—unexpectedly chose this day to unveil their new products, undoubtedly bringing double anticipation to tech enthusiasts. This face-off has been humorously dubbed by many netizens as “mutual face-to-face grand opening”. So, when we … Read more

Understanding GPU Memory Usage in Large Models (Single GPU)

Understanding GPU Memory Usage in Large Models (Single GPU)

MLNLP community is a well-known machine learning and natural language processing community, with an audience covering NLP master’s and doctoral students, university professors, and corporate researchers. The vision of the community is to promote communication and progress between the academic and industrial sectors of natural language processing and machine learning, especially for beginners. Reprinted from … Read more

Single-GPU Operation for Thousands of Large Models: UC Berkeley’s S-LoRA Method

Single-GPU Operation for Thousands of Large Models: UC Berkeley's S-LoRA Method

Originally from PaperWeekly Author: Dan Jiang Affiliation: National University of Singapore Generally speaking, the deployment of large language models follows the “pre-training – then fine-tuning” model. However, when fine-tuning a base model for numerous tasks (such as personalized assistants), the training and service costs can become very high. Low-Rank Adaptation (LoRA) is a parameter-efficient fine-tuning … Read more

Understanding NVIDIA DGX, EGX, IGX, HGX, MGX

Understanding NVIDIA DGX, EGX, IGX, HGX, MGX

Recently, NVIDIA’s market value increased by 5.2%, closing at $3.019 trillion, surpassing Apple to become the second largest company by market value in the US stock market, second only to Microsoft. In today’s technology landscape, GPUs have become one of the most important infrastructures driving the development of artificial intelligence, deep learning, and high-performance computing. … Read more

A Universal RISC-V Chip: Integrating CPU and GPU into One Core

A Universal RISC-V Chip: Integrating CPU and GPU into One Core

X-Silicon Inc. (XSi) has created a new RISC-V microprocessor architecture that combines RISC-V CPU cores with vector capabilities and GPU acceleration into a single chip. According to Jon Peddie Research, the CPU/GPU hybrid chip is open-source and is designed to handle a variety of functions typically managed by dedicated CPUs and GPUs, aiming to do … Read more

Analysis of Chip Architecture Characteristics: CPU, GPU, NPU, FPGA, and More

Analysis of Chip Architecture Characteristics: CPU, GPU, NPU, FPGA, and More

1. Overview With the surge of artificial intelligence and the widespread application of AI algorithms, deep learning has become a key focus of current AI research. In the field of autonomous driving, environmental perception, sensor fusion, and control decision-making all involve deep learning to some extent. The performance of autonomous driving is directly related to … Read more