Running DeepSeek on RISC-V with XTheadVector Extension

Running DeepSeek on RISC-V with XTheadVector Extension

This Friday, during an offline communication event organized by the Software Research Institute of the Chinese Academy of Sciences [1], partners from the PLCT laboratory testing team demonstrated how to run the DeepSeek R1 Distill model on the Milk-V Pioneer Box equipped with the SG2042 processor using the toolchain integrated in RuyiSDK, successfully accelerating it … Read more

Running DeepSeek on RISC-V with XTheadVector Extension Enabled

Running DeepSeek on RISC-V with XTheadVector Extension Enabled

This Friday, during an offline communication event organized by the Software Research Institute of the Chinese Academy of Sciences [1], partners from the PLCT laboratory testing team demonstrated how to use the toolchain integrated in RuyiSDK to run the DeepSeek R1 Distill model on the Milk-V Pioneer Box equipped with the SG2042 processor, and successfully … Read more

Optimizing Hardware-Software Collaboration: Arm Technology’s New Generation ‘Zhouyi’ NPU for Efficient Deployment of DeepSeek-R1

Optimizing Hardware-Software Collaboration: Arm Technology's New Generation 'Zhouyi' NPU for Efficient Deployment of DeepSeek-R1

Recently, the hardware platform equipped with Arm Technology’s latest generation ‘Zhouyi’ NPU processor successfully ran the DeepSeek-R1 series models, delivering outstanding performance and excellent cost-effectiveness, providing users with a more efficient and convenient AI application experience. This innovative NPU processor adopts an architecture design optimized for large model characteristics, and its beta version has been … Read more

Accelerating DeepSeek Inference with NPU

Accelerating DeepSeek Inference with NPU

Today, from university professors to middle and primary school students, from technology workers to ordinary citizens, DeepSeek has become an indispensable intelligent assistant, empowering various industries and driving society towards a new intelligent era. Its emergence is not only a technological innovation but also a profound social transformation. However, when we use the online version … Read more

Understanding Core Principles of DeepSeek-MLA

Understanding Core Principles of DeepSeek-MLA

DeepSeek’s MLA (Multi-head Latent Attention) is an improved attention mechanism technique based on the Transformer architecture (combining multi-head attention and latent variables), aimed at enhancing the model’s understanding and processing capabilities of input data. By introducing latent variables and sparse attention, MLA can better capture the hidden structure of input data while reducing computational overhead, … Read more

Deploying DeepSeek Distillation Models on Orange Pi with MindIE

Deploying DeepSeek Distillation Models on Orange Pi with MindIE

Introduction MindIE (Mind Inference Engine) is Huawei’s Ascend inference acceleration suite designed for AI applications across various scenarios. By providing layered open AI capabilities, it supports diverse AI business needs, enabling a multitude of models and releasing the computational power of Ascend hardware devices. It supports multiple mainstream AI frameworks and interfaces with various types … Read more

Domestic AI Chips No Longer ‘Dependent’! DeepSeek’s Key Step

Domestic AI Chips No Longer 'Dependent'! DeepSeek's Key Step

This time, the Chinese AI industry is truly different. Recently, there has been a piece of news in the tech circle that, although seemingly ordinary, is incredibly exciting upon reflection—DeepSeek has released version 3.1, introducing the UE8M0 FP8 precision format, specifically optimized for domestic AI chips. Following the announcement, A-share chip stocks surged across the … Read more

DeepSeek’s New Breakthrough! FP8 Ignites the Revolution in Domestic Chips

DeepSeek's New Breakthrough! FP8 Ignites the Revolution in Domestic Chips

Overview On August 21, Chinese AI company DeepSeek quietly released its new large model DeepSeek-V3.1, which for the first time adopts a domestically developed precision standard called “UE8M0 FP8,” specifically tailored for the next generation of autonomous chips. This move not only marks the realization of “soft and hard synergy” in Chinese AI but also … Read more

DeepSeek Drives Surge in Domestic Chip Market with UE8M0 FP8 Technology

DeepSeek Drives Surge in Domestic Chip Market with UE8M0 FP8 Technology

DeepSeek V3.1 AI model introduces a technological innovation called “UE8M0 FP8,” which has garnered widespread attention in the AI community and the market. Domestic chip companies have seen a significant rise. 1. DeepSeek V3.1 Release Causes a Sensation DeepSeek V3.1 is a newly released AI large model developed by Huansquare Quantization (the company behind DeepSeek). … Read more

DeepSeek’s Statement Sparks Surge in Domestic Chip Stocks

DeepSeek's Statement Sparks Surge in Domestic Chip Stocks

During the release of the DeepSeek-V3.1 model, the official statement from DeepSeek mentioned that the UE8M0 FP8 precision format is “designed for the upcoming next-generation domestic chips.” This statement was interpreted by the market as a significant breakthrough in the underlying technology of domestic AI chips, leading to an optimistic sentiment in the capital market … Read more