low-bit quantization

NPU Neural Processing Unit (7.1) – Data Compression for AI Acceleration

by
NPU Neural Processing Unit (7.1) - Data Compression for AI Acceleration

1) AI Data Compression Problem: Large language models (LLM) are powerful, but their massive scale and computational demands often present practical challenges. Deploying a model with billions of parameters requires substantial memory, processing power, and energy consumption, limiting their application in resource-constrained environments such as mobile devices or edge hardware, and increasing operational costs for … Read more

Is ADC Sampling the Conversion of Continuous Analog Signals to Time-Discrete Analog Signals?

by
Is ADC Sampling the Conversion of Continuous Analog Signals to Time-Discrete Analog Signals?

Hello everyone, I am the Information Guy~ Recently, I came across a statement: “ADC sampling is the conversion of continuous analog signals that change over time into time-discrete analog signals.” I noticed that some colleagues said this statement was incorrect, and that it should be the conversion of continuous analog signals into time-discrete digital signals. … Read more

Embedded AI Briefing (2020-03-19)

by
Embedded AI Briefing (2020-03-19)

Focus on model compression, low-bit quantization, mobile inference acceleration optimization, and deployment Abstract: The domestic epidemic situation has stabilized, and we are waiting for the open-source release of the Megvii framework at the end of March. Huawei Cloud has launched its 2020 “new flagship” – Kunpeng Cloud Phone. Meanwhile, the overseas epidemic is surging, and … Read more