Memory Bottleneck

Innovative Energy-Saving NPU Technology Developed by South Korean Researchers Reduces AI Model Power Consumption by 44%

by
Innovative Energy-Saving NPU Technology Developed by South Korean Researchers Reduces AI Model Power Consumption by 44%

Researchers at the Korea Advanced Institute of Science and Technology (KAIST) have developed an energy-saving NPU (Neural Processing Unit) technology that has shown significant performance improvements in laboratory tests. Based on controlled experimental results, their dedicated AI chip runs AI models 60% faster than the graphics cards currently powering most AI systems, while reducing power … Read more

Interview Question: Can L2 Cache Be Removed When Using Only a Single Cortex-A Core?

by
Interview Question: Can L2 Cache Be Removed When Using Only a Single Cortex-A Core?

Even when using only a single Cortex-A core, the L2 cache cannot be eliminated. Students at the Jingxin Training Camp have asked this question before, and the role of L2 cache is crucial. Why is that? The core issue is that the CPU operates too quickly, while accessing the external main memory is too slow. … Read more