In the field of modern high-performance computing and parallel processing, two concepts frequently arise:SIMD (Single Instruction Multiple Data) and SIMT (Single Instruction Multiple Threads). For those who are encountering these terms for the first time, they may find their meanings and differences confusing. This article will help you understand the basic concepts, application scenarios, and … Read more
In modern parallel computing architectures, GPUs (Graphics Processing Units) are no longer just “graphics chips” used for rendering, but rather powerful “multi-core processors” with exceptional general-purpose parallel computing capabilities. Among them, NVIDIA’s CUDA programming framework employs the SIMT (Single Instruction Multiple Threads) model allows us to easily write parallel programs with a “thread” mindset. However, … Read more
It’s another pleasant weekend for learning and Q&A time (•́へ•́╬) What are SIMT and SIMD? When discussing SIMT (Single Instruction, Multiple Threads) and SIMD (Single Instruction, Multiple Data), we are dealing with two common models of parallel computing. Both are technologies used to handle large-scale data and improve computational efficiency. Here is a brief introduction … Read more
In the field of high-performance computing (HPC), improving computational efficiency and breaking through computational bottlenecks has always been an unremitting goal. SIMD (Single Instruction, Multiple Data) and SIMT (Single Instruction, Multiple Threads) technologies act like two sharp blades, cutting through various high-performance computing scenarios and playing a key role in significantly advancing computational capabilities. 1. … Read more
Comprehensive Comparison Table Feature SIMD (Single Instruction, Multiple Data) SIMT (Single Instruction, Multiple Threads) Core Essence A data parallel execution paradigm/instruction type. A single instruction operates on multiple data elements simultaneously. A thread parallel execution model. A single instruction is executed by multiple threads simultaneously, with each thread processing its own private data. The hardware … Read more
The original text is a discussion on Zhihu regarding “Is Huawei’s NPU Ascend chip a major strategic misstep, and should GPGPU have been chosen, leading to the CANN software stack facing obsolescence?” Many respondents provided insightful comments, and this article organizes the excellent responses from several contributors. —————————————— The main text begins: The essence of … Read more