Since tech giants like Google and Amazon launched custom ASIC chips, attempting to challenge NVIDIA’s dominance in AI inference scenarios, the competition between “NVIDIA vs ASIC” has intensified. Many opinions suggest that as the industry focus shifts from model training to inference deployment, NVIDIA’s technology stack is not irreplaceable. In the latest third-quarter earnings call, … Read more
Let’s start with the first article, focusing on NVIDIA, the highest-valued company in the world. Starting at the end of 2024, NVIDIA’s latest GB200 chip will cost over $70,000 per unit. This is just the price of the chip itself—if you want to buy a complete GB200 system with eight chips and interconnect devices, the … Read more
Click belowCard to follow “Machine Vision and AI Deep Learning“ Visual/Image processing insights delivered promptly! This project is named SPEED-SAM-C++-TENSORRT, a high-performance implementation of the Segment Anything Model (SAM), utilizing NVIDIA’s TensorRT for efficient inference and optimizing GPU utilization with CUDA. Below is a detailed introduction to how this implementation works, how to compile it, … Read more
It is now 2025, and Loongson has suddenly introduced an entry-level graphics card, with performance comparable to AMD’s RX550 released in 2017, which is somewhat unimpressive! Looking into the development history of Loongson products, they began laying the groundwork for GPU products as early as 2016, primarily aiming to complement their CPU products and address … Read more
In NCCL cluster communication operations, there is no direct alltoall communication API, nor is there an alltoall_split method. This article mainly introduces the principle of alltoall_split and one implementation method, along with profiling of the send/recv operator calls in the alltoall operation. Other references: NCCL Communication C++ Example (Part 1): Basic Use Case Interpretation and … Read more
Click the blue text to follow us The NCCL (NVIDIA Collective Communication Library, pronounced “Nickel”) library is primarily used for communication in GPU clusters. This article provides some basic C++ API library calls for learning reference. The NCCL documentation has a rich API introduction, but the explanations are interspersed with various operational details, which can … Read more
In this tutorial, you will learn how to combine OpenCV’s Deep Neural Network (DNN) module with NVIDIA GPU, CUDA, and cuDNN to boost inference speed by 211-1549%. Back in August 2017, I published my first tutorial on image classification using OpenCV’s DNN module. Readers of PyImageSearch loved the convenience and ease of use of OpenCV’s … Read more
The previous content introduced the basic commands for downloading the container version of DeepStream 6.1 from NVIDIA NGC to the local Jetson device. However, before officially using the container version of DeepStream 6.1, we still need to provide basic usage methods and some tips for beginners. Jetson Orin Development Kit comes with 64GB of EMMC … Read more
The English name for GPU is Graphic Processing Unit, and the full Chinese name is 计算机图形处理器, proposed by NVIDIA in 1999. 1. Overview of GPU The concept of GPU arises in relation to the CPU in computer systems. As people’s demand for graphics has increased, especially among home systems and gaming enthusiasts, the traditional CPU … Read more
Source | Reprinted with permission from Baidu Intelligent Cloud Technology Station Official Account How to maximize the efficiency of hardware computing power is a concern for all resource operators and users. As a leading AI company, Baidu possesses perhaps the most comprehensive AI application scenarios in the industry. In this article, we will share and … Read more