NCCL Communication C++ Example (Part 1): Basic Use Case Interpretation and Execution
Click the blue text to follow us The NCCL (NVIDIA Collective Communication Library, pronounced “Nickel”) library is primarily used for communication in GPU clusters. This article provides some basic C++ API library calls for learning reference. The NCCL documentation has a rich API introduction, but the explanations are interspersed with various operational details, which can … Read more