C++ API

NCCL Communication C++ Example (Part 2): Establishing Multi-Machine Connections Using Sockets

by
NCCL Communication C++ Example (Part 2): Establishing Multi-Machine Connections Using Sockets

Click the blue text to follow us The NCCL (NVIDIA Collective Communication Library) is primarily used for GPU cluster communication. This article provides some basic C++ API library calls for learning reference. It mainly introduces how to establish multi-machine initialization connections using TCP/IP sockets.. The multi-machine example on the NCCL official website uses MPI to … Read more

NCCL Communication C++ Example (Part 1): Basic Use Case Interpretation and Execution

by
NCCL Communication C++ Example (Part 1): Basic Use Case Interpretation and Execution

Click the blue text to follow us The NCCL (NVIDIA Collective Communication Library, pronounced “Nickel”) library is primarily used for communication in GPU clusters. This article provides some basic C++ API library calls for learning reference. The NCCL documentation has a rich API introduction, but the explanations are interspersed with various operational details, which can … Read more