NCCL Communication C++ Example (Part 2): Establishing Multi-Machine Connections Using Sockets
Click the blue text to follow us The NCCL (NVIDIA Collective Communication Library) is primarily used for GPU cluster communication. This article provides some basic C++ API library calls for learning reference. It mainly introduces how to establish multi-machine initialization connections using TCP/IP sockets.. The multi-machine example on the NCCL official website uses MPI to … Read more