Requirements 2 GPU on a system Run $ mpirun -np 2 --allow-run-as-root ./nccl_alltoallv Reference Fast Multi-GPU collectives with NCCL NVIDIA Collective Communication Library (NCCL) Documentation