Finalize NCCL communicators before destroying them

LLNL / Aluminum

High-performance, GPU-aware communication library

https://aluminum.readthedocs.io/en/latest/

Other

84 stars 21 forks source link

Closed ndryden closed 1 year ago

ndryden commented 1 year ago

NCCL documentation recommends calling finalize before destroying communicators.

Bump minimum NCCL version to 2.14, as that is when ncclCommFinalize was introduced.