CUDA initialized even when user didn't use CUDA at all in an environment with GPUs

Bluefog-Lib / bluefog

Distributed and decentralized training framework for PyTorch over graph

https://bluefog-lib.github.io/bluefog/

Apache License 2.0

291 stars 71 forks source link

CUDA initialized even when user didn't use CUDA at all in an environment with GPUs #100

Open hanbinhu opened 2 years ago

hanbinhu commented 2 years ago

The CUDA stream is initialized in MPI_context no matter whether user use CUDA or not. Consider lazy initialization. See: /home/kun/projects/hhb/bluefog/bluefog/common/mpi_context.cc:358.