Closed drunkinlove closed 3 years ago
Is it possible to train with DP?
го
Model is training with data parallelism. In sh file you can specify NUM_GPUS_PER_WORKER=1 parameter. For example for use 16 gpu just set to 16.
NUM_GPUS_PER_WORKER=1
Is it possible to train with DP?