Open romainphan opened 1 month ago
Is there a way to always use as much GPU as possible during training phase ? Same with different cores of the CPU ?
Maybe : https://discuss.pytorch.org/t/unstable-gpu-utilization-when-training-resnet/143507/7 --> https://on-demand.gputechconf.com/gtc-cn/2019/pdf/CN9951/presentation.pdf --> https://github.com/NVIDIA/nsight-training
Usually I tend to increase the batch size till I reach the maximum memory available. Not sure this answers your question...
Is there a way to always use as much GPU as possible during training phase ? Same with different cores of the CPU ?