Are there exiting any tricks to accelerate the training process?

yang-song / score_sde_pytorch

PyTorch implementation for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)

https://arxiv.org/abs/2011.13456

Apache License 2.0

1.58k stars 295 forks source link

Are there exiting any tricks to accelerate the training process? #37

Open mo666666 opened 1 year ago

mo666666 commented 1 year ago

I try to perform the experiments on 8A100 GPUs. However, as I observed, the utilities of GPUs are quite low (<20%). Therefore, I am quite curious about whether tricks exist to further accelerate the training process.