How to solve CUDA OUT OF MEMORY problem?

xrenaa / DisCo

[ICLR2022] Code for "Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View"

134 stars 10 forks source link

How to solve CUDA OUT OF MEMORY problem? #5

Open huangzy-55 opened 1 year ago

huangzy-55 commented 1 year ago

I am trying to train DisCo, but it costs the cuda memory too much especially when I increase the number of positive and negative number (N and K). And it seems that declining BATCHSIZE and distributing it cannot help.