search

ivcylc / qa-mdt

SOTA Text-to-music (TTM) Generation (OpenMusic)
https://qa-mdt.github.io
MIT License
397 stars 40 forks source link

A30 with 24G Memory is not enough? #12

Open 8600862 opened 1 week ago

8600862 commented 1 week ago

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB. GPU 0 has a total capacty of 23.53 GiB of which 6.06 MiB is free.

ivcylc commented 1 week ago

Yeah, the memory needed is very close to 24GB. You can try to move the VAE, Hifi-gan, Flan-t5 part on CPU, leave MDT part on GPU. If still occurs memory limit exceed error, I will update my code for 24GB infernece this weekend~

8600862 commented 1 week ago

Yeah, the memory needed is very close to 24GB. You can try to move the VAE, Hifi-gan, Flan-t5 part on CPU, leave MDT part on GPU. If still occurs memory limit exceed error, I will update my code for 24GB infernece this weekend~

thanks