NVIDIA / mellotron

Mellotron: a multispeaker voice synthesis model based on Tacotron 2 GST that can make a voice emote and sing without emotive or singing training data
BSD 3-Clause "New" or "Revised" License
855 stars 183 forks source link

CUDA out of memory while running inference file #50

Closed pathakmukul closed 4 years ago

pathakmukul commented 4 years ago

When running the Singing voice from Music Score's second cell. The error I am getting is "CUDA out of memory. Tried to allocate 378.00 MiB (GPU 0; 6.00 GiB total capacity; 3.46 GiB already allocated; 206.13 MiB free; 4.02 GiB reserved in total by PyTorch)".

How can I reset this and get the Mellatron running?

CookiePPP commented 4 years ago

Restart the notebook. You may need to use a shorter audio file to fit inside of 6GB of VRAM. EDIT: Also you may need to close other programs using the graphics card, I see you're not using custom audio.

pathakmukul commented 4 years ago

@CookiePPP how do I shorten the audio file? I'm new to this and windows.

CookiePPP commented 4 years ago

@pathakmukul From what I see, you're just very close to the VRAM limit. If you have any

Running, you should try closing them.

You can see Dedicated GPU Memory inside Task Manager.

https://www.howtogeek.com/351073/how-to-monitor-gpu-usage-in-the-windows-task-manager/

pathakmukul commented 4 years ago

@CookiePPP I have no games or videos or anything on my laptop. It's brand new. On task manager it shows GPU usage to be around 2-3% There's no heavier task.

I restarted everything now I am getting the same error but with different values. "CUDA out of memory. Tried to allocate 2.35 GiB (GPU 0; 6.00 GiB total capacity; 1.83 GiB already allocated; 2.05 GiB free; 2.18 GiB reserved in total by PyTorch)".

CookiePPP commented 4 years ago

Dedicated GPU Memory is what you're running out of. I believe you have just enough but you will need to remove anything that uses GPU Memory other than the notebook.

Read the "How to View an Application’s Video Memory Usage" inside https://www.howtogeek.com/351073/how-to-monitor-gpu-usage-in-the-windows-task-manager/ Close anything that uses Dedicated GPU Memory that is non-essential.

rafaelvalle commented 4 years ago

Closing due to inactivity.

Narrdooo commented 3 years ago

@CookiePPP I have no games or videos or anything on my laptop. It's brand new. On task manager it shows GPU usage to be around 2-3% There's no heavier task.

I restarted everything now I am getting the same error but with different values. "CUDA out of memory. Tried to allocate 2.35 GiB (GPU 0; 6.00 GiB total capacity; 1.83 GiB already allocated; 2.05 GiB free; 2.18 GiB reserved in total by PyTorch)".

Did u solved the problem? I just met the same problem too..