Unloading model leaves VRAM footprint

myshell-ai / MeloTTS

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

MIT License

4.84k stars 631 forks source link

Unloading model leaves VRAM footprint #213

Open jozsefszalma opened 1 week ago

jozsefszalma commented 1 week ago

Hey,

even if I move the model to cpu, then delete the model object, empty the torch cache and do a garbage collect there is still ~1.2 GB VRAM consumed by melotts. I haven't yet found the culprit. Any ideas?