Gradio seems to double VRAM requirement

open-mmlab / FoleyCrafter

FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds. AI拟音大师，给你的无声视频添加生动而且同步的音效 😝

https://foleycrafter.github.io/

Apache License 2.0

472 stars 41 forks source link

Open dzupin opened 4 months ago

dzupin commented 4 months ago

Running sora examples in CLI: python inference.py --save_dir=output/sora/ requires about 12.7 GB VRAM

Running same examples in gradio GUI: python app.py requires more than 24 GB VRAM (fails to fit into my 4090 card)

There seems to be something wrong with how memory is used in Gradio app

xpeng commented 4 months ago

same issue

kostebas commented 4 months ago

same issue anybody knows how it fix it ?

yhqqxq commented 4 months ago

same issue