Finetune, cuda out of memory

hotshotco / Hotshot-XL

✨ Hotshot-XL: State-of-the-art AI text-to-GIF model trained to work alongside Stable Diffusion XL

https://hotshot.co

Apache License 2.0

982 stars 77 forks source link

Finetune, cuda out of memory #47

Closed xiefan233 closed 5 months ago

xiefan233 commented 5 months ago

I am using your code to make Finetune, but "cuda out of memory" is displayed. What is the memory space required by Finetune? I used an A100 with 40GB of RAM. I think the reason is that the size of the picture is too large (512). Is there a smaller picture size available from Finetune?

johnmullan commented 5 months ago

I responded to this here https://github.com/hotshotco/Hotshot-XL/issues/45#event-11402451913

It will be a challenge to fine tune on a A100 40gb at that resolution.