Doubiiu / ToonCrafter

[SIGGRAPH Asia 2024, Journal Track] ToonCrafter: Generative Cartoon Interpolation
https://doubiiu.github.io/projects/ToonCrafter/
Apache License 2.0
5.4k stars 452 forks source link

Is it supposing to be taking this long to generate? (4060 ti 16gb vram) #28

Open scaruslooner opened 5 months ago

scaruslooner commented 5 months ago

Its taking me a long time 12 mins to generate a video. I have a 4060ti 16gb vram gpu. Any suggests to make it go faster? image image image image

khawar-islam commented 5 months ago

@scaruslooner I have the same problem and I am using 24GB VRAM but still i cannot generate video. It gives an error "CUDA out of memory" do you get this error? If not, did you change something?

scaruslooner commented 5 months ago

No the video complete but slow down my computer a lot , the only I did differently is use a fork of tooncraft called tooncraft for windows and follow this video https://youtu.be/E89R5_hQ5bQ?si=ByQXA5TyXKCHJ64h

scaruslooner commented 5 months ago

@khawar-islam

slayeryahu commented 5 months ago

A100 is required.

zafirexd commented 5 months ago

I use this implementation inside comfy ui https://github.com/kijai/ComfyUI-DynamiCrafterWrapper image image Download this model. If you want to keep that environment replace all the mentions of the model.ckpt with the path of the fp16.safetensors path, in all of this files in your installation image i had a 3060 12gb and the max resolution i can use is 550x400 and 450x500, 11.8gb and the advantages for use inside comfy its the batch interpolation and use also rife interpolation, but it save all the previous frames in the vram, for 2 interpolations at the same time its the best, took from 1min to 3, but if start to use more than 11.9gb, goes brrrrr to 10 mins, image (Edit/update) I dont know why but xformers dont work for me, so i kill it and use standard vae decode, i use this command F:\AI\Comfy2\ComfyUI_windows_portable\python_embeded\python.exe -m pip uninstall xformers

image

https://github.com/ToonCrafter/ToonCrafter/assets/100502318/f9209a59-617c-49ee-a190-b0d40c35f715

Utsa7 commented 5 months ago

@zafirexd thanks man! I installed comfyUI just for this. I have the same gpu so I ditto copied your workspace and it worked, but I am facing a problem, my generated clips are so short ( all 0 second) and I can't seem to make it to 2 seconds like you, do you have any idea how to achieve that? sorry I can't seem to understand most of the parameter there haha

zafirexd commented 5 months ago

@Utsa7

Just decrease the frame rate in the video combine, Tooncraft only works properly with 16 frames, for 2 secs long video, change the frame rate in video combine, "frame_rate '8' " image