search

comfyanonymous / ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
https://www.comfy.org/
GNU General Public License v3.0
53.66k stars 5.69k forks source link

How to install deforum on comfyui #1134

Open ca3gamedev opened 1 year ago

ca3gamedev commented 1 year ago

Hi, just want to know how to make animations in comfyui.

jaideep2 commented 1 year ago

no way of doing this right now

sanguivore-easyco commented 1 year ago

https://github.com/alt-key-project/comfyui-dream-project - just found this in the same search that brought me to this issue, haven't played with it myself yet

jaideep2 commented 1 year ago

Hey @sanguivore-easyco looks promising, but I see the image gets darker and darker because of the design choices. Here is another one that uses a different approach https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

sanguivore-easyco commented 1 year ago

Hey @sanguivore-easyco looks promising, but I see the image gets darker and darker because of the design choices. Here is another one that uses a different approach https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

My main issue with this one is that it doesn't seem able to support SDXL and exports its results as gifs with lots of visual artifacts (that and I do really like the ability to music-sync things like in deforum, which I don't think AnimateDiff can support)

jaideep2 commented 1 year ago

Agreed! Let me know if you happen to come across anything with SDXL. I am currently using https://github.com/neggles/animatediff-cli because it works with my GPU that has 12GB VRAM.

aleatorydialogue commented 10 months ago

Hey @sanguivore-easyco looks promising, but I see the image gets darker and darker because of the design choices. Here is another one that uses a different approach https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

My main issue with this one is that it doesn't seem able to support SDXL and exports its results as gifs with lots of visual artifacts (that and I do really like the ability to music-sync things like in deforum, which I don't think AnimateDiff can support)

You can change the output for mp4 or some other options. But agree no sdxl is a shame

sanguivore-easyco commented 10 months ago

Hey @sanguivore-easyco looks promising, but I see the image gets darker and darker because of the design choices. Here is another one that uses a different approach https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

My main issue with this one is that it doesn't seem able to support SDXL and exports its results as gifs with lots of visual artifacts (that and I do really like the ability to music-sync things like in deforum, which I don't think AnimateDiff can support)

You can change the output for mp4 or some other options. But agree no sdxl is a shame

There's a more recent model for SDXL support in the huggingface repo for AnimateDiff now: https://huggingface.co/guoyww/animatediff/tree/main cc @jaideep2

And also with the help of https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite and ControlNets, you could possibly sync with music like Deforum in a sense.

XmYx commented 8 months ago

Check our new Deforum Node package here: https://github.com/XmYx/deforum-comfy-nodes