search

kijai / ComfyUI-CogVideoXWrapper

479 stars 28 forks source link

CogVideoX-Fun-V1.1 #119

Open hassakajin opened 3 hours ago

hassakajin commented 3 hours ago

is the CogVideoX-Fun-V1.1 not compatible with I2V like the first one? it completely distorts and warps images, no matter the noise strength "wich i have no idea how it works" or cfg, i had a poor cat turn into a strange matter akin to a demon from the depths of hell so many times that i had to delete the poor thing, i downloaded the model directly from HF, could that be the reason tho? i might re-download it from the loader tomorrow maybe.

kijai commented 3 hours ago

It's a lot stronger because of that noise, less noise would make it more stable. Generally the issue with the 1.0 was that it most of the time just generated no motion at all, just slow zooms, and their 1.1 was mostly to address this. I can't say I've seen anything like you describe yet though, but there's been some results with pretty much garbled motion.

That said, if you can run the model then it's working as intended, if there was any issue with download etc. it would simply error out.

hassakajin commented 2 hours ago

It's a lot stronger because of that noise, less noise would make it more stable.

yeah really cranking the noise down + lowering cfg made it way more stable, thanks! i had the idea that normal noise would be like 0.4, but around 0.010 it started getting better!

Generally the issue with the 1.0 was that it most of the time just generated no motion at all, just slow zooms, and their 1.1 was mostly to address this.

yeah that was truly an issue, though i think 1.1 was a bit overtuned in that aspect, maybe that's just me... 2b works wonders though strangely, time to get testing everything that works again i guess.