search

kijai / ComfyUI-CogVideoXWrapper

980 stars 59 forks source link

Will CogVideoX 1.5 5b I2V ever support Tora? #278

Open RedDeltas opened 20 hours ago

RedDeltas commented 20 hours ago

Thank you for all your work making CogVideoX 1.5 5b easy to use - it's much appreciated! I was wondering what the blockers are to getting Tora support 😊

kijai commented 20 hours ago

I've spent more than a day on the issue as I really like Tora, sadly it does not seem possible without re-training or training some sort of adapter for it. Reason is that Tora trajectories are created with same size patch_embeds than the 1.0 models use, but 1.5 uses very different patch_embeds and they just aren't compatible. For the same reason 1.0 controlnets won't work with 1.5.

RedDeltas commented 18 hours ago

That is frustrating - thank you for all your work on it!