kijai / ComfyUI-CogVideoXWrapper

988 stars 59 forks source link

What method is needed to drop fps to increase video length? #210

Open DuckersMcQuack opened 1 week ago

DuckersMcQuack commented 1 week ago

Or can the video only last for 2 seconds? As i've tried 12 fps and 24 fps, both times it's the same duration.

cheezecrisp commented 1 week ago

2 ways to extend the length of the video: a) reduce the fps parameter in videocombine node b) use frame interpolation to increase the number of frames in the video both of these methods slow down the motion.

DuckersMcQuack commented 1 week ago

Ah ok, so model is strictly intended for 2 second videos? can't do half fps to last twice as long for instance?

cheezecrisp commented 1 week ago

Ah ok, so model is strictly intended for 2 second videos? can't do half fps to last twice as long for instance?

I don't think there is a way to do that. But you can use the last frame in the video to generate another video and then concatenate them together.

DuckersMcQuack commented 1 week ago

Ah ok, so model is strictly intended for 2 second videos? can't do half fps to last twice as long for instance?

I don't think there is a way to do that. But you can use the last frame in the video to generate another video and then concatenate them together.

True. I need to see if it will result like animatediff models where last frame of the first video with the same seed will result in a X amount of second "still image video" lol. As i setup a train of 10 video gens to make up a combined 10 sec video xD

Or was it a whole damn minute i had a train for lol.

zazoum-art commented 1 week ago

Don't use the same seed. It works as cheezecrisp said. I have 1 minute and 39 secs so far with a fluid anime sequence. I told you the process in the other thread. It just needs a bit of color correction between the segments.

zazoum-art commented 1 week ago

i2v.json

Here is the workflow. With no surprise it is the basic workflow with a bit of help of Flowrense-2. I can't post the whole sequence here cause the github limit is 10MB. Give me a few moments to cut 2 characteristic raw low-res un-enchanched unedited sequences (not properly edited in a professional film direction manner).

zazoum-art commented 1 week ago

https://github.com/user-attachments/assets/782b6ef4-dbca-4601-8ee2-34957744681e

Here's an Enki-bilal dystopian style shot unedited. It is 22 secs and that's 4 clips of cogvideo, not 22. It is static camera following the woman, cause well, thats enki bilal.

Give me a few moments to cut a dynamic movement one.

zazoum-art commented 1 week ago

https://github.com/user-attachments/assets/e67cea2a-d665-49cf-ac4b-71920afe7ca8

Here's a more dramatic one. 17secs

Of course you can't present these on festivals as they are. You have to edit the momentum and change the RGB properties. I use Premiere Pro. But as you can see the transitions are fluid.

The ugly faces, the upscaling, the enchancement, blurriness, sharpness etc. are easily dealt with Topaz Video AI. They can be converted to crystal clear 8K resolution videos with all distortions fixed in under 2 minutes of 4090 process I think.

KrakeyMTL commented 1 week ago

FYI by default both the models, video and the img2vid (fun versions as well!) are 6 sec default so if yours are 2 sec then the basic settings are off.

on the output node there is a FPS setting and essentially without touching anything else (the frame interpol works as well but you need video math to get it right) by increasing the fps here you will SHORTEN the video to 4 sec (8fps = 6 sec, 10fps = 4 sec, and 6fps will make 8 sec yada yada) but then you are dealing with a slow fps video, and need topazai or adobe premiere to "fix" the entire thing.

My videos are too big for github here, but you might have seen me posting large ones around certain discord model ai channels already. I leave my settings at 8fps and then post process after.

This is a RAW example - default 6 sec to show you. [ The full video I was making is over 2min so far with over 60 spliced videos to combine into a fun racing glory demo]

https://github.com/user-attachments/assets/c15d2c1c-a9aa-400e-b60b-3286559fbd3b

KrakeyMTL commented 1 week ago

I just tested with a fresh install on one of my new servers and can confirm that yes, 6 sec default on clean!

https://github.com/user-attachments/assets/5271b6aa-42d6-4056-8f7d-09e393054825