search

volotat / SD-CN-Animation

This script allows to automate video stylization task using StableDiffusion and ControlNet.
MIT License
806 stars 61 forks source link

vid2vid #32

Closed MeTheMagnificent closed 1 year ago

MeTheMagnificent commented 1 year ago

On trying vid2vid conversion, I get this error. Not sure what I'm doing wrong.

image

image

This happens with or without controlnet enabled. Also a question on controlnet. Can you just use the input directory for controlnet ? Or do you have to export the video as frames and feed it to the batch controlnet ?

volotat commented 1 year ago

Not sure about the error. Try to process any other video, preferably mp4 with H.264 codec, as I suspect that this is some sort of problem with the video itself. Regarding controlnet, you have not to do any extra steps besides just activating it and choosing the model, the current frame will be fed to the CN by the extension itself.

alexmihaic commented 1 year ago

Same happens to me:

A1111 Web UI Autoinstaller\stable-diffusion-webui/extensions/sd-cn-animation/scripts\core\txt2vid.py", line 62, in start_process processed_frame = np.array(processed_frames[0]) IndexError: list index out of range

alexmihaic commented 1 year ago

Changing the video worked for me, thanks!

MeTheMagnificent commented 1 year ago

I got a number of things wrong that time. Messed up height and width input, also the video was 5 minutes long lol. I exported a shorter 5 second video and made sure it was h.264 mp4. Still didn't work, BUT I restarted webui completely and now it works. So it's solved !

Thanks !