deforum-art / sd-webui-deforum

Deforum extension for AUTOMATIC1111's Stable Diffusion webui
https://deforum.github.io
Other
2.69k stars 389 forks source link

[Bug]: FFMPEG DID NOT STITCH ANY VIDEO #956

Open roots-3d opened 7 months ago

roots-3d commented 7 months ago

Have you read the latest version of the FAQ?

Is there an existing issue for this?

Are you using the latest version of the Deforum extension?

What happened?

Hello Deforum, thank you for the amazing art software that I use for my creations.

Error description:

In 2D and 3D modes, I can interrupt my video at any time and FFMPEG successfully stitches together the initial part of the video. This allows me to watch previews and perform some tests before choosing a final render.

2D and 3D modes are working.

In the case of Video Input, I need to let the video run until the end, in which case it completes the stitching process. However, if I use the STOP button, it gives me this bug in the terminal:

Deforum progress:  18% 10904/62007 [54:25<4:15:01,  3.34it/s]
Got a request to stitch frames to video using FFmpeg.
Frames:
/output/img2img/Deforum_20240306104116/20240306104116_%09d.png
To Video:
/output/img2img/Deforum_20240306104116/20240306104116.mp4
Stitching *video*...** FFMPEG DID NOT STITCH ANY VIDEO ** Error: local variable 'temp_file' referenced before assignment

I've been dealing with this error for a long time now, and today I'm able to detect and anticipate that this problem is recurring. The files are saved in the folder, the video is saved. However, the "update," when it fails, never returns to normal mode until I restart the program.

Steps to reproduce the problem

Error steps: -> Play on the Automatic1111 container ( https://github.com/AbdBarho/stable-diffusion-webui-docker ) -> Extensions connected: Deforum, ControlNet

-> Do Ensure the correct video path is set as video input. -> Click generate. -> Interrupt. -> Turn on ControlNets. -> Turn off ControlNets. -> Click generate. -> Interrupt. -> BUG: The video update fails to refresh and play repeating the animation executed in the last run.

What should have happened/how would you fix it?

Restart container.

Torch version

2.1.2

On which platform are you launching the webui with the extension?

No response

Deforum settings

20240306121322_settings.txt

Webui core settings

ui-config.json

Console logs

started run_deforum
times_to_run: 1
Deforum extension for auto1111 webui
Git commit: df6a63d5
Starting job task(hrggs7a2b7aebm5)-0...
Exporting Video Frames (1 every 1) frames to /output/img2img/Deforum_20240306120808/inputframes...
Trying to extract frames from video with input FPS of 25.0. Please wait patiently.
Extracted 1879 frames from video in 2.12 seconds!
Loading 1879 input frames from /output/img2img/Deforum_20240306120808/inputframes and saving video frames to /output/img2img/Deforum_20240306120808Git commit: df6a63d5
Starting job task(ihfbzbovckup4az)-0...
Exporting Video Frames (1 every 1) frames to /output/img2img/Deforum_20240306121322/inputframes...
Trying to extract frames from video with input FPS of 25.0. Please wait patiently.
Extracted 1879 frames from video in 2.17 seconds!
Loading 1879 input frames from /output/img2img/Deforum_20240306121322/inputframes and saving video frames to /output/img2img/Deforum_20240306121322
Saving animation frames to:
/output/img2img/Deforum_20240306121322
Animation frame: 0/1879  
Seed: 2518532154
Prompt: a painting in style of van gogh depicting an acoustic guitar player. music art
Neg Prompt: signature, text, name
Using video init frame /output/img2img/Deforum_20240306121322/inputframes/1000000000.jpg
╭─────┬───┬───────╮
│Steps│CFG│Denoise│
├─────┼───┼───────┤
│ 33  │7.0│   1   │
╰─────┴───┴───────╯

  0% 0/33 [00:00<?, ?it/s]

Deforum progress:   0% 0/62007 [00:00<?, ?it/s]
  3% 1/33 [00:00<00:21,  1.46it/s]

 85% 28/33 [00:03<00:00,  8.23it/s]

Deforum progress:   1% 359/62007 [00:48<2:04:35,  8.25it/s]
 88% 29/33 [00:03<00:00,  8.25it/s]

Deforum progress:   1% 360/62007 [00:48<2:04:24,  8.26it/s]
 91% 30/33 [00:03<00:00,  8.26it/s]

Deforum progress:   1% 361/62007 [00:48<2:04:17,  8.27it/s]
 94% 31/33 [00:03<00:00,  8.27it/s]

Deforum progress:   1% 362/62007 [00:48<2:04:12,  8.27it/s]
 97% 32/33 [00:03<00:00,  8.27it/s]

Deforum progress:   1% 363/62007 [00:48<2:04:08,  8.28it/s]
100% 33/33 [00:03<00:00,  8.28it/s]
100% 33/33 [00:03<00:00,  8.27it/s]

Animation frame: 11/1879  

Seed: 3495107005

Prompt: a painting in style of van gogh depicting an acoustic guitar player. music art

Neg Prompt: signature, text, name

Using video init frame /output/img2img/Deforum_20240306120709/inputframes/1000000011.jpg

╭─────┬───┬───────╮

│Steps│CFG│Denoise│

├─────┼───┼───────┤

│ 33  │7.0│   1   │

╰─────┴───┴───────╯

  0% 0/33 [00:00<?, ?it/s]

Deforum progress:   1% 364/62007 [00:49<4:47:23,  3.57it/s]
  3% 1/33 [00:00<00:03,  8.15it/s]

Deforum progress:   1% 365/62007 [00:49<3:58:10,  4.31it/s]
  6% 2/33 [00:00<00:03,  8.25it/s]

Deforum progress:   1% 366/62007 [00:49<3:23:45,  5.04it/s]
  9% 3/33 [00:00<00:03,  8.28it/s]

Deforum progress:   1% 367/62007 [00:49<2:59:48,  5.71it/s]
 12% 4/33 [00:00<00:03,  8.28it/s]

Deforum progress:   1% 368/62007 [00:49<2:43:06,  6.30it/s]
 15% 5/33 [00:00<00:03,  8.28it/s]

Deforum progress:   1% 369/62007 [00:50<2:31:21,  6.79it/s]
 18% 6/33 [00:00<00:03,  8.28it/s]

Deforum progress:   1% 370/62007 [00:50<2:23:07,  7.18it/s]
 21% 7/33 [00:00<00:03,  8.29it/s]

Deforum progress:   1% 371/62007 [00:50<2:17:19,  7.48it/s]
 24% 8/33 [00:00<00:03,  8.29it/s]

Deforum progress:   1% 372/62007 [00:50<2:13:17,  7.71it/s]
 27% 9/33 [00:01<00:02,  8.29it/s]

Deforum progress:   1% 373/62007 [00:50<2:10:27,  7.87it/s]
 30% 10/33 [00:01<00:02,  8.29it/s]

Deforum progress:   1% 374/62007 [00:50<2:08:29,  7.99it/s]
 33% 11/33 [00:01<00:02,  8.29it/s]

Deforum progress:   1% 375/62007 [00:50<2:07:06,  8.08it/s]
 36% 12/33 [00:01<00:02,  8.29it/s]

Deforum progress:   1% 376/62007 [00:50<2:06:08,  8.14it/s]
 39% 13/33 [00:01<00:02,  8.29it/s]
 39% 13/33 [00:01<00:02,  8.28it/s]

Animation frame: 12/1879  

Seed: 3495107004

Prompt: a painting in style of van gogh depicting an acoustic guitar player. music art

Neg Prompt: signature, text, name

Using video init frame /output/img2img/Deforum_20240306120709/inputframes/1000000012.jpg

Deforum progress:   1% 376/62007 [00:51<2:20:10,  7.33it/s]

Got a request to stitch frames to video using FFmpeg.

Frames:

/output/img2img/Deforum_20240306120709/20240306120709_%09d.png

To Video:

/output/img2img/Deforum_20240306120709/20240306120709.mp4

Stitching *video*...** FFMPEG DID NOT STITCH ANY VIDEO ** Error: local variable 'temp_file' referenced before assignment

 'I have a good reason for not including the log' 

the log is inside the container

Additional information

The error occurs regardless of whether the container is on Windows or Linux.

ElSuccerro commented 6 months ago

Got the same problem ...

qq2628480515 commented 6 months ago

Me, too. The previous versions were all normal. ...

rewbs commented 4 months ago

This should be resolved with the latest Deforum (which requires a1111 v1.9). If you can please confirm I will close this issue.

lavibeats commented 4 months ago

I have the same issue. Today, I hoped updating my deform extension would help, but now I can't generate anything! Screenshot 2024-05-16 091922

rewbs commented 4 months ago

I have the same issue. Today, I hoped updating my deform extension would help, but now I can't generate anything! Screenshot 2024-05-16 091922

That issue suggests you are on an old version of a1111. Can you check you have updates to 1.9?

Ryden-kai commented 3 months ago

I have updated it, but this problem still occurs

C4l1b3r commented 3 months ago

i have same issue with a1111 deforum & forge defoeum

VTL1618 commented 3 months ago

Same! Mac Os M1

C4l1b3r commented 3 months ago

Screenshot_20240707_084254_RVNC Viewer I was having every so often it wouldn't compile to video now it's none of them.

Happens on A1111 and forge

C4l1b3r commented 3 months ago

when you boot automatic1111 up do you get an opencv change

if so

i did this to fix this.

goto the forge folder and then into the venv/Scripts folder. Highlight the address bar and type cmd press enter type activate press enter pip uninstall opencv-python pip uninstall opencv-python-headless

pip install opencv-python==4.8.72 pip install opencv-python-headless==4.8.72

exit and run forge

all my issues have been fixed with this process

lavibeats commented 3 months ago

I found my problem. Just needed to add ffmpeg Link to the settings of a1111