[Bug]: Resume Cadence Misalignment Stutter

brbbbq commented 1 year ago

Have you read the latest version of the FAQ?

[X] I have visited the FAQ page right now and my issue is not present there

Is there an existing issue for this?

[X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

Are you using the latest version of the Deforum extension?

[X] I have Deforum updated to the lastest version and I still have the issue.

What happened?

When using the resume function with cadence, it blends the resumed frames at the incorrect location on the timeline. In the following example cadence is set to 12 to highlight the issue. You can see the stutter at frames 72-84 on the left. The right side is after manually fixing the issue in After Effects:

https://github.com/deforum-art/sd-webui-deforum/assets/135537138/99ad723c-3538-4a80-a734-5163c801a0c0

With the current resume function, at frames 72-84, the resumed frames are inserted one period (12 frames) late, causing the animation to look like it's repeating the motion (stutter).

Steps to reproduce the problem

Using the current resume function in the Deforum extension for Automatic1111

230604-125630-chrome

What should have happened/how would you fix it?

I was able to fix the problem manually by the following steps:

Remove the last 12 frames of the original run (frames 60-72) and save in a separate folder
Resume the generation
In After Effects, cut the sequence at frame 72 and slide it 1 period (12 frames) back to frame 60
Blend the 12 frames that were removed from the original run (frames 60-72) back on top of the sequence at it's original position (frame 60)

230603-203426-AfterFX

Torch version

torch: 1.13.1+cu117

On which platform are you launching the webui with the extension?

No response

Deforum settings

https://gist.github.com/brbbbq/e31caa7054ece9e5ed2b17830e3c0fb4

Webui core settings

https://gist.github.com/brbbbq/39dbb20632274751357cac5a2e38ef13

Console logs

venv "C:\Apps\stable-diffusion\venv\Scripts\Python.exe"
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Commit hash: 22bcc7be428c94e9408f589966c2040187245d81
Installing requirements for Web UI

Launching Web UI with arguments: --xformers --disable-safe-unpickle --ckpt-dir D:\_SD\_CHECKPOINTS --embeddings-dir G:\_DOCS\_WORKING\_IMAGES\_EMBEDDINGS --lora-dir G:\_DOCS\_WORKING\_IMAGES\_LORA
ControlNet v1.1.210
ControlNet v1.1.210
Loading weights [6ce0161689] from D:\_SD\_CHECKPOINTS\v1-5-pruned-emaonly.safetensors
Creating model from config: C:\Apps\stable-diffusion\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
Applying xformers cross attention optimization.
Model loaded in 6.0s (load weights from disk: 0.2s, create model: 0.6s, apply weights to model: 1.6s, apply half(): 0.8s, move model to device: 1.0s, load textual inversion embeddings: 1.7s).
Create LRU cache (max_size=16) for preprocessor results.
Create LRU cache (max_size=16) for preprocessor results.
*Deforum ControlNet support: enabled*
Running on local URL:  http://127.0.0.1:7861

To create a public link, set `share=True` in `launch()`.
Create LRU cache (max_size=16) for preprocessor results.
Startup time: 22.2s (import torch: 4.5s, import gradio: 3.1s, import ldm: 1.0s, other imports: 2.8s, list SD models: 0.1s, setup codeformer: 0.1s, load scripts: 2.8s, load SD checkpoint: 6.2s, create ui: 1.3s, gradio launch: 0.2s).

Deforum extension for auto1111 webui, v2.4b
Git commit: 780e8a3b (Sat Jun  3 14:02:11 2023)
Saving animation frames to:
G:/_DOCS/_WORKING/_IMAGES/_STABLE_DIFFUSION/outputs/img2img-images\230603-resume_test-02_20230603200529
Loading MiDaS model from dpt_large-midas-2f21e586.pt...
Animation frame: 0/73
Seed: 737924564
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│   0   │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [00:03<00:00,  6.93it/s]
Animation frame: 12/73  ███████████████████▎                                           | 25/79 [00:03<00:07,  6.93it/s]
Creating in-between cadence frame: 0; tween:0.08;
Creating in-between cadence frame: 1; tween:0.17;
Creating in-between cadence frame: 2; tween:0.25;
Creating in-between cadence frame: 3; tween:0.33;
Creating in-between cadence frame: 4; tween:0.42;
Creating in-between cadence frame: 5; tween:0.50;
Creating in-between cadence frame: 6; tween:0.58;
Creating in-between cadence frame: 7; tween:0.67;
Creating in-between cadence frame: 8; tween:0.75;
Creating in-between cadence frame: 9; tween:0.83;
Creating in-between cadence frame: 10; tween:0.92;
Creating in-between cadence frame: 11; tween:1.00;
Seed: 737924565
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.70it/s]
Animation frame: 24/73  ██████████████████████████▌                                    | 34/79 [00:06<00:07,  5.76it/s]
Creating in-between cadence frame: 12; tween:0.08;
Creating in-between cadence frame: 13; tween:0.17;
Creating in-between cadence frame: 14; tween:0.25;
Creating in-between cadence frame: 15; tween:0.33;
Creating in-between cadence frame: 16; tween:0.42;
Creating in-between cadence frame: 17; tween:0.50;
Creating in-between cadence frame: 18; tween:0.58;
Creating in-between cadence frame: 19; tween:0.67;
Creating in-between cadence frame: 20; tween:0.75;
Creating in-between cadence frame: 21; tween:0.83;
Creating in-between cadence frame: 22; tween:0.92;
Creating in-between cadence frame: 23; tween:1.00;
Seed: 737924566
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.91it/s]
Animation frame: 36/73  █████████████████████████████████▊                             | 43/79 [00:09<00:06,  5.57it/s]
Creating in-between cadence frame: 24; tween:0.08;
Creating in-between cadence frame: 25; tween:0.17;
Creating in-between cadence frame: 26; tween:0.25;
Creating in-between cadence frame: 27; tween:0.33;
Creating in-between cadence frame: 28; tween:0.42;
Creating in-between cadence frame: 29; tween:0.50;
Creating in-between cadence frame: 30; tween:0.58;
Creating in-between cadence frame: 31; tween:0.67;
Creating in-between cadence frame: 32; tween:0.75;
Creating in-between cadence frame: 33; tween:0.83;
Creating in-between cadence frame: 34; tween:0.92;
Creating in-between cadence frame: 35; tween:1.00;
Seed: 737924567
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.86it/s]
Animation frame: 48/73  █████████████████████████████████████████▏                     | 52/79 [00:13<00:04,  5.50it/s]
Creating in-between cadence frame: 36; tween:0.08;
Creating in-between cadence frame: 37; tween:0.17;
Creating in-between cadence frame: 38; tween:0.25;
Creating in-between cadence frame: 39; tween:0.33;
Creating in-between cadence frame: 40; tween:0.42;
Creating in-between cadence frame: 41; tween:0.50;
Creating in-between cadence frame: 42; tween:0.58;
Creating in-between cadence frame: 43; tween:0.67;
Creating in-between cadence frame: 44; tween:0.75;
Creating in-between cadence frame: 45; tween:0.83;
Creating in-between cadence frame: 46; tween:0.92;
Creating in-between cadence frame: 47; tween:1.00;
Seed: 737924568
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.80it/s]
Animation frame: 60/73  ████████████████████████████████████████████████▍              | 61/79 [00:16<00:03,  5.48it/s]
Creating in-between cadence frame: 48; tween:0.08;
Creating in-between cadence frame: 49; tween:0.17;
Creating in-between cadence frame: 50; tween:0.25;
Creating in-between cadence frame: 51; tween:0.33;
Creating in-between cadence frame: 52; tween:0.42;
Creating in-between cadence frame: 53; tween:0.50;
Creating in-between cadence frame: 54; tween:0.58;
Creating in-between cadence frame: 55; tween:0.67;
Creating in-between cadence frame: 56; tween:0.75;
Creating in-between cadence frame: 57; tween:0.83;
Creating in-between cadence frame: 58; tween:0.92;
Creating in-between cadence frame: 59; tween:1.00;
Seed: 737924569
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.72it/s]
Animation frame: 72/73  ███████████████████████████████████████████████████████▋       | 70/79 [00:20<00:01,  5.44it/s]
Creating in-between cadence frame: 60; tween:0.08;
Creating in-between cadence frame: 61; tween:0.17;
Creating in-between cadence frame: 62; tween:0.25;
Creating in-between cadence frame: 63; tween:0.33;
Creating in-between cadence frame: 64; tween:0.42;
Creating in-between cadence frame: 65; tween:0.50;
Creating in-between cadence frame: 66; tween:0.58;
Creating in-between cadence frame: 67; tween:0.67;
Creating in-between cadence frame: 68; tween:0.75;
Creating in-between cadence frame: 69; tween:0.83;
Creating in-between cadence frame: 70; tween:0.92;
Creating in-between cadence frame: 71; tween:1.00;
Seed: 737924570
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.90it/s]
Deforum progress: 100%|████████████████████████████████████████████████████████████████| 79/79 [00:24<00:00,  3.25it/s]
Got a request to stitch frames to video using FFmpeg.
Frames:
G:/_DOCS/_WORKING/_IMAGES/_STABLE_DIFFUSION/outputs/img2img-images\230603-resume_test-02_20230603200529\20230603200529_%09d.png
To Video:
G:/_DOCS/_WORKING/_IMAGES/_STABLE_DIFFUSION/outputs/img2img-images\230603-resume_test-02_20230603200529\20230603200529.mp4
Stitching *video*...
Video stitching done in 1.11 seconds!
Deforum extension for auto1111 webui, v2.4b
Git commit: 780e8a3b (Sat Jun  3 14:02:11 2023)
Saving animation frames to:
G:/_DOCS/_WORKING/_IMAGES/_STABLE_DIFFUSION/outputs/img2img-images\230603-resume_test-02_20230603200717
Loading MiDaS model from dpt_large-midas-2f21e586.pt...
Animation frame: 0/145
Seed: 737924564
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│   0   │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [00:03<00:00,  6.79it/s]
Animation frame: 12/145  █████████▊                                                   | 25/133 [00:03<00:15,  6.80it/s]
Creating in-between cadence frame: 0; tween:0.08;
Creating in-between cadence frame: 1; tween:0.17;
Creating in-between cadence frame: 2; tween:0.25;
Creating in-between cadence frame: 3; tween:0.33;
Creating in-between cadence frame: 4; tween:0.42;
Creating in-between cadence frame: 5; tween:0.50;
Creating in-between cadence frame: 6; tween:0.58;
Creating in-between cadence frame: 7; tween:0.67;
Creating in-between cadence frame: 8; tween:0.75;
Creating in-between cadence frame: 9; tween:0.83;
Creating in-between cadence frame: 10; tween:0.92;
Creating in-between cadence frame: 11; tween:1.00;
Seed: 737924565
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.75it/s]
Animation frame: 24/145  ██████████████                                               | 34/133 [00:06<00:17,  5.76it/s]
Creating in-between cadence frame: 12; tween:0.08;
Creating in-between cadence frame: 13; tween:0.17;
Creating in-between cadence frame: 14; tween:0.25;
Creating in-between cadence frame: 15; tween:0.33;
Creating in-between cadence frame: 16; tween:0.42;
Creating in-between cadence frame: 17; tween:0.50;
Creating in-between cadence frame: 18; tween:0.58;
Creating in-between cadence frame: 19; tween:0.67;
Creating in-between cadence frame: 20; tween:0.75;
Creating in-between cadence frame: 21; tween:0.83;
Creating in-between cadence frame: 22; tween:0.92;
Creating in-between cadence frame: 23; tween:1.00;
Seed: 737924566
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.73it/s]
Animation frame: 36/145  ██████████████████▎                                          | 43/133 [00:09<00:16,  5.43it/s]
Creating in-between cadence frame: 24; tween:0.08;
Creating in-between cadence frame: 25; tween:0.17;
Creating in-between cadence frame: 26; tween:0.25;
Creating in-between cadence frame: 27; tween:0.33;
Creating in-between cadence frame: 28; tween:0.42;
Creating in-between cadence frame: 29; tween:0.50;
Creating in-between cadence frame: 30; tween:0.58;
Creating in-between cadence frame: 31; tween:0.67;
Creating in-between cadence frame: 32; tween:0.75;
Creating in-between cadence frame: 33; tween:0.83;
Creating in-between cadence frame: 34; tween:0.92;
Creating in-between cadence frame: 35; tween:1.00;
Seed: 737924567
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.89it/s]
Animation frame: 48/145  ██████████████████████▋                                      | 52/133 [00:13<00:14,  5.62it/s]
Creating in-between cadence frame: 36; tween:0.08;
Creating in-between cadence frame: 37; tween:0.17;
Creating in-between cadence frame: 38; tween:0.25;
Creating in-between cadence frame: 39; tween:0.33;
Creating in-between cadence frame: 40; tween:0.42;
Creating in-between cadence frame: 41; tween:0.50;
Creating in-between cadence frame: 42; tween:0.58;
Creating in-between cadence frame: 43; tween:0.67;
Creating in-between cadence frame: 44; tween:0.75;
Creating in-between cadence frame: 45; tween:0.83;
Creating in-between cadence frame: 46; tween:0.92;
Creating in-between cadence frame: 47; tween:1.00;
Seed: 737924568
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.94it/s]
Animation frame: 60/145  ██████████████████████████▉                                  | 61/133 [00:16<00:12,  5.63it/s]
Creating in-between cadence frame: 48; tween:0.08;
Creating in-between cadence frame: 49; tween:0.17;
Creating in-between cadence frame: 50; tween:0.25;
Creating in-between cadence frame: 51; tween:0.33;
Creating in-between cadence frame: 52; tween:0.42;
Creating in-between cadence frame: 53; tween:0.50;
Creating in-between cadence frame: 54; tween:0.58;
Creating in-between cadence frame: 55; tween:0.67;
Creating in-between cadence frame: 56; tween:0.75;
Creating in-between cadence frame: 57; tween:0.83;
Creating in-between cadence frame: 58; tween:0.92;
Creating in-between cadence frame: 59; tween:1.00;
Seed: 737924569
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.75it/s]
Animation frame: 72/145  ███████████████████████████████▏                             | 70/133 [00:20<00:11,  5.51it/s]
Creating in-between cadence frame: 60; tween:0.08;
Creating in-between cadence frame: 61; tween:0.17;
Creating in-between cadence frame: 62; tween:0.25;
Creating in-between cadence frame: 63; tween:0.33;
Creating in-between cadence frame: 64; tween:0.42;
Creating in-between cadence frame: 65; tween:0.50;
Creating in-between cadence frame: 66; tween:0.58;
Creating in-between cadence frame: 67; tween:0.67;
Creating in-between cadence frame: 68; tween:0.75;
Creating in-between cadence frame: 69; tween:0.83;
Creating in-between cadence frame: 70; tween:0.92;
Creating in-between cadence frame: 71; tween:1.00;
Seed: 737924570
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.87it/s]
Animation frame: 84/145  ███████████████████████████████████▍                         | 79/133 [00:23<00:09,  5.61it/s]
Creating in-between cadence frame: 72; tween:0.08;
Creating in-between cadence frame: 73; tween:0.17;
Creating in-between cadence frame: 74; tween:0.25;
Creating in-between cadence frame: 75; tween:0.33;
Creating in-between cadence frame: 76; tween:0.42;
Creating in-between cadence frame: 77; tween:0.50;
Creating in-between cadence frame: 78; tween:0.58;
Creating in-between cadence frame: 79; tween:0.67;
Creating in-between cadence frame: 80; tween:0.75;
Creating in-between cadence frame: 81; tween:0.83;
Creating in-between cadence frame: 82; tween:0.92;
Creating in-between cadence frame: 83; tween:1.00;
Seed: 737924571
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.68it/s]
Animation frame: 96/145  ███████████████████████████████████████▋                     | 88/133 [00:26<00:08,  5.30it/s]
Creating in-between cadence frame: 84; tween:0.08;
Creating in-between cadence frame: 85; tween:0.17;
Creating in-between cadence frame: 86; tween:0.25;
Creating in-between cadence frame: 87; tween:0.33;
Creating in-between cadence frame: 88; tween:0.42;
Creating in-between cadence frame: 89; tween:0.50;
Creating in-between cadence frame: 90; tween:0.58;
Creating in-between cadence frame: 91; tween:0.67;
Creating in-between cadence frame: 92; tween:0.75;
Creating in-between cadence frame: 93; tween:0.83;
Creating in-between cadence frame: 94; tween:0.92;
Creating in-between cadence frame: 95; tween:1.00;
Seed: 737924572
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.92it/s]
Animation frame: 108/145  ██████████████████████████████████████████▉                 | 97/133 [00:30<00:06,  5.48it/s]
Creating in-between cadence frame: 96; tween:0.08;
Creating in-between cadence frame: 97; tween:0.17;
Creating in-between cadence frame: 98; tween:0.25;
Creating in-between cadence frame: 99; tween:0.33;
Creating in-between cadence frame: 100; tween:0.42;
Creating in-between cadence frame: 101; tween:0.50;
Creating in-between cadence frame: 102; tween:0.58;
Creating in-between cadence frame: 103; tween:0.67;
Creating in-between cadence frame: 104; tween:0.75;
Creating in-between cadence frame: 105; tween:0.83;
Creating in-between cadence frame: 106; tween:0.92;
Creating in-between cadence frame: 107; tween:1.00;
Seed: 737924573
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.83it/s]
Animation frame: 120/145  ██████████████████████████████████████████████▍            | 106/133 [00:34<00:04,  5.41it/s]
Creating in-between cadence frame: 108; tween:0.08;
Creating in-between cadence frame: 109; tween:0.17;
Creating in-between cadence frame: 110; tween:0.25;
Creating in-between cadence frame: 111; tween:0.33;
Creating in-between cadence frame: 112; tween:0.42;
Creating in-between cadence frame: 113; tween:0.50;
Creating in-between cadence frame: 114; tween:0.58;
Creating in-between cadence frame: 115; tween:0.67;
Creating in-between cadence frame: 116; tween:0.75;
Creating in-between cadence frame: 117; tween:0.83;
Creating in-between cadence frame: 118; tween:0.92;
Creating in-between cadence frame: 119; tween:1.00;
Seed: 737924574
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
Deforum progress:  80%|█████████████████████████████████████████████████▍            | 106/133 [00:36<00:09,  2.92it/s]
Got a request to stitch frames to video using FFmpeg.
Frames:
G:/_DOCS/_WORKING/_IMAGES/_STABLE_DIFFUSION/outputs/img2img-images\230603-resume_test-02_20230603200717\20230603200717_%09d.png
To Video:
G:/_DOCS/_WORKING/_IMAGES/_STABLE_DIFFUSION/outputs/img2img-images\230603-resume_test-02_20230603200717\20230603200717.mp4
Stitching *video*...
Video stitching done in 1.43 seconds!
Deforum extension for auto1111 webui, v2.4b
Git commit: 780e8a3b (Sat Jun  3 14:02:11 2023)
Saving animation frames to:
G:/_DOCS/_WORKING/_IMAGES/_STABLE_DIFFUSION/outputs/img2img-images\230603-resume_test-02_20230603200529
Loading MiDaS model from dpt_large-midas-2f21e586.pt...
Resuming: Current frame count: 60
Resuming: Last frame: 48 - Next frame: 59
Animation frame: 60/145
Seed: 737924564
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.61it/s]
Animation frame: 72/145  ████▋                                                          | 9/88 [00:01<00:11,  7.08it/s]
Creating in-between cadence frame: 60; tween:0.08;
Creating in-between cadence frame: 61; tween:0.17;
Creating in-between cadence frame: 62; tween:0.25;
Creating in-between cadence frame: 63; tween:0.33;
Creating in-between cadence frame: 64; tween:0.42;
Creating in-between cadence frame: 65; tween:0.50;
Creating in-between cadence frame: 66; tween:0.58;
Creating in-between cadence frame: 67; tween:0.67;
Creating in-between cadence frame: 68; tween:0.75;
Creating in-between cadence frame: 69; tween:0.83;
Creating in-between cadence frame: 70; tween:0.92;
Creating in-between cadence frame: 71; tween:1.00;
Seed: 737924565
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.72it/s]
Animation frame: 84/145  ███████████                                                   | 18/88 [00:04<00:12,  5.57it/s]
Creating in-between cadence frame: 72; tween:0.08;
Creating in-between cadence frame: 73; tween:0.17;
Creating in-between cadence frame: 74; tween:0.25;
Creating in-between cadence frame: 75; tween:0.33;
Creating in-between cadence frame: 76; tween:0.42;
Creating in-between cadence frame: 77; tween:0.50;
Creating in-between cadence frame: 78; tween:0.58;
Creating in-between cadence frame: 79; tween:0.67;
Creating in-between cadence frame: 80; tween:0.75;
Creating in-between cadence frame: 81; tween:0.83;
Creating in-between cadence frame: 82; tween:0.92;
Creating in-between cadence frame: 83; tween:1.00;
Seed: 737924566
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.64it/s]
Animation frame: 96/145  █████████████████▋                                            | 27/88 [00:08<00:11,  5.45it/s]
Creating in-between cadence frame: 84; tween:0.08;
Creating in-between cadence frame: 85; tween:0.17;
Creating in-between cadence frame: 86; tween:0.25;
Creating in-between cadence frame: 87; tween:0.33;
Creating in-between cadence frame: 88; tween:0.42;
Creating in-between cadence frame: 89; tween:0.50;
Creating in-between cadence frame: 90; tween:0.58;
Creating in-between cadence frame: 91; tween:0.67;
Creating in-between cadence frame: 92; tween:0.75;
Creating in-between cadence frame: 93; tween:0.83;
Creating in-between cadence frame: 94; tween:0.92;
Creating in-between cadence frame: 95; tween:1.00;
Seed: 737924567
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.38it/s]
Animation frame: 108/145  ███████████████████████▏                                     | 36/88 [00:11<00:09,  5.26it/s]
Creating in-between cadence frame: 96; tween:0.08;
Creating in-between cadence frame: 97; tween:0.17;
Creating in-between cadence frame: 98; tween:0.25;
Creating in-between cadence frame: 99; tween:0.33;
Creating in-between cadence frame: 100; tween:0.42;
Creating in-between cadence frame: 101; tween:0.50;
Creating in-between cadence frame: 102; tween:0.58;
Creating in-between cadence frame: 103; tween:0.67;
Creating in-between cadence frame: 104; tween:0.75;
Creating in-between cadence frame: 105; tween:0.83;
Creating in-between cadence frame: 106; tween:0.92;
Creating in-between cadence frame: 107; tween:1.00;
Seed: 737924568
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.92it/s]
Animation frame: 120/145  █████████████████████████████▋                               | 45/88 [00:15<00:07,  5.47it/s]
Creating in-between cadence frame: 108; tween:0.08;
Creating in-between cadence frame: 109; tween:0.17;
Creating in-between cadence frame: 110; tween:0.25;
Creating in-between cadence frame: 111; tween:0.33;
Creating in-between cadence frame: 112; tween:0.42;
Creating in-between cadence frame: 113; tween:0.50;
Creating in-between cadence frame: 114; tween:0.58;
Creating in-between cadence frame: 115; tween:0.67;
Creating in-between cadence frame: 116; tween:0.75;
Creating in-between cadence frame: 117; tween:0.83;
Creating in-between cadence frame: 118; tween:0.92;
Creating in-between cadence frame: 119; tween:1.00;
Seed: 737924569
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.72it/s]
Animation frame: 132/145  ████████████████████████████████████▎                        | 54/88 [00:18<00:06,  5.48it/s]
Creating in-between cadence frame: 120; tween:0.08;
Creating in-between cadence frame: 121; tween:0.17;
Creating in-between cadence frame: 122; tween:0.25;
Creating in-between cadence frame: 123; tween:0.33;
Creating in-between cadence frame: 124; tween:0.42;
Creating in-between cadence frame: 125; tween:0.50;
Creating in-between cadence frame: 126; tween:0.58;
Creating in-between cadence frame: 127; tween:0.67;
Creating in-between cadence frame: 128; tween:0.75;
Creating in-between cadence frame: 129; tween:0.83;
Creating in-between cadence frame: 130; tween:0.92;
Creating in-between cadence frame: 131; tween:1.00;
Seed: 737924570
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.60it/s]
Animation frame: 144/145  ██████████████████████████████████████████▊                  | 63/88 [00:22<00:04,  5.57it/s]
Creating in-between cadence frame: 132; tween:0.08;
Creating in-between cadence frame: 133; tween:0.17;
Creating in-between cadence frame: 134; tween:0.25;
Creating in-between cadence frame: 135; tween:0.33;
Creating in-between cadence frame: 136; tween:0.42;
Creating in-between cadence frame: 137; tween:0.50;
Creating in-between cadence frame: 138; tween:0.58;
Creating in-between cadence frame: 139; tween:0.67;
Creating in-between cadence frame: 140; tween:0.75;
Creating in-between cadence frame: 141; tween:0.83;
Creating in-between cadence frame: 142; tween:0.92;
Creating in-between cadence frame: 143; tween:1.00;
Seed: 737924571
Prompt: professional close-up macro photo of a beautiful colorful arowana fish, swimming underwater in a tropical coral aquarium, crystal clear water, cinematic lighting, 8k octane render, high quality super high quality, by national geographic
Neg Prompt: blurry, grainy, noisy, stochastic noise, speckled, nsfw, nude, cartoon, illustration, painting, drawing, airbrushed, fanart, fake, nsfw, fingers, hands, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), naive, beginner, disproportionate, wtf, ugly, junk, trash, noob, gross, letters, script, text, title, symbols, watermark
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│ 0.35  │ 0  │ 0  │1.75│ 0  │ 0  │0.2 │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00,  6.83it/s]
Deforum progress:  82%|████████████████████████████████████████████████████▎           | 72/88 [00:25<00:05,  2.77it/s]
Got a request to stitch frames to video using FFmpeg.
Frames:
G:/_DOCS/_WORKING/_IMAGES/_STABLE_DIFFUSION/outputs/img2img-images\230603-resume_test-02_20230603200529\20230603200529_%09d.png
To Video:
G:/_DOCS/_WORKING/_IMAGES/_STABLE_DIFFUSION/outputs/img2img-images\230603-resume_test-02_20230603200529\20230603200529.mp4
Stitching *video*...
Video stitching done in 1.34 seconds!

Additional information

No response

github-actions[bot] commented 1 year ago

This issue has been closed due to incorrect formatting. Please address the following mistakes and reopen the issue (click on the 'Reopen' button below):

Include THE FULL LOG FROM THE START OF THE WEBUI in the issue description.

hithereai commented 1 year ago

@reallybigname would appreciate your input

github-actions[bot] commented 1 year ago

This issue has been closed due to incorrect formatting. Please address the following mistakes and reopen the issue (click on the 'Reopen' button below):

Include THE FULL LOG FROM THE START OF THE WEBUI in the issue description.

brbbbq commented 1 year ago

Tried to fix the "wrong format" error by adding the cmd console logs, but there's no "Reopen" button available.

github-actions[bot] commented 1 year ago

Thanks for addressing your formatting mistakes. The issue has been reopened now.

reallybigname commented 1 year ago

Planning to test this very soon.

brbbbq commented 1 year ago

I've actually been doing more testing and finding some inconsistencies with my results. I'm in the middle of trying to isolate some things, will follow up soon.

brbbbq commented 1 year ago

I've discovered 2 separate issues with using resume with cadence that seem to require 2 separate solutions. I used a cadence of 6, and a seed travel of 0.01/frame (I used Parseq to animate the seed).

CASE 1 - 3D Translation Only When stopping at frame 59, and resuming it creates a stutter (repeats the last 6 frames). The best solution I've found so far is to remove the last 6 frames and save in a separate folder, then resume from frame 53.

In After Effects, cut the sequence at frame 60, then slide the end section -6 frames to frame 54, overlay the saved 6 frame sequence at frame 54, and fade out (this is the same process outlined in the original post). https://i.imgur.com/xxON9h1.mp4

CASE 2 - 3D Translation & Rotation I'm not sure exactly what's going on, but for some reason the above solution doesn't work when the animation includes 3D rotation. When sliding the resumed sequence -6 frames, it makes it worse. It seems like instead of a stutter (repeating frames) it's doing the opposite (skipping frames).

https://github.com/deforum-art/sd-webui-deforum/assets/135537138/4c6a7321-dbbc-4cc7-ac0e-c03540c24ef9

In this case resuming at frame 53 achieved best results, I think this is simply from the movement being smaller at frame 53 than frame 59. https://i.imgur.com/THEQqzW.mp4

I don't know if there's some difference in the order of operations with 3D rotation that makes the scenario different than animating only the translation, but as far as I can tell animating translation creates a stutter (repeat frames) whereas rotation causes skip frames.

brbbbq commented 1 year ago

Don't know if this is helpful or not, but here's a link to my AE project files if you're interested in referring to it at all: https://mega.nz/file/sT8niTqD#2l5EtMdSV40HTIL2s1wj747_A6NPMT9xnAywmUEXCq4

reallybigname commented 1 year ago

Don't know if this is helpful or not, but here's a link to my AE project files if you're interested in referring to it at all: https://mega.nz/file/sT8niTqD#2l5EtMdSV40HTIL2s1wj747_A6NPMT9xnAywmUEXCq4

Not at all interested! But, thanks for alerting me to the resume issue. I was able to fix it last time without After Effects, so I'm sure I'll be fine this time. lol

I have repaired a bunch of stuff in my local copy. Within the next few days I should have a PR that fixes resume as well as fixing an issue where it won't go all the way to the end of an animation, and adding a bunch of new features and making others better.

reallybigname commented 1 year ago

Sorry I never fixed this. I got totally messed up by a health issue and couldn't do anything for over a month. However, I'm catching up now and have many changes to incorporate, including a rock solid fix for this which is working locally.

I may have had it done before I became ill, but when I went to fix it I found other issues that had cropped up in recent updates that made fixing it by itself much harder. Indexing was all one-off and actually had to change a lot of code to make it work right. Also, the current version won't go to the end frame of an animation. I guess nobody noticed! It was cutting of early. I don't know if I'll just try to merge everything in a nightmare merge, or address each issue separately using my copy as a reference, but either way I'm back on the job and eager to finish.

I've resumed now from many different scenarios including optical flow cadences and haven't had one issue. It's looking good. I also added a variable resume_skip_cadence which skips the cadence cycle, making the logic around resuming much easier to understand. The cadence loop comes before generation in the code, using two images from the previous cycles. So, this skipping also allows it to only regenerate the very last actual generation, rather than having to start back an extra cycle. I really got down to the nitty gritty. It starts right into the rerender of the last actual generated frame, then continues the cadence as normal.

I could have started right into the next frame without a skip mechanism, but the last generation, and the cadence frames leading up to it, usually need regenerating anyway if you cancelled, since the generation can get stopped right in the middle with a corrupted image. So, last time I fixed it, I had to make it go back another cycle in order to ensure redoing corrupted frames. The way I did it now seems to always work, and I think it could even resume from a single done image, though I haven't tried that.

brbbbq commented 1 year ago

No worries, totally know the feeling, been dealing with fatigue related to a medical condition myself.

Really appreciate you taking the time to follow-up on it, look forward to seeing it in an update!

gpihl commented 1 year ago

HI guys! Thanks for putting up this issue and working to solve it. I am also very keen on a solution to this as I use the resume feature a lot. It's nice to just step forward around 50 frames at a time, deciding what to do along the way, as it can be quite unpredictable how an animation develops. Currently I'm postponing creating anything new because of this issue. Don't really feel like going through the hassle of using video editing software to address this at like 20 different points in a 3 minute animation.,

deforum-art / sd-webui-deforum