deforum-art / sd-webui-deforum

Deforum extension for AUTOMATIC1111's Stable Diffusion webui
https://deforum.github.io
Other
2.72k stars 390 forks source link

Adding more example pictures/gifs that show features #72

Closed ClashSAN closed 1 year ago

ClashSAN commented 2 years ago

Just requesting some additional documentation, perhaps a wiki page. We like pictures here, right? 😅

Zarxrax commented 2 years ago

I also think a wiki would be a good idea. The community can add better documentation.

kabachuha commented 2 years ago

I saw a great Chinese introduction to the extension illustrated with gifs, so I think it'd be great to make something like this here too

https://www.bilibili.com/read/cv19523364/

And the gifs can even be made to pop up in tooltips with JS, CSS and HTML, but I'll leave it for the future


Anyone willing to record the gifs?

ClashSAN commented 2 years ago

test

You can hide them too!

Example: (Click to expand:) ![test](https://i0.hdslb.com/bfs/article/fc48a5b1963a7d207f64b8195f1711df9722a33b.gif)
ClashSAN commented 2 years ago

I hid some gifs, @kabachuha would this be good (after fixes) or do you want to make some different guide? This is only a guide for the 2d animation, but still very useful. I haven't used the extension more than once, I made demo apple in the snow video and was very lost since. So the names of things are probably wrong.

2d Guide by 小李xiaolxl

Let's start the official tutorial. (PS: Some settings are not mentioned in the tutorial. There are three reasons: one is that the introductory tutorial is not used, the other is that there is no effect after setting, and the third is that there is generally no need to change)

1. Overview

After opening the Deforum animation plugin menu we can see that there are 5 tabs

image

After that, we will explain its commonly used parameters separately.

2. Run

image

Set video length and width

image

Here is the place to set the length and width of the video. Set it as small as possible here. If the setting is too large, the generation speed will be very slow.

set sampler

image

The sampler used for each image generation is set here. I won't introduce it here. Wizards should be familiar with it.

Picture difference setting

image

After turning on Enable extras, you can set a subseed (mutation seed) [-1 is random] to make the details different when the pictures are roughly the same. The greater the subseed_strength, the greater the difference

Behavior of seeds per frame

image

This option has four behaviors to choose from:

(In general, random has more screen changes than iter (iterative)

iteration iter (iteration)

fixed example: (Click to expand:) ![test](https://i0.hdslb.com/bfs/article/fc48a5b1963a7d207f64b8195f1711df9722a33b.gif)

Fixed (repair) effect display

random example: (Click to expand:) ![random](https://i0.hdslb.com/bfs/article/7cd6345c39e78950a69b7b67a51be490d53c334a.gif)

random

schedule example: (Click to expand:) ![schedule](https://i0.hdslb.com/bfs/article/33102d0451f3883acf223bead2efd13d05d66ca1.gif)

schedule (custom)

3. Keyframes

image

screen settings

animation_mode: There are three modes to choose from, one is 2D, the other is 3D, and the third is Video Input (generated using the input video) [The tutorial is based on NovelAI2D animation, so the following animations are all set in 2D here]

border example: (Click to expand:) ![border](https://i0.hdslb.com/bfs/article/57312d28934e1eaf2744d4d375e5cebdda846a05.gif)

replicate (copy) [generally choose this]

replicate example: (Click to expand:) ![replicate](https://i0.hdslb.com/bfs/article/873189ab5d68719f1493bf6f963c58e0e4ed6655.gif)

wrap (package) [this will have a side bag effect]

image

2D and 3D settings (screen movement settings)

angle (screen rotation): 0 is fixed, greater than 0 -> rotate counterclockwise, less than 0 -> rotate clockwise

Angle Example: (Click to expand:) ![test](https://i0.hdslb.com/bfs/article/62de2391f6e9cafec2b57af63c8d15437e69e52d.gif) ![test](https://i0.hdslb.com/bfs/article/343b465dfa42f9ad03ebf53832f8459d3400030d.gif)

zoom (the screen moves forward and backward (depth)): 1 is fixed, greater than 1 -> move in/inward, less than 1 -> move outward

Zoom Example: (Click to expand:) ![test](https://i0.hdslb.com/bfs/article/57312d28934e1eaf2744d4d375e5cebdda846a05.gif) ![test](https://i0.hdslb.com/bfs/article/83ee2f251ab8ef0a5bd6b8ab3ebcdcb2c610db4d.gif)

(Here I mention that 0.98+0.02sin(23.14*t/20) in the official default setting is a function that automatically controls the movement speed according to the time variable t, which will make the movement fast, then slow and then fast to cycle)

translation_x (change along the X axis (horizontal)): 0 is fixed, greater than 0-> move to the left, less than 0-> move to the right

Example: (Click to expand:) ![test](https://i0.hdslb.com/bfs/article/3fddb9a2811b587c004ee4ac8d15c46bcb61f6ca.gif) ![test](https://i0.hdslb.com/bfs/article/1b547989384ea97fbb48bc22e1215322e03724a2.gif)

translation_y (change along the Y-axis direction (longitudinal)): 0 is fixed, greater than 0-> move up, less than 0-> move down

Example: (Click to expand:) ![test](https://i0.hdslb.com/bfs/article/c95e9209b884f96a7d2471d9435692187039150d.gif) ![test](https://i0.hdslb.com/bfs/article/8452359bab59e1571dc0e8de177d9a5c83c84a57.gif)

4. Prompts (keyword settings)

image

keyword setting

4.1 Single Frame Control

Format:

"n":"prompts"

n is a certain frame, prompts is a keyword

example:

"0": "{best quality}, {{masterpiece}}, {highres}, {an extremely delicate and beautiful}, original, extremely detailed wallpaper, one Fox Girl,{{{Nine fox tails}}},Small ear ,Long hair, white hair,Witch dress,looking_at_viewer,full body,petals,long_hair,cherry_blossoms,green_eyes,blonde_hair,wide_sleeves,smile,animal_ears,falling_petals,long_sleeves,sheathed --neg NSFW, lowres,bad anatomy,bad hands, text , error, missing fingers,extra digit, fewer digits, cropped, worstquality, low quality, normal quality,jpegartifacts,signature, watermark, username,blurry,bad feet"

Example explanation:

--neg is to separate your prompt and negative prompts

4.2 Multi-frame control

You can set keywords for certain frames by the following methods

Format:

"n":"prompts"

n is a certain frame, prompts is the keyword, the difference between multiple frames is that there are multiple frame descriptions and the description of each frame is separated by ,

example:

"0": "Apple",

"30": "Banana"

5. Video output (video export settings)

image

The fps here is mentioned in the previous setting of the total number of frames. The larger the fps, the smoother the picture, but at the same time, the speed of change in this plug-in will be faster. Generally, the effect is best around 12 to 15.

Congratulations, you have finished reading the "WebUi Animation Plug-in Deforum Introductory Tutorial (Based on NovelAI2D Animation)" column in this issue, and you can start to try more complex animations! If it is helpful to you, please give a one-click three-link! If you have any questions or suggestions, please put them in the comment area. (PS: Some settings will not be mentioned in the tutorial, there are three reasons: one is that the introductory tutorial is not used, the other is that there is no effect after setting, and the third is that there is generally no need to change) (There will be follow-up advanced columns in the future, welcome Everyone follow me, don't miss the follow-up content)

If you are still not satisfied, you can take a look at the following, some animation videos made by me: Author: Xiaoli xiaolxl https://www.bilibili.com/read/cv19523364/ Source: bilibili

kabachuha commented 2 years ago

Looks quite great! I'll think about the best format for the guide a little bit more, but you can attempt to make gifs for more settings meanwhile

hithereai commented 1 year ago

Let me know if any help is needed with this guide, I'm down to help.

ghost commented 1 year ago

A great idea for gifs. It would be perfect to do this kind of thing with the more advanced features like the "Hybrid Video" section, or to show the influence of certain parameters in the "init_video" mode, ... etc. There is so much to say with all these updates !

https://dreamingcomputers.com/deforum-stable-diffusion/deforum-stable-diffusion-settings/

hithereai commented 1 year ago

https://github.com/deforum-art/deforum-for-automatic1111-webui/wiki/Animation-Video-Examples-Gallery

Please talk with me in DM or via Discord if you want to contribute to the wiki :)

Closing.