Closed ClashSAN closed 1 year ago
I also think a wiki would be a good idea. The community can add better documentation.
I saw a great Chinese introduction to the extension illustrated with gifs, so I think it'd be great to make something like this here too
https://www.bilibili.com/read/cv19523364/
And the gifs can even be made to pop up in tooltips with JS, CSS and HTML, but I'll leave it for the future
Anyone willing to record the gifs?
You can hide them too!
I hid some gifs, @kabachuha would this be good (after fixes) or do you want to make some different guide? This is only a guide for the 2d animation, but still very useful. I haven't used the extension more than once, I made demo apple in the snow video and was very lost since. So the names of things are probably wrong.
Let's start the official tutorial. (PS: Some settings are not mentioned in the tutorial. There are three reasons: one is that the introductory tutorial is not used, the other is that there is no effect after setting, and the third is that there is generally no need to change)
After opening the Deforum animation plugin menu we can see that there are 5 tabs
Run
Keyframes
Prompts
Init
Video output
After that, we will explain its commonly used parameters separately.
Here is the place to set the length and width of the video. Set it as small as possible here. If the setting is too large, the generation speed will be very slow.
The sampler used for each image generation is set here. I won't introduce it here. Wizards should be familiar with it.
After turning on Enable extras, you can set a subseed (mutation seed) [-1 is random] to make the details different when the pictures are roughly the same. The greater the subseed_strength, the greater the difference
This option has four behaviors to choose from:
iter (iteration): continuously change on the initial seed
fixed: keep fixing on the same screen
random: randomly select a seed
schedule (custom): You can customize the seed of each frame, or the seed of certain frames
(In general, random has more screen changes than iter (iterative)
iter (iteration)
Fixed (repair) effect display
random
schedule (custom)
screen settings
animation_mode: There are three modes to choose from, one is 2D, the other is 3D, and the third is Video Input (generated using the input video) [The tutorial is based on NovelAI2D animation, so the following animations are all set in 2D here]
max_frames (maximum number of frames): the larger the number of frames, the longer the time, but remember that it is a multiple of the fps (frames per second) in the following settings
border (border): There are two modes to choose from, one is wrap (package), the other is replicate (copy)
replicate (copy) [generally choose this]
wrap (package) [this will have a side bag effect]
2D and 3D settings (screen movement settings)
angle (screen rotation): 0 is fixed, greater than 0 -> rotate counterclockwise, less than 0 -> rotate clockwise
zoom (the screen moves forward and backward (depth)): 1 is fixed, greater than 1 -> move in/inward, less than 1 -> move outward
(Here I mention that 0.98+0.02sin(23.14*t/20) in the official default setting is a function that automatically controls the movement speed according to the time variable t, which will make the movement fast, then slow and then fast to cycle)
translation_x (change along the X axis (horizontal)): 0 is fixed, greater than 0-> move to the left, less than 0-> move to the right
translation_y (change along the Y-axis direction (longitudinal)): 0 is fixed, greater than 0-> move up, less than 0-> move down
keyword setting
Format:
"n":"prompts"
n is a certain frame, prompts is a keyword
example:
"0": "{best quality}, {{masterpiece}}, {highres}, {an extremely delicate and beautiful}, original, extremely detailed wallpaper, one Fox Girl,{{{Nine fox tails}}},Small ear ,Long hair, white hair,Witch dress,looking_at_viewer,full body,petals,long_hair,cherry_blossoms,green_eyes,blonde_hair,wide_sleeves,smile,animal_ears,falling_petals,long_sleeves,sheathed --neg NSFW, lowres,bad anatomy,bad hands, text , error, missing fingers,extra digit, fewer digits, cropped, worstquality, low quality, normal quality,jpegartifacts,signature, watermark, username,blurry,bad feet"
Example explanation:
--neg is to separate your prompt and negative prompts
You can set keywords for certain frames by the following methods
Format:
"n":"prompts"
n is a certain frame, prompts is the keyword, the difference between multiple frames is that there are multiple frame descriptions and the description of each frame is separated by ,
example:
"0": "Apple",
"30": "Banana"
The fps here is mentioned in the previous setting of the total number of frames. The larger the fps, the smoother the picture, but at the same time, the speed of change in this plug-in will be faster. Generally, the effect is best around 12 to 15.
Congratulations, you have finished reading the "WebUi Animation Plug-in Deforum Introductory Tutorial (Based on NovelAI2D Animation)" column in this issue, and you can start to try more complex animations! If it is helpful to you, please give a one-click three-link! If you have any questions or suggestions, please put them in the comment area. (PS: Some settings will not be mentioned in the tutorial, there are three reasons: one is that the introductory tutorial is not used, the other is that there is no effect after setting, and the third is that there is generally no need to change) (There will be follow-up advanced columns in the future, welcome Everyone follow me, don't miss the follow-up content)
If you are still not satisfied, you can take a look at the following, some animation videos made by me: Author: Xiaoli xiaolxl https://www.bilibili.com/read/cv19523364/ Source: bilibili
Looks quite great! I'll think about the best format for the guide a little bit more, but you can attempt to make gifs for more settings meanwhile
Let me know if any help is needed with this guide, I'm down to help.
A great idea for gifs. It would be perfect to do this kind of thing with the more advanced features like the "Hybrid Video" section, or to show the influence of certain parameters in the "init_video" mode, ... etc. There is so much to say with all these updates !
https://dreamingcomputers.com/deforum-stable-diffusion/deforum-stable-diffusion-settings/
https://github.com/deforum-art/deforum-for-automatic1111-webui/wiki/Animation-Video-Examples-Gallery
Please talk with me in DM or via Discord if you want to contribute to the wiki :)
Closing.
Just requesting some additional documentation, perhaps a wiki page. We like pictures here, right? 😅