After the 2022-12-30 update, the default noise type is Perlin noise due to its great frame coherence improvements. If you want to use the old noise and replicate the previous settings, set the type to "uniform" in the Keyframes tab.
Video output settings: all settings (including fps and max frames)
\n
\n \n ', '
Anti-blur settings
', '
Perlin noise params, if selected.
', '
Hybrid Video Compositing in 2D/3D Modeby reallybigname
', '
Composite video with previous frame init image in 2D or 3D animation_mode(not for Video Input mode)
Uses your Init settings for video_init_path, extract_nth_frame, overwrite_extracted_frames
In Keyframes tab, you can also set color_coherence = \'Video Input\'
color_coherence_video_every_N_frames lets you only match every N frames
Color coherence may be used with hybrid composite off, to just use video color.
Hybrid motion may be used with hybrid composite off, to just use video motion.
Hybrid Video Schedules
The alpha schedule controls overall alpha for video mix, whether using a composite mask or not.
The hybrid_comp_mask_blend_alpha_schedule only affects the \'Blend\' hybrid_comp_mask_type.
Mask contrast schedule is from 0-255. Normal is 1. Affects all masks.
Autocontrast low/high cutoff schedules 0-100. Low 0 High 100 is full range. (hybrid_comp_mask_auto_contrast must be enabled)
See main Deforum document for more details.', '
Hybrid Video Schedules
', '\n Use RIFE and other Video Frame Interpolation methods to smooth out, slow-mo (or both) your output videos.\n
\n Supported engines:\n
\n
RIFE v4.6, v4.3 and v4.0. Recommended for now: v4.6.
\n
RIFE v2.3 and other interpolation engines might come in the future.
\n
\n \n
\n Important notes:\n
\n
ffmpeg has to be installed for this feature to work properly. If you can\'t have it, make sure to check the "keep_imgs" tab so that your interpolated frames are saved into HD\'\n
Frame Interpolation will not run if \'store_frames_in_ram\' is enabled.
\n
Audio (if provided) will be transferred to the interpolated video even if Slow-Mo is enabled.
\n
Frame Interpolation will always save an .mp4 video even if you used GIF for the raw video.
\n
\n \n ', 'Supports boolean operations (! - negation, & - and, | - or, ^ - xor, \ - difference, () - nested operations); default variables in \{\}, like \{init_mask\}, \{video_mask\}, \{everywhere\}; masks from files in [], like [mask1.png]; description-based word masks in <>, like <apple>, <hair>') {}
Traceback (most recent call last):
File "C:\stable-diffusion-webui\modules\call_queue.py", line 56, in f
res = list(func(args, *kwargs))
File "C:\stable-diffusion-webui\modules\call_queue.py", line 37, in f
res = func(args, **kwargs)
File "C:\stable-diffusion-webui\extensions\deforum-for-automatic1111-webui\scripts\deforum.py", line 85, in run_deforum
render_animation(args, anim_args, video_args, parseq_args, loop_args, root.animation_prompts, root)
File "C:\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\render.py", line 285, in render_animation
noised_image = add_noise(contrast_image, noise, args.seed, anim_args.noise_type,
File "C:\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\noise.py", line 62, in add_noise
sample = cv2.addWeighted(sample, 1-noise_amt, noise_to_add, noise_amt, 0)
cv2.error: OpenCV(4.6.0) D:\a\opencv-python\opencv-python\opencv\modules\core\src\arithm.cpp:650: error: (-209:Sizes of input arguments do not match) The operation is neither 'array op array' (where arrays have the same size and the same number of channels), nor 'array op scalar', nor 'scalar op array' in function 'cv::arithm_op'
0 100%|████████████████████████████████████████████████████████████████████████████████| 110/110 [00:18<00:00, 5.85it/s] 2023-01-28 22:26:40,872 - root - INFO - Calibrating color correction. | 110/6666 [00:18<18:06, 6.03it/s] Rendering animation frame 2 of 300 creating in between frame 0 tween:0.50 resized to 500x1000 creating in between frame 1 tween:1.00 resized to 500x1000 resized to 500x1000 Deforum progress: 2%|█ | 110/6666 [00:19<18:57, 5.76it/s] Error completing request Arguments: ('task(c4663zv6flaeiz1)', None, False, '', '3D', 300, 'wrap', '0:(0)', '0:(1.02+0.02sin(23.14t/20))', '0:(0)', '0:(0)', '0:(1)', '0:(0)', '0:(0)', '0:(0)', False, '0:(0)', '0:(t%15)', '0:(0)', '0:(53)', '0: (0.02)', '0: (0.6)', '0: (1.0)', '0: (7)', False, '0: (25)', '0: (40)', '0: (200)', '0: (10000)', '0: (t%4294967293)', False, '0: ("Euler a")', '0: ("!({everywhere}^({init_mask}|{video_mask}) ) ")', False, '0: ("!({everywhere}^({init_mask}|{video_mask}) ) ")', False, '0: ("model1.ckpt"), 100: ("model2.ckpt")', '0: (5)', '0: (1.0)', '0: (0.1)', '0: (0.0)', True, 'Match Frame 0 LAB', 1.0, 2.0, 'perlin', 8.0, 8.0, 4, 0.5, True, 0.3, 200.0, 10000.0, 40.0, 'border', 'bicubic', False, '/content/video_in.mp4', 1, 0, -1, False, False, '/content/videoin.mp4', False, 4, False, '20220829210106', ong neck"\n}', 512, 1024, False, False, True, 0, 0, -1, 'Euler a', False, 1, 0.01, 0, 0, 110, 0.0, 1, False, 1, True, True, False, False, False, False, 'Deforum', '{timestring}{index}_{prompt}.png', 'iter', 1, False, False, True, 0.6, 'https://user-images.githubusercontent.com/14872007/195867706-d067cdc6-28cd-450b-a61e-55e25bc67010.png', False, False, False, True, 'https://www.filterforge.com/wiki/images/archive/b/b7/20080927223728%21Polygonal_gradient_thumb.jpg', 1.0, 1.0, 5.0, 1, True, 4, 'reroll', False, 28.0, 'FFMPEG mp4', 'C:\stable-diffusion-webui\venv\lib\site-packages\imageio_ffmpeg\binaries\ffmpeg-win64-v4.2.2.exe', 17.0, 'veryslow', 'None', 'snowfall.mp3', False, False, 300.0, 'x0pred', '/content/drive/MyDrive/AI/StableDiffusion/2022-09/20220903000939%05d.png', '/content/drive/MyDrive/AI/StableDiffusion/content/drive/MyDrive/AI/StableDiffusion/2022-09/kabachuha/2022-09/20220903000939.mp4', False, 'RIFE v4.6', 'x3', 'x2', False, '', True, False, 'None', False, 'None', 'Farneback', False, 'None', False, 'None', False, False, '0:(1)', '0:(0.5)', '0:(1)', '0:(100)', '0:(0)', False, '{\n "0": "https://cdn.discordapp.com/attachments/1047760262637297664/1049851726200578058/a_dragon_flying_over_a_futuristic_city_dramatic_sky_cinematic_view_seed-1703716904ts-1670374556_idx-0.png",\n "50": "https://cdn.discordapp.com/attachments/1047760262637297664/1049901219004555274/a_digital_painting_of_a_fox_standing_in_the_grass_on_a_hill__trees_beh_t_outpaint_from-down_seed-1205071278ts-1670386356_idx-0.png",\n "100": "https://cdn.discordapp.com/attachments/745415989633482882/1048084925359857704/00024-2977479109-wings_hubble_images_jwst_images_6.png",\n "150": "https://cdn.discordapp.com/attachments/1011355905490694355/1047133257097031680/31_0031_31.jpg",\n "200": "https://cdn.discordapp.com/attachments/1047760262637297664/1049851726200578058/a_dragon_flying_over_a_futuristic_city_dramatic_sky_cinematic_view_seed-1703716904ts-1670374556_idx-0.png"\n}', '0:(.75)', '0:(.35)', '0:(.25)', '0:(20)', '0:(.075)', 'If you liked this extension, please give it a star on GitHub! 😊', '', '', '', '', '
', 'Deforum v0.5-webui-beta
', 'Made by deforum.github.io, port for AUTOMATIC1111\'s webui maintained by kabachuha', '\n- The code for this extension: Fork of deforum for auto1111\'s webui.
\n - Join the official Deforum Discord to share your creations and suggestions.
\n - For general usage, see the User guide for Deforum v0.5.
\n - For advanced animations, see the Math keyframing explanation.
\n - Alternatively, use sd-parseq as a UI to define your animation schedules (see the Parseq section in the Keyframes tab).
\n - framesync.xyz is also a good option, it makes compact math formulae for Deforum keyframes by selecting various waveforms.
\n - The other site allows for making keyframes using interactive splines and Bezier curves (select Disco output format).
\n - After the 2022-12-30 update, the default noise type is Perlin noise due to its great frame coherence improvements. If you want to use the old noise and replicate the previous settings, set the type to "uniform" in the Keyframes tab.
\n
\nImport settings from file
', 'Animation settings
', 'Motion parameters:
', '2D and 3D settings
', 'Prespective flip — Low VRAM pseudo-3D mode:
', 'Coherence:
', '3D Depth Warping:
', 'Video Input:
', 'Interpolation (turned off atm)
', 'Resume animation:
', 'Prompts
', '
prompts. (Batch mode disabled atm, only animation_prompts are working)animation_mode: None
batches on list ofImportant change from vanilla Deforum!
', 'This script uses the built-in webui weighting settings.
', 'So if you want to use math functions as prompt weights,
', 'keep the values above zero in both parts
', 'Negative prompt part can be specified with --neg
', 'Run settings
', 'Sampling settings
', '3D Fov settings:
', '', '', '', 'Batch settings
', 'Init settings
', '3D settings
', 'Steps scheduling:
', 'Video output settings
', 'To enable seed schedule select seed behavior — \'schedule\'
', '\n Use an <a style=\'color:blue;\' target=\'_blank\' href=\'https://sd-parseq.web.app/deforum\'>sd-parseq manifest for your animation (leave blank to ignore).\n\n Note that parseq overrides:\n
\n- Run: seed, subseed, subseed strength.
\n - Keyframes: generation settings (noise, strength, contrast, scale).
\n - Keyframes: motion parameters for 2D and 3D (angle, zoom, translation, rotation, perspective flip).
\n
\n \n <p">\n Parseq does not override:\n\n- Run: Sampler, W, H, Restore faces, tiling, highres fix, resize seed.
\n - Keyframes: animation settings (animation mode, max_frames, border)
\n - Keyframes: coherence (color coherence & diffusion cadence)
\n - Keyframes: depth warping
\n - Video output settings: all settings (including fps and max frames)
\n
\n \n ', 'Anti-blur settings
', 'Perlin noise params, if selected.
', 'Hybrid Video Compositing in 2D/3D Modeby reallybigname
', '- Composite video with previous frame init image in 2D or 3D animation_mode (not for Video Input mode)
- Uses your Init settings for video_init_path, extract_nth_frame, overwrite_extracted_frames
- In Keyframes tab, you can also set color_coherence = \'Video Input\'
- color_coherence_video_every_N_frames lets you only match every N frames
- Color coherence may be used with hybrid composite off, to just use video color.
- Hybrid motion may be used with hybrid composite off, to just use video motion.
Hybrid Video Schedules- The alpha schedule controls overall alpha for video mix, whether using a composite mask or not.
- The hybrid_comp_mask_blend_alpha_schedule only affects the \'Blend\' hybrid_comp_mask_type.
- Mask contrast schedule is from 0-255. Normal is 1. Affects all masks.
- Autocontrast low/high cutoff schedules 0-100. Low 0 High 100 is full range.
See main Deforum document for more details.', '(hybrid_comp_mask_auto_contrast must be enabled)
Hybrid Video Schedules
', '\n Use RIFE and other Video Frame Interpolation methods to smooth out, slow-mo (or both) your output videos.\n\n Supported engines:\n
\n- RIFE v4.6, v4.3 and v4.0. Recommended for now: v4.6.
\n - RIFE v2.3 and other interpolation engines might come in the future.
\n
\n \n\n Important notes:\n
\n- ffmpeg has to be installed for this feature to work properly. If you can\'t have it, make sure to check the "keep_imgs" tab so that your interpolated frames are saved into HD\'\n
- Frame Interpolation will not run if \'store_frames_in_ram\' is enabled.
\n - Audio (if provided) will be transferred to the interpolated video even if Slow-Mo is enabled.
\n - Frame Interpolation will always save an .mp4 video even if you used GIF for the raw video.
\n
\n \n ', 'Supports boolean operations (! - negation, & - and, | - or, ^ - xor, \ - difference, () - nested operations); default variables in \{\}, like \{init_mask\}, \{video_mask\}, \{everywhere\}; masks from files in [], like [mask1.png]; description-based word masks in <>, like <apple>, <hair>') {} Traceback (most recent call last): File "C:\stable-diffusion-webui\modules\call_queue.py", line 56, in f res = list(func(args, *kwargs)) File "C:\stable-diffusion-webui\modules\call_queue.py", line 37, in f res = func(args, **kwargs) File "C:\stable-diffusion-webui\extensions\deforum-for-automatic1111-webui\scripts\deforum.py", line 85, in run_deforum render_animation(args, anim_args, video_args, parseq_args, loop_args, root.animation_prompts, root) File "C:\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\render.py", line 285, in render_animation noised_image = add_noise(contrast_image, noise, args.seed, anim_args.noise_type, File "C:\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\noise.py", line 62, in add_noise sample = cv2.addWeighted(sample, 1-noise_amt, noise_to_add, noise_amt, 0) cv2.error: OpenCV(4.6.0) D:\a\opencv-python\opencv-python\opencv\modules\core\src\arithm.cpp:650: error: (-209:Sizes of input arguments do not match) The operation is neither 'array op array' (where arrays have the same size and the same number of channels), nor 'array op scalar', nor 'scalar op array' in function 'cv::arithm_op'