continue-revolution / sd-webui-animatediff

AnimateDiff for AUTOMATIC1111 Stable Diffusion WebUI
Other
3.11k stars 258 forks source link

when use animatediff, it show RuntimeError: CUDA error: device-side assert triggered #479

Closed lvsh2012 closed 7 months ago

lvsh2012 commented 8 months ago

Traceback (most recent call last): File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/gradio/routes.py", line 488, in run_predict output = await app.get_blocks().process_api( File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/gradio/blocks.py", line 1431, in process_api result = await self.call_function( File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/gradio/blocks.py", line 1103, in call_function prediction = await anyio.to_thread.run_sync( File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/anyio/to_thread.py", line 33, in run_sync return await get_asynclib().run_sync_in_worker_thread( File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 877, in run_sync_in_worker_thread return await future File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 807, in run result = context.run(func, args) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/gradio/utils.py", line 707, in wrapper response = f(args, *kwargs) File "/mnt/code/stable-diffusion-webui/modules/call_queue.py", line 95, in f mem_stats = {k: -(v//-(10241024)) for k, v in shared.mem_mon.stop().items()} File "/mnt/code/stable-diffusion-webui/modules/memmon.py", line 92, in stop return self.read() File "/mnt/code/stable-diffusion-webui/modules/memmon.py", line 77, in read free, total = self.cuda_mem_get_info() File "/mnt/code/stable-diffusion-webui/modules/memmon.py", line 34, in cuda_mem_get_info return torch.cuda.mem_get_info(index) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/torch/cuda/memory.py", line 656, in mem_get_info return torch.cuda.cudart().cudaMemGetInfo(device) RuntimeError: CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

diff

if I don't use animatediff, the webui is work well, but i use the animatediff, it show the error, and then the webui can't work

nitinmukesh commented 7 months ago

Something is seriously messed up. Try using DDIM as Sampling method.

lvsh2012 commented 7 months ago

Something is seriously messed up. Try using DDIM as Sampling method.

DDIM and DPM++, Euler is the same problem, unable to work.

continue-revolution commented 7 months ago

There is no way that I can reproduce your error. I always test with Euler A sampler.

continue-revolution commented 7 months ago

also this error log gives no information about which line cause this error, so it's impossible to debug anything.

nitinmukesh commented 7 months ago

@continue-revolution Give me some time, I will prepare the logs as I am also facing the same problem.

nitinmukesh commented 7 months ago

@lvsh2012 Can you update the extension and check again. Not sure how it start to work again. Continuing to test

lvsh2012 commented 7 months ago

also this error log gives no information about which line cause this error, so it's impossible to debug anything.

2024-03-23 13:54:32,554 - AnimateDiff - INFO - AnimateDiff process start. 2024-03-23 13:54:32,554 - AnimateDiff - INFO - Loading motion module mm_sd_v15.ckpt from /mnt/code/stable-diffusion-webui/extensions/sd-webui-animatediff/model/mm_sd_v15.ckpt 2024-03-23 13:54:32,966 - AnimateDiff - INFO - Guessed mm_sd_v15.ckpt architecture: MotionModuleType.AnimateDiffV1 2024-03-23 13:54:34,395 - AnimateDiff - INFO - Hacking SD1.5 GroupNorm32 forward function. 2024-03-23 13:54:34,395 - AnimateDiff - INFO - Injecting motion module mm_sd_v15.ckpt into SD1.5 UNet input blocks. 2024-03-23 13:54:34,395 - AnimateDiff - INFO - Injecting motion module mm_sd_v15.ckpt into SD1.5 UNet output blocks. 2024-03-23 13:54:34,395 - AnimateDiff - INFO - Setting DDIM alpha. 2024-03-23 13:54:34,397 - AnimateDiff - INFO - Injection finished. 2024-03-23 13:54:34,397 - AnimateDiff - INFO - AnimateDiff + ControlNet will generate 16 frames. 0%| | 0/20 [00:00<?, ?it/s]2024-03-23 13:54:34,487 - AnimateDiff - INFO - inner model forward hooked /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [96,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [97,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [98,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [99,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [100,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [101,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [102,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [103,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [104,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [105,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [106,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [107,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [108,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [109,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [110,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [111,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [112,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [113,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [114,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [115,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [116,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [117,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [118,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [119,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [120,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [121,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [122,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [123,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [124,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [125,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [126,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [608,0,0], thread: [127,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [96,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [97,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [98,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [99,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [100,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [101,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [102,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [103,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [104,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [105,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [106,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [107,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [108,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [109,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [110,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [111,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [112,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [113,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [114,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [115,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [116,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [117,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [118,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [119,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [120,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [121,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [122,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [123,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [124,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [125,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [126,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. /opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [565,0,0], thread: [127,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed. 0%| | 0/20 [00:00<?, ?it/s] Error completing request Arguments: ('task(krzjf2ke5rxt5df)', <gradio.routes.Request object at 0x7f6966334fd0>, 'a boy,smile,', '(low quality:2),(normal quality:2),lowres,normal quality,((monochrome)),((grayscale)),skin spots,acnes,skin blemishes,age spot,(ugly:1.33),(duplicate:1.33),(morbid:1.21),(mutilated:1.21),(tranny:1.33),mutated hands,(poorly drawn hands:1.5),blurry,(bad anatomy:1.21),(bad proportions:1.33),extra limbs,(disfigured:1.33),(missing arms:1.33),(extra legs:1.33),(fused fingers:1.61),(too many fingers:1.61),(unclear eyes:1.33),lowers,bad hands,missing fingers,extra digit,bad hands,missing fingers,(((extra arms and legs))),DeepNegativeV1.x_V175T,EasyNegative,EasyNegativeV2,', [], 20, 'Euler a', 1, 1, 7, 512, 512, False, 0.7, 2, 'Latent', 0, 0, 0, 'Use same checkpoint', 'Use same sampler', '', '', [], 0, False, '', 0.8, 2654972415, False, -1, 0, 0, 0, False, False, {'ad_model': 'face_yolov8n.pt', 'ad_model_classes': '', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_k_largest': 0, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 4, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 4, 'ad_denoising_strength': 0.4, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': False, 'ad_inpaint_width': 512, 'ad_inpaint_height': 512, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_checkpoint': False, 'ad_checkpoint': 'Use same checkpoint', 'ad_use_vae': False, 'ad_vae': 'Use same VAE', 'ad_use_sampler': False, 'ad_sampler': 'DPM++ 2M Karras', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_use_clip_skip': False, 'ad_clip_skip': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'None', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, {'ad_model': 'None', 'ad_model_classes': '', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_k_largest': 0, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 4, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 4, 'ad_denoising_strength': 0.4, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': False, 'ad_inpaint_width': 512, 'ad_inpaint_height': 512, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_checkpoint': False, 'ad_checkpoint': 'Use same checkpoint', 'ad_use_vae': False, 'ad_vae': 'Use same VAE', 'ad_use_sampler': False, 'ad_sampler': 'DPM++ 2M Karras', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_use_clip_skip': False, 'ad_clip_skip': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'None', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, True, False, <scripts.easyphoto_utils.animatediff_utils.AnimateDiffProcess object at 0x7f6975d64ee0>, <scripts.animatediff_ui.AnimateDiffProcess object at 0x7f6966334910>, UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None), False, False, 'positive', 'comma', 0, False, False, 'start', '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, False, False, False, 0, False, None, None, False, None, None, False, None, None, False, None, None, False, 50) {} Traceback (most recent call last): File "/mnt/code/stable-diffusion-webui/modules/call_queue.py", line 57, in f res = list(func(*args, kwargs)) File "/mnt/code/stable-diffusion-webui/modules/call_queue.py", line 36, in f res = func(*args, *kwargs) File "/mnt/code/stable-diffusion-webui/modules/txt2img.py", line 110, in txt2img processed = processing.process_images(p) File "/mnt/code/stable-diffusion-webui/modules/processing.py", line 785, in process_images res = process_images_inner(p) File "/mnt/code/stable-diffusion-webui/extensions/sd-webui-controlnet/scripts/batch_hijack.py", line 48, in processing_process_images_hijack return getattr(processing, '__controlnet_original_process_images_inner')(p, args, kwargs) File "/mnt/code/stable-diffusion-webui/modules/processing.py", line 921, in process_images_inner samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts) File "/mnt/code/stable-diffusion-webui/modules/processing.py", line 1257, in sample samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x)) File "/mnt/code/stable-diffusion-webui/modules/sd_samplers_kdiffusion.py", line 234, in sample samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, extra_params_kwargs)) File "/mnt/code/stable-diffusion-webui/modules/sd_samplers_common.py", line 261, in launch_sampling return func() File "/mnt/code/stable-diffusion-webui/modules/sd_samplers_kdiffusion.py", line 234, in samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, extra_params_kwargs)) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, kwargs) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/k_diffusion/sampling.py", line 145, in sample_euler_ancestral denoised = model(x, sigmas[i] * s_in, *extra_args) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl return self._call_impl(args, kwargs) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl return forward_call(*args, kwargs) File "/mnt/code/stable-diffusion-webui/modules/sd_samplers_cfg_denoiser.py", line 256, in forward x_out[a:b] = self.inner_model(x_in[a:b], sigma_in[a:b], cond=make_condition_dict(c_crossattn, image_cond_in[a:b])) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl return self._call_impl(*args, *kwargs) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl return forward_call(args, kwargs) File "/mnt/code/stable-diffusion-webui/extensions/sd-webui-animatediff/scripts/animatediff_infv2v.py", line 164, in mm_sd_forward x_in[_context], sigma_in[_context], RuntimeError: CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.


Traceback (most recent call last): File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/gradio/routes.py", line 488, in run_predict output = await app.get_blocks().process_api( File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/gradio/blocks.py", line 1431, in process_api result = await self.call_function( File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/gradio/blocks.py", line 1103, in call_function prediction = await anyio.to_thread.run_sync( File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/anyio/to_thread.py", line 33, in run_sync return await get_asynclib().run_sync_in_worker_thread( File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 877, in run_sync_in_worker_thread return await future File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 807, in run result = context.run(func, args) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/gradio/utils.py", line 707, in wrapper response = f(args, *kwargs) File "/mnt/code/stable-diffusion-webui/modules/call_queue.py", line 95, in f mem_stats = {k: -(v//-(10241024)) for k, v in shared.mem_mon.stop().items()} File "/mnt/code/stable-diffusion-webui/modules/memmon.py", line 92, in stop return self.read() File "/mnt/code/stable-diffusion-webui/modules/memmon.py", line 77, in read free, total = self.cuda_mem_get_info() File "/mnt/code/stable-diffusion-webui/modules/memmon.py", line 34, in cuda_mem_get_info return torch.cuda.mem_get_info(index) File "/mnt/conda/envs/sd_webui/lib/python3.10/site-packages/torch/cuda/memory.py", line 656, in mem_get_info return torch.cuda.cudart().cudaMemGetInfo(device) RuntimeError: CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

@continue-revolution

66ssoo88 commented 7 months ago

OH,NO!!!!! 2024-03-23 13:24:37,712 - AnimateDiff - INFO - inner model forward hooked C:\actions-runner_work\pytorch\pytorch\builder\windows\pytorch\aten\src\ATen\native\cuda\IndexKernel.cu:92: block: 【975,0,0】, thread: 【64,0,0】 Assertion index >= -sizes【i】 && index < sizes【i】 && "index out of bounds" failed.

lvsh2012 commented 7 months ago

OH,NO!!!!! 2024-03-23 13:24:37,712 - AnimateDiff - INFO - inner model forward hooked C:\actions-runner_work\pytorch\pytorch\builder\windows\pytorch\aten\src\ATen\native\cuda\IndexKernel.cu:92: block: 【975,0,0】, thread: 【64,0,0】 Assertion index >= -sizes【i】 && index < sizes【i】 && "index out of bounds" failed.

How to solve it?

continue-revolution commented 7 months ago

This is common issue if you are using after detailer. If so, either disable adetailer, or update AnimateDiff to the latest version.

continue-revolution commented 7 months ago

It is possible that your update attempt will be rejected by git if you modify whatever code internally. If that’s the case, reinstall this extension.

continue-revolution commented 7 months ago

https://github.com/continue-revolution/sd-webui-animatediff/issues/470#issuecomment-2016885741

spekcool commented 7 months ago

Disabling the "sd-webui-prompt-all-in-one extension" and shortening the request prompt helped for me.

linghu-cell commented 5 months ago

这个错误是由于提示词超过了75个词,我这边只要提示词超过75个就会出现这个错误,请问有解决办法吗?