lllyasviel / ControlNet-v1-1-nightly

Nightly release of ControlNet 1.1
4.47k stars 364 forks source link

Error with ZoeDepth preprocessor #98

Open devingfx opened 11 months ago

devingfx commented 11 months ago

Hi! I have an error with ZoeDepth preprocessor, sadly there is not error shown in the webui terminal only the HTML Error splatch on preview image :/ All other depth preprocessors are working well...

How can I find more usefull error logs? Or anything that can help?

Thx for your work btw ! :)

devingfx commented 11 months ago

Ha! I have an error in terminal finally :)

Traceback (most recent call last):
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/gradio/routes.py", line 422, in run_predict
    output = await app.get_blocks().process_api(
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/gradio/blocks.py", line 1323, in process_api
    result = await self.call_function(
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/gradio/blocks.py", line 1051, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/anyio/to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/anyio/_backends/_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/anyio/_backends/_asyncio.py", line 807, in run
    result = context.run(func, *args)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/scripts/controlnet_ui/controlnet_ui_group.py", line 636, in run_annotator
    result, is_image = preprocessor(
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/scripts/utils.py", line 79, in decorated_func
    return cached_func(*args, **kwargs)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/scripts/utils.py", line 67, in cached_func
    return func(*args, **kwargs)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/scripts/global_state.py", line 35, in unified_preprocessor
    return preprocessor_modules[preprocessor_name](*args, **kwargs)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/scripts/processor.py", line 517, in zoe_depth
    result = model_zoe_depth(img)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/zoe/__init__.py", line 47, in __call__
    depth = self.model.infer(image_depth)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/zoe/zoedepth/models/depth_model.py", line 126, in infer
    return self.infer_with_flip_aug(x, pad_input=pad_input, **kwargs)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/zoe/zoedepth/models/depth_model.py", line 110, in infer_with_flip_aug
    out = self._infer_with_pad_aug(x, pad_input=pad_input, **kwargs)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/zoe/zoedepth/models/depth_model.py", line 88, in _infer_with_pad_aug
    out = self._infer(x)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/zoe/zoedepth/models/depth_model.py", line 55, in _infer
    return self(x)['metric_depth']
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1502, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1511, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/zoe/zoedepth/models/zoedepth/zoedepth_v1.py", line 144, in forward
    rel_depth, out = self.core(x, denorm=denorm, return_rel_depth=True)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1502, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1511, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/zoe/zoedepth/models/base_models/midas.py", line 263, in forward
    x = self.prep(x)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/zoe/zoedepth/models/base_models/midas.py", line 187, in __call__
    return self.normalization(self.resizer(x))
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/zoe/zoedepth/models/base_models/midas.py", line 174, in __call__
    return nn.functional.interpolate(x, (height, width), mode='bilinear', align_corners=True)
  File "/home/dig/dev/AI/A1111/stable-diffusion-webui/venv/lib/python3.8/site-packages/torch/nn/functional.py", line 3928, in interpolate
    raise TypeError(
TypeError: expected size to be one of int or Tuple[int] or Tuple[int, int] or Tuple[int, int, int], but got size with types [<class 'numpy.int64'>, <class 'numpy.int64'>]

FYI my install is full CPU ...

joelYing commented 9 months ago

same error

geroldmeisinger commented 8 months ago

see here https://github.com/Fannovel16/comfyui_controlnet_aux/issues/2 and fix in https://github.com/Fannovel16/comfyui_controlnet_aux/pull/71/commits/7755961321784ed9d704e894abb6830afab128f5