[FeatureRequest] New preprocessor Depth and Normal Metric3D

[sdbds]

https://github.com/YvanYin/Metric3D

[wibur0620]

https://github.com/TheMistoAI/ComfyUI-Anyline

[wibur0620]

https://github.com/TheMistoAI/ComfyUI-Anyline

https://github.com/TheMistoAI/MistoLine

[Fannovel16]

@sdbds

[Fannovel16]

@wibur0620

[Fannovel16]

RepeatImageBatch is unneccessary. It's there for testing multiple batches

[wibur0620]

https://github.com/Fannovel16/comfyui_controlnet_aux/assets/131615326/42df065a-094f-4699-a79c-3cb2dd22a358

RepeatImageBatch is unneccessary. It's there for testing multiple batches

This is strange. This node is indeed confirmed to be yours, but the way it opens feels very strange to me. I did not uninstall the ComfyUI-Anyline plugin before updating your plugin. I wonder if this is the reason for the issue?

[wibur0620]

[Fannovel16]

@wibur0620 Ah I forgot to change the category

[Fannovel16]

Fixed https://github.com/Fannovel16/comfyui_controlnet_aux/commit/0c00bb6c4ceff64dd806d82d37b390914f214daf

[wibur0620]

[wibur0620]

[wibur0620]

Is the metric_depth_vit_giant2_800k.pth model necessary? I noticed that this model is very large, and it was not used in the official demo of Metric3D.

[wibur0620]

[wibur0620]

model_path is D:\AI\ComfyUI\custom_nodes\comfyui_controlnet_aux\ckpts\JUGGHM/Metric3D\metric_depth_vit_small_800k.pth using MLP layer as FFN Loading weight 'D:\AI\ComfyUI\custom_nodes\comfyui_controlnet_aux\ckpts\JUGGHM/Metric3D\metric_depth_vit_small_800k.pth' Successfully loaded weight: 'D:\AI\ComfyUI\custom_nodes\comfyui_controlnet_aux\ckpts\JUGGHM/Metric3D\metric_depth_vit_small_800k.pth' model_path is D:\AI\ComfyUI\custom_nodes\comfyui_controlnet_aux\ckpts\JUGGHM/Metric3D\metric_depth_vit_small_800k.pth using MLP layer as FFN Loading weight 'D:\AI\ComfyUI\custom_nodes\comfyui_controlnet_aux\ckpts\JUGGHM/Metric3D\metric_depth_vit_small_800k.pth' Successfully loaded weight: 'D:\AI\ComfyUI\custom_nodes\comfyui_controlnet_aux\ckpts\JUGGHM/Metric3D\metric_depth_vit_small_800k.pth' Prompt executed in 3.16 seconds

[Fannovel16]

@wibur0620 Giant2 is added for versatility. I agree that the difference between small and large is already marginal tho. Gonna make the small one as the default

[Fannovel16]

Guess that there is no more problem

https://github.com/Fannovel16/comfyui_controlnet_aux/commit/ab0705c9e3ae50e3cd58f339578013241acf4659

[wibur0620]

This issue seems to remain unresolved; there is a bug in the deep preprocessing.

[Fannovel16]

@wibur0620 Wdym?

[wibur0620]

@wibur0620 Wdym?

After processing through this node, the resulting image is completely white and lacks any depth information, regardless of which model I choose.

[Fannovel16]

@wibur0620 Wdym?

After processing through this node, the resulting image is completely white and lacks any depth information, regardless of which model I choose.

What about normal?

[sdbds]

@wibur0620 Wdym?

After processing through this node, the resulting image is completely white and lacks any depth information, regardless of which model I choose.

same problem.

[Fannovel16]

@sdbds @wibur0620

[sdbds]

@sdbds @wibur0620

it works now

[rethink-studios]

Just downloaded and tried to use the Metric3D-DepthMapPreprocessor and got this error. I created the folders needed, downloaded the file, and I still get the error

[rethink-studios]

I got the same error (10:45 CST)

[rethink-studios]

link changed?? Here's the working link: https://huggingface.co/JUGGHM/Metric3D/resolve/main/metric_depth_vit_giant2_800k.pth?download=true

[kagevazquez]

Error occurred when executing Metric3D-NormalMapPreprocessor:

Failed to find function: controlnet_aux.metric3d.mono.model.backbones.vit_giant2_reg