search

nullquant / ComfyUI-BrushNet

ComfyUI BrushNet nodes
Apache License 2.0
571 stars 20 forks source link

Inconsistent Inpainting Results with `v_prediction` Models #118

Closed linanwx closed 2 months ago

linanwx commented 3 months ago

Hello,

Firstly, thank you for creating BrushNet; it's one of the most natural inpainting tools I've used. However, I've encountered an issue when using BrushNet with v_prediction models. The inpainted images often appear incorrect or blurry. Is this due to an incompatibility with v_prediction? Any guidance or solutions would be greatly appreciated.

Thank you!

nullquant commented 3 months ago

Thank you for the kind words, but I only adapted BrushNet for ComfyUI. You can reach authors of BrushNet here.

As for v_prediction models, yes, it is possible that they are incompatible. BrushNet was trained with base models (runwayml/stable-diffusion-v1-5 and stabilityai/stable-diffusion-xl-base-1.0). It is possible to train BrushNet with other models but it requires good hardware.