search

TencentARC / BrushNet

[ECCV 2024] The official implementation of paper "BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion"
https://tencentarc.github.io/BrushNet/
Other
1.45k stars 121 forks source link

Can StableDiffusionBrushNetPipeline be connected to the openpose ControlNet like the StableDiffusionControlNetPipeline? #48

Open woshiodoman opened 5 months ago

woshiodoman commented 5 months ago

Can StableDiffusionBrushNetPipeline be connected to the openpose ControlNet like the StableDiffusionControlNetPipeline? Cause I want to maintain the original image's pose while using BrushNet.

MasaiahHan commented 3 months ago

Hi, I have already implement brushnet with comtrolnet pipeline, just need to modify either brushnetpipline or controller pipeline!

woshiodoman commented 3 months ago

Hi, I have already implement brushnet with comtrolnet pipeline, just need to modify either brushnetpipline or controller pipeline!

Thank you very much for your reply. May I ask which part of the StableDiffusionBrushNetPipeline code you have modified?

MasaiahHan commented 3 months ago

Hi, I have already implement brushnet with comtrolnet pipeline, just need to modify either brushnetpipline or controller pipeline!

Thank you very much for your reply. May I ask which part of the StableDiffusionBrushNetPipeline code you have modified?

Actually StableDiffusionBrushNetPipeline is writing based on StableDiffusionControlNetPipeline, so you just need to add additional controlnet imag condition, processor, controlnet(forward) according to the StableDiffusionControlNetPipeline source code.

xduzhangjiayu commented 3 months ago

Hi, I have already implement brushnet with comtrolnet pipeline, just need to modify either brushnetpipline or controller pipeline!

Thank you very much for your reply. May I ask which part of the StableDiffusionBrushNetPipeline code you have modified?

Actually StableDiffusionBrushNetPipeline is writing based on StableDiffusionControlNetPipeline, so you just need to add additional controlnet imag condition, processor, controlnet(forward) according to the StableDiffusionControlNetPipeline source code.

Hi, After you combining SD + BrushNet + ControlNet, i am curious that the performance is still good? Have you tried it? Appreciate for the reply!

TianyangHan commented 3 months ago

us that the performance is still good? Have

The performance is great as long as you implement it properly.

xduzhangjiayu commented 3 months ago

us that the performance is still good? Have

The performance is great as long as you implement it properly.

Thanks! Is there the open source code for this (BrushNet + ControlNet) in github?

henbucuoshanghai commented 3 months ago

no