search

XLabs-AI / x-flux

Apache License 2.0
1.63k stars 118 forks source link

Any plan about inpainting controlnet? #59

Open yinian-lw opened 3 months ago

yinian-lw commented 3 months ago

Inpainting is widely used. Do you have plans to train an inpainting controlnet?

Anghellia commented 3 months ago

Hi! Yes, we have plans to add inpainting

datong-new commented 3 months ago

Inpainting is widely used. Do you have plans to train an inpainting controlnet?

https://github.com/huggingface/diffusers/blob/2d9ccf39b53325d95036776df0a8acfc39352256/src/diffusers/pipelines/controlnet_sd3/pipeline_stable_diffusion_3_controlnet_inpainting.py

https://github.com/huggingface/diffusers/blob/2d9ccf39b53325d95036776df0a8acfc39352256/src/diffusers/pipelines/controlnet/pipeline_controlnet_inpaint.py

Like above methods, can we create a similar pipeline using current flux controlnet, or should we train a specific controlnet + inpainting model?

datong-new commented 2 months ago

https://github.com/yishaoai/flux-controlnet-inpaint/ support flux + controlnet + inpaint now.