How to pass the mask for inpainting via diffusers library

lllyasviel / ControlNet-v1-1-nightly

Nightly release of ControlNet 1.1

4.48k stars 364 forks source link

How to pass the mask for inpainting via diffusers library #52

Closed darshats closed 1 year ago

darshats commented 1 year ago

Hi, The gradio script for inpainting controlnet set -1 for the masked areas.

How can we do this via diffusers library that takes a PIL image? I tried creating the PIL image of float32 type, but it does not work for RGB or RGBA images.

lllyasviel commented 1 year ago

perfect inpaint masking and processing is a1111-only. see also https://github.com/lllyasviel/ControlNet-v1-1-nightly