search

exx8 / differential-diffusion

398 stars 23 forks source link

how to use this with inpainting model? #16

Open crapthings opened 8 months ago

crapthings commented 8 months ago

is this working with1.5 inpainting or sdxl inpainting?

Laidawang commented 8 months ago

+1

exx8 commented 8 months ago

Hi sorry for the delay, Thanks for your interest in diff diff. Actually, I now experimented with a modified version of the inpaint pipeline of diffusers and it seems to work. On each step, inpaint models take 9 channel (including masked image and binary mask), which are changed according to the current threshold. It is worth noting that the inpaint models tend to make more conservative changes. I need to think what is the support plan of this repo.