search

exx8 / differential-diffusion

336 stars 17 forks source link

how to use this with inpainting model? #16

Open crapthings opened 4 months ago

crapthings commented 4 months ago

is this working with1.5 inpainting or sdxl inpainting?

Laidawang commented 3 months ago

+1

exx8 commented 3 months ago

Hi sorry for the delay, Thanks for your interest in diff diff. Actually, I now experimented with a modified version of the inpaint pipeline of diffusers and it seems to work. On each step, inpaint models take 9 channel (including masked image and binary mask), which are changed according to the current threshold. It is worth noting that the inpaint models tend to make more conservative changes. I need to think what is the support plan of this repo.