search

sail-sg / EditAnything

Edit anything in images powered by segment-anything, ControlNet, StableDiffusion, etc. (ACM MM)
Apache License 2.0
3.23k stars 179 forks source link

Reference mode for the cross-image drag and merge functionality #48

Closed koutilya-pnvr closed 11 months ago

koutilya-pnvr commented 11 months ago

Thanks for the excellent work.

It looks like you use the reference mode recently released by ControlNet to achieve the cross-image drag and merge feature. Can you point to any resource/material on how this reference mode works in ControlNet? Also, can you point to the code in your repo that does this functionality?

Thanks for your time and help.

gasvn commented 11 months ago

Thanks for your interest. This cross-image drag and merge is based on the standard reference mode but has some differences in order to achieve the function. We will provide a tech report for this function soon, and we are testing a stronger version. The code for current version is on https://github.com/sail-sg/EditAnything/blob/572298811b13d90569fb39bbf48e624168e9a005/utils/stable_diffusion_controlnet_inpaint.py#L391

koutilya-pnvr commented 11 months ago

Thanks for the amazing work.