search

exx8 / differential-diffusion

336 stars 17 forks source link

ip adapter and controlnet pipelines #19

Open loboere opened 3 months ago

loboere commented 3 months ago

This has a lot of potential if used together with ip adapter and controlnet However, the current pipeline is very old and does not support the new features. can you please update and add pipelines for ip adapter and controlnet

CesarERamosMedina commented 3 months ago

With the way the latents are calculated in diff diff, I am unsure whether this would work out of the box for controlnet and ip adapter pipelines. My early experiments just output noise, even after a large number of steps.

exx8 commented 3 months ago

Hi, Sorry for the delay and thanks for your interest in diff diff. I actually tested now the paper with ControlNet and it works! I haven't decided what is my support plan for this repo yet. As fields progress rapidly, I believe we need a lasting solution, especially considering that more papers expected to work with diff diff are expected to be released. I will try to speak with https://github.com/huggingface/diffusers 's maintainers.