cubiq / Diffusers_IPAdapter

implementation of the IPAdapter models for HF Diffusers
MIT License
166 stars 7 forks source link

question on negative ip adapter #9

Open Clement-Lelievre opened 1 month ago

Clement-Lelievre commented 1 month ago

Hi @cubiq,

thanks for your work.

Are you planning to support flux models? I'm particularly interested in the "negative IP adapter" feature.

Best,

Clem

cubiq commented 1 month ago

This was released before diffusers actually integrated most of the features into the main repository. I would say this is mostly deprecated now and sending a PR to diffusers seem like a drop in the ocean.

I still believe that the official repository only leverages 50% of the actual potential of the model, but I'm working on a new project that will hopefully help me interface with diffusers in a faster and easier way.

Regarding the negative embeds for flux, I have to check. AFAIK they don't use negating embeddings so it might work with noise but I don't think it would work that well with actual images. Has to be tested