search

huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
26.34k stars 5.43k forks source link

Train IP Adapter #7194

Open AMohamedAakhil opened 8 months ago

AMohamedAakhil commented 8 months ago

There isn't an example of how to train or finetune your own IP Adapter model currently. It would be helpful to have an implementation of the how to train/finetune the IP Adapter face id, sdxl and plus versions

I'd like to work on this issue

rootonchair commented 8 months ago

It seems like the code to train IP-Adapter is provided in the original repo: https://github.com/tencent-ailab/IP-Adapter

AMohamedAakhil commented 8 months ago

Yes, I just wanted to implement this within diffusers, and update the docs. I was initially confused on how to exactly go about it, would be helpful to have an example in the docs. Can I work on this?

sapkun commented 8 months ago

Yes, I just wanted to implement this within diffusers, and update the docs. I was initially confused on how to exactly go about it, would be helpful to have an example in the docs. Can I work on this?

Hello! Have you completed integrating the IP adapter training script into the project?

AMohamedAakhil commented 8 months ago

still working on it! https://github.com/huggingface/diffusers/pull/7196

github-actions[bot] commented 7 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] commented 7 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.