huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
25.66k stars 5.3k forks source link

Follow The Policy Objective of Diffusion-DPO #5947

Closed 1073521013 closed 10 months ago

1073521013 commented 11 months ago

Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...].

Describe the solution you'd like. A clear and concise description of what you want to happen.

Describe alternatives you've considered. A clear and concise description of any alternative solutions or features you've considered.

Additional context. Add any other context or screenshots about the feature request here.

sayakpaul commented 10 months ago

It will reside in huggingface/trl:

https://github.com/huggingface/trl

Cc: @lvwerra @kashif