search

huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
26.11k stars 5.38k forks source link

Implement using RetNet instead of transformers #4209

Closed tronizx closed 1 year ago

tronizx commented 1 year ago

New RetNet is introduced i think it should be implemented in diffusers . I think you already knew about it but it may be helpful for faster inference.

Screenshot 2023-07-22 193832

sayakpaul commented 1 year ago

RetNet: https://arxiv.org/abs/2307.08621

Do we have pre-trained weights available for RetNets that could go with any of our existing pipelines? I guess once that's the case, we can revisit this.

tronizx commented 1 year ago

I don't think right now we have! but let see if any pretrained model will come from Micrsoft in future.

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.