Could you please provide a TINY or SMALL version of xlmr ?

facebookresearch / fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

MIT License

30.43k stars 6.4k forks source link

Could you please provide a TINY or SMALL version of xlmr ? #3846

Closed thesby closed 2 years ago

thesby commented 3 years ago

🚀 Feature Request

a TINY or SMALL version of xlmr

Motivation

Current xlmr models, base and large are too big to train. I want to use xlmr for image caption task with multi languages, and the captions are not very complicated. So I think a tiny or small version xlmr is good enough.

stale[bot] commented 2 years ago

This issue has been automatically marked as stale. If this issue is still affecting you, please leave any comment (for example, "bump"), and we'll keep it open. We are sorry that we haven't been able to prioritize it yet. If you have any new additional information, please include it with your comment!

stale[bot] commented 2 years ago

Closing this issue after a prolonged period of inactivity. If this issue is still present in the latest release, please create a new issue with up-to-date information. Thank you!