Checkpoint for RetNet - Githubissues

microsoft / unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

https://aka.ms/GeneralAI

MIT License

19.57k stars 2.49k forks source link

Open macsz opened 6 months ago

macsz commented 6 months ago

Hi,

is there a pre-trained checkpoint available for RetNet? It is not mentioned in the README.

Thanks!

WuJuli commented 6 months ago

also want that

macsz commented 5 months ago

Any updates?