Training & Inference examples for RetNet

microsoft / torchscale

Foundation Architecture for (M)LLMs

https://aka.ms/GeneralAI

MIT License

3k stars 201 forks source link

Closed jhl-Det closed 1 year ago

jhl-Det commented 1 year ago

Could you provide some Training & Inference examples for RetNet?

donglixp commented 1 year ago

I found one blog (in Japanese) that might be useful https://zenn.dev/selllous/articles/retnet_tutorial.