search

epfLLM / Megatron-LLM

distributed trainer for LLMs
Other
504 stars 73 forks source link

Introduce Sailor Models #105

Closed longxudou closed 2 months ago

longxudou commented 2 months ago

Hello! We have used Megatron-LLM in our Sailor project.

It is a suite of Open Language Models tailored for South-East Asia (SEA), focusing on languages such as 🇮🇩Indonesian, 🇹🇭Thai, 🇻🇳Vietnamese, 🇲🇾Malay, and 🇱🇦Lao.

Please see Sailor homepage for more details. We also reference Megatron-LLM in Section 5.1 of the Sailor Report.

Thanks for for building the excellent codebase and presenting the detailed document!

martinjaggi commented 2 months ago

many thank for letting us know. i added a link in our readme. keep us posted!