Finding pre-trained Thai LLM on Huggingfaces

[huak95]

We want to identify pre-trained Thai LLMs available on Hugging Face to use in our benchmarking evaluation.

• Searching for Thai LLMs on the Hugging Face model hub, filtering by Thai language.
• Checking for any licensing or usage restrictions for each pre-trained model to ensure that we can use them in our evaluation.

Possible Candidates:

• GPT3, GPT3.5, GPT4
• PaLM, Flan-PaLM
• OPT, LLaMA
• T5, Flan-T5
• Switch Transformers
• Chinchilla, Gopher
• GPTJ, GPTNEO-X

Multilingual models:

• Bloom, Bloomz, MT-0
• XGLM
• GLM (General Language Model, Chinese-English)

[arnajak]

volunteer kub

[huak95]

Criteria

✅ = Worked can use. 👻 = Know Thai Token, but can't use. ❌ = Don't know thai. (Unrelate response, answer as same as input)

List of tried model

• GPT4 ✅ (Bing)

• GPT3.5-Turbo ✅ (ChatGPT)

• vicuna-13b test 👻

• koala-13b test ❌

• alpaca-13b test ❌

• chatglm-6b test ❌

• llama-13b test ❌

• Flan-ul2 test ❌

• mGPT test 👻

To do list

• GPT-J
• Bloom
• Bloomz
• MT-0
• XGLM