jncraton / languagemodels

Explore large language models in 512MB of RAM
https://jncraton.github.io/languagemodels/
MIT License
1.18k stars 78 forks source link

Is there any recommended Chinese models (from huggingface)? #8

Closed LeoWood closed 1 year ago

LeoWood commented 1 year ago

when i input Chinese, like: lm.do("你好") it returns ' ⁇ , ⁇ , ⁇ '

It seems that the current model does not support Chinese Is there any recommended Chinese models in huggingface?

jncraton commented 1 year ago

The models used here were trained and fine-tuned primarily in English, so other languages will not work well. I do not have plans to support multilingual models in this package at the moment, but there are some available on Hugging Face. Here's one example:

https://huggingface.co/bigscience/mt0-large

LeoWood commented 1 year ago

您的邮件已收到,我将尽快回复,谢谢。刘欢