Closed wuguokai closed 3 years ago
Hi @wuguokai,
As you've probably noticed, we host few languages models and tokenizers models at this URL. Supported languages are the following ones:
Unfortunatly, we don't currently support chinese language models, but there is a workaround.
As stated in these 2 forums threads:
chinese-support turkish-nlp-about
you can download desired language models here and bpe models here.
I strongly suggest using the biggest available models (300 dimension and 200000 vocab size) for performance reasons.
Let me know if you have any other question,
François
Hi again,
based on this forum thread I assume you found a solution to your problem.
For this reason, I'll close this issue, but feel free to reopen if needed.
François
@franklevasseur Yes! Thanks a lot!
Hi! How to generate the language .bpe.model and .bin file, such as Chinese.Thanks!![image](https://user-images.githubusercontent.com/30334643/121620035-34887880-ca9c-11eb-9d3f-ea0c40f227df.png)