search

xverse-ai / XVERSE-13B

XVERSE-13B: A multilingual large language model developed by XVERSE Technology Inc.
Apache License 2.0
649 stars 58 forks source link

分词器的词表也是开源的吗 #2

Closed wwfcnu closed 1 year ago

wwfcnu commented 1 year ago

如题

underspirit commented 1 year ago

词表是开源的, 在huggingface上: https://huggingface.co/xverse/XVERSE-13B/blob/main/tokenizer.json