requires dict.txt and sentencepiece.bpe.model

microsoft / torchscale

Foundation Architecture for (M)LLMs

https://aka.ms/GeneralAI

MIT License

3.01k stars 202 forks source link

requires dict.txt and sentencepiece.bpe.model #6

Closed lpyhdzx closed 1 year ago

lpyhdzx commented 1 year ago

Could you provide "dict.txt" and "sentencepiece.bpe.model" (i.e., files in doc ''Example: BERT Pretraining'') for further exploring pretraining BERT with deepnorm.

shumingma commented 1 year ago

Here you are:

dict.txt sentencepiece.bpe.model

Please note that they are English only.

robotzheng commented 1 year ago

can not download