search

HarderThenHarder / transformers_tasks

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.
https://www.zhihu.com/column/c_1451236880973426688
2.11k stars 376 forks source link

大佬您好，请问在做词表扩充的这个环节，为什么在llama的词表基础上扩充，而不是选择ChatGLM2的分词器 #81

Open GromZhang opened 1 year ago

GromZhang commented 1 year ago

image 感谢您的解惑