search

baichuan-inc / Baichuan-13B

A 13B large language model developed by Baichuan Intelligent Technology
https://huggingface.co/baichuan-inc/Baichuan-13B-Chat
Apache License 2.0
2.98k stars 236 forks source link

词表里 \U0010fc06 和 <reserved_7> 这两类有什么妙用吗？ #162

Closed CanvaChen closed 1 year ago

CanvaChen commented 1 year ago

词表里有 \U0010fc06 和 ，平时不太会用上这两类，添加进去是基于什么考虑呢？