<|reserved_special_token|>的作用？

OpenBMB / MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

Apache License 2.0

7.82k stars 543 forks source link

Open ZHANGTIANYAO1 opened 1 week ago

ZHANGTIANYAO1 commented 1 week ago

tokenizer.json中的<|reserved_special_token_xx|>有什么特殊的作用吗？还是只是占位符？可以将其修改成自己想要添加的特殊token吗？