search

openmedlab / PULSE

PULSE: Pretrained and Unified Language Service Engine
Apache License 2.0
467 stars 15 forks source link

tokenizer是否是BloomTokenizerFast #5

Open MelodyChenjun opened 1 year ago

MelodyChenjun commented 1 year ago

在加载tokenizer的时候，报错autotokenizer没有BloomTokenizer，是否需要在tokenizer_config.json中修改成BloomTokenizerFast

genggui001 commented 10 months ago

NB 感谢指正 已经更新