search

hsc748NLP / SikuBERT-for-digital-humanities-and-classical-Chinese-information-processing

SikuBERT：四库全书的预训练语言模型（四库BERT） Pre-training Model of Siku Quanshu
Apache License 2.0
110 stars 15 forks source link

下载好模型之后如何做古汉语分词 #5

Open coloredglaze32 opened 9 months ago

coloredglaze32 commented 9 months ago

from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("SIKU-BERT/sikubert")

model = AutoModel.from_pretrained("SIKU-BERT/sikubert")

这样下载后的模型如何对古汉语分词，是调用api吗