search

yongzhuo / Pytorch-NLU

Pytorch-NLU，一个中文文本分类、序列标注工具包，支持中文长文本、短文本的多类、多标签分类任务，支持中文命名实体识别、词性标注、分词、抽取式文本摘要等序列标注任务。 Ptorch NLU, a Chinese text classification and sequence annotation toolkit, supports multi class and multi label classification tasks of Chinese long text and short text, and supports sequence annotation tasks such as Chinese named entity recognition, part of spee
https://blog.csdn.net/rensihui
Apache License 2.0
328 stars 52 forks source link

self.do_lower_case 和 self.vocab 没定义，执行报错？！ #5

Closed Wang-Zhenxing closed 2 years ago

Wang-Zhenxing commented 2 years ago

https://github.com/yongzhuo/Pytorch-NLU/blob/864fb9acc7751fc51abd3d05d24b5a9a7eab7110/pytorch_nlu/pytorch_textclassification/tcData.py#L169

https://github.com/yongzhuo/Pytorch-NLU/blob/864fb9acc7751fc51abd3d05d24b5a9a7eab7110/pytorch_nlu/pytorch_textclassification/tcData.py#L171

这两个类变量在哪定义的？跑代码时报错！

yongzhuo commented 2 years ago

感觉没道理呀，用的是哪个模型类型？继承transformers的Tokenizer的

Wang-Zhenxing commented 2 years ago

应该是我在Hugging Face下载是预训练模型（albert-base-v1）有问题。