Open Cgetier520990 opened 1 month ago
Traceback (most recent call last): File "run.py", line 28, in train_data, dev_data, test_data = build_dataset(config) File "D:\PYTHON_PROGRAMME\Bert-Chinese-Text-Classification\utils.py", line 36, in build_dataset train = load_dataset(config.train_path, config.pad_size) File "D:\PYTHON_PROGRAMME\Bert-Chinese-Text-Classification\utils.py", line 20, in load_dataset token = config.tokenizer.tokenize(content) AttributeError: 'NoneType' object has no attribute 'tokenize' 这个报错怎么解决?
我也出现这个错误,你解决了吗
没有诶,你现在解决了吗?
@wangling6666 @Cgetier520990 我刚刚拉完代码也有这个问题,从huggingface把vocab.txt下载后放到模型文件夹就行
Traceback (most recent call last): File "run.py", line 28, in
train_data, dev_data, test_data = build_dataset(config)
File "D:\PYTHON_PROGRAMME\Bert-Chinese-Text-Classification\utils.py", line 36, in build_dataset
train = load_dataset(config.train_path, config.pad_size)
File "D:\PYTHON_PROGRAMME\Bert-Chinese-Text-Classification\utils.py", line 20, in load_dataset
token = config.tokenizer.tokenize(content)
AttributeError: 'NoneType' object has no attribute 'tokenize'
这个报错怎么解决?