Cannot find added_tokens.josn, special_tokens_map.json, tokenizer_config.json...

nlpyang / PreSumm

code for EMNLP 2019 paper Text Summarization with Pretrained Encoders

MIT License

1.28k stars 464 forks source link

Cannot find added_tokens.josn, special_tokens_map.json, tokenizer_config.json... #138

Open CN-COTER opened 4 years ago

CN-COTER commented 4 years ago

Hi sir whether i train or validate the model, it always say
Didn't find file ../added_tokens.json.We won't load it. Didn't find file ../special_tokens_map.json.We won't load it. Didn't find file ../tokenizer_config.json.We won't load it. it seems that loading preprocessed datasets encounter problems. How can i deal with it ?

yunbujian commented 2 years ago

got the same bug

neu-yu commented 7 months ago

This problem Didn't find file ../added_tokens.json.We won't load it. Has it been solved?