search

chujiezheng / CoMAE

Codes and data for the ACL 2021-Findings paper: CoMAE: A Multi-factor Hierarchical Framework for Empathetic Response Generation
39 stars 6 forks source link

couldn't find or generate added_tokens.json #11

Closed joy8joy8 closed 2 years ago

joy8joy8 commented 2 years ago

HELLO , it's me again. I retry your codes, and encountered these problems, could you take a look and maybe you can provide added_tokens.json, special_tokens_map.json and tokenizer_config.json. thanks

06/13/2022 17:21:09 - INFO - tokenization.tokenization_utils_base - Didn't find file ./GPT2-small/added_tokens.json. We won't load it.

06/13/2822 17:21:09 - INFO - tokenization.tokenization_utils_base - Didn't find file ./GPT2-small/special_tokens_map.json. We won't load it.

06/13/2022 17:21:09 - INFO - tokenization.tokenization_utils_base - Didn't find file ./GPT2-small/tokenizer_config.json. We won't load it.

06/13/2022 17:21:09 - INFO - utils.building_utils - pad_token_id in toker is inconsistent with model

06/13/2022 17:21:09 - INFO - utils.building_utils - sep_token_id in toker is inconsistent with model 8c16bf93422418df812bf2768539d3e

chujiezheng commented 2 years ago

GPT-2 does not require these files. I think you can ignore these warnings.