Open rainbow979 opened 3 years ago
Because you're using an old version of the code but a new version of the transformers library, which removes this docsting in https://github.com/huggingface/transformers/commit/f5af87361718be29a1d3ddb2d8ef23f85b1c70c3 A solution is to roll back to an old version like v4.11 or update your code.
just change the variable name tokenizer_class to processor_class. That works for me.
PS: If you click the link @wydwww suggested, you can see it there.
Because you're using an old version of the code but a new version of the transformers library, which removes this docsting in https://github.com/huggingface/transformers/commit/f5af87361718be29a1d3ddb2d8ef23f85b1c70c3 A solution is to roll back to an old version like v4.11 or update your code.