search

awslabs / mlm-scoring

Python library & examples for Masked Language Model Scoring (ACL 2020)
https://www.aclweb.org/anthology/2020.acl-main.240/
Apache License 2.0
335 stars 59 forks source link

Can't load tokenizer for 'xlm-roberta-large' #21

Open ksoky opened 2 years ago

ksoky commented 2 years ago

Dear authors,

I have tried to change the pre-trained model to 'xlm-roberta-large', but I got this OSerror message:

Can't load tokenizer for 'xlm-roberta-large'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'xlm-roberta-large' is the correct path to a directory containing all relevant files for a XLMTokenizer tokenizer.

Could you guide me how to solve this problem?

Zhangshiyu07 commented 8 months ago

Dear authors,

I have tried to change the pre-trained model to 'xlm-roberta-large', but I got this OSerror message:

Can't load tokenizer for 'xlm-roberta-large'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'xlm-roberta-large' is the correct path to a directory containing all relevant files for a XLMTokenizer tokenizer.

Could you guide me how to solve this problem?

sry to disturb, i run into the same problem and want to know if you have resolve this yet?