awslabs / mlm-scoring

Python library & examples for Masked Language Model Scoring (ACL 2020)
https://www.aclweb.org/anthology/2020.acl-main.240/
Apache License 2.0
335 stars 59 forks source link

Using mlm-scoring with other public PyTorch RoBERTa model #24

Closed dsorato closed 1 year ago

dsorato commented 1 year ago

Hello, This is probably a silly question, but I'm having a hard time adapting the mlm-scoring to use other public PyTorch RoBERTa models that are not on the list of supported models. Do you have any tutorials/materials on how to use self-trained/other public RoBERTa models with mlm-scoring? Any help would be much appreciated and I apologize in advance in case this information is in the repository and I missed it.

Kind regards, Danielly