search

Helsinki-NLP / Opus-MT

Open neural machine translation models and web services
MIT License
574 stars 71 forks source link

fill-mask ? #90

Closed flutter-painter closed 6 months ago

flutter-painter commented 9 months ago

Is it possible to pre-train this model using fill-mask ? Or to reuse pre-existing fill-mask such as https://huggingface.co/Davlan/afro-xlmr-large-61L ? The goal is to pretrain low resource language on monolingual dataset

jorgtied commented 6 months ago

Which model are you referring to? Is this the wrong forum?

flutter-painter commented 6 months ago

I was refering to any translation model under opus-MT. Your 2nd question is only rhetorical apparently.

jorgtied commented 6 months ago

Not at all, I really thought that this question could be posted to the wrong thread and that you refer to one specific model (as you said "this model"). In any case, I would not know how to use the opus-mt models in the way you suggest.