search

ThilinaRajapakse / pytorch-transformers-classification

Based on the Pytorch-Transformers library by HuggingFace. To be used as a starting point for employing Transformer models in text classification tasks. Contains code to easily train BERT, XLNet, RoBERTa, and XLM models for text classification.
Apache License 2.0
306 stars 97 forks source link

Available languages #16

Closed Magpi007 closed 5 years ago

Magpi007 commented 5 years ago

Hi,

Is there a place where we can check the pre-trained languages available for the transformer models (XLNet, RoBERTa, and XLM) up-to-date?

Thanks

ThilinaRajapakse commented 5 years ago

Yes, they are available in the Hugging Face docs. I can post a link later if you need.

Magpi007 commented 5 years ago

Can be these ones?

Magpi007 commented 5 years ago

I was trying to find the languages for roBERTa, as I supposed all the BERT ones would be supported, but I am not sure about this assumption...

ThilinaRajapakse commented 5 years ago

I don't think Roberta has multilingual support as of yet. At least, I haven't been able to find anything of the sort.

Magpi007 commented 5 years ago

Ok, let's see if any of these models cover more languages in the near future...