search

huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
https://huggingface.co/transformers
Apache License 2.0
134.27k stars 26.85k forks source link

XLM-R Support #2040

Closed josecannete closed 4 years ago

josecannete commented 4 years ago

❓ Questions & Help

Hello!

Is there a way to use XLM-R (https://github.com/pytorch/fairseq/blob/master/examples/xlmr/README.md) with the library of transformers? maybe via RoBERTa? can you provide some guidance on this please?

Thank you in advance

TheEdoardo93 commented 4 years ago

The latest news about using XLM-R model with Transformers are discussed in #1769 Briefly, at the moment it's not possible to use this model with Transformers directly.

Questions & Help

Hello!

Is there a way to use XLM-R (https://github.com/pytorch/fairseq/blob/master/examples/xlmr/README.md) with the library of transformers? maybe via RoBERTa? can you provide some guidance on this please?

Thank you in advance

josecannete commented 4 years ago

Thank you,

I'm closing this one and keep an eye in #1769