search

AliOsm / simplerepresentations

Easy-to-use text representations extraction library based on the Transformers library.
Apache License 2.0
32 stars 4 forks source link

xlm-roberta? #2

Open KnutJaegersberg opened 4 years ago

KnutJaegersberg commented 4 years ago

Could you add xlm roberta? see https://huggingface.co/transformers/pretrained_models.html

AliOsm commented 4 years ago

Hello @KnutJaegersberg, I was trying to add CamemBERT and XLM-RoBERTa, but I faced the following issue:

TypeError: can't pickle SwigPyObject objects

So, I'm looking for a solution. Please, let me know if you have a solution for such issue.

KnutJaegersberg commented 4 years ago

a related error was recognized, and supposed to be solved with transformers 2.3 ...

https://github.com/flairNLP/flair/issues/840

https://github.com/huggingface/transformers/pull/2189

I guess the issue will be resolved in the transformers lib given a bit more time.

AliOsm commented 4 years ago

Thank @KnutJaegersberg for your support, I will look into this.