iPieter / RobBERT

A Dutch RoBERTa-based language model
https://pieter.ai/robbert/
MIT License
196 stars 29 forks source link

[Transformers] Now honors a model_type=roberta in config.json #4

Closed julien-c closed 4 years ago

julien-c commented 4 years ago

@iPieter I've taken the liberty of adding a model_type: "roberta" to both your models' config.json (hope it's ok!)

From https://github.com/huggingface/transformers/pull/2494 we've added support for this model_type

We'll release a new pypi version in the comings days, cc @lysandrejik

julien-c commented 4 years ago

Also: you'll find a discussion that might be of interest here: https://github.com/huggingface/transformers/issues/2520#issuecomment-579009439

TL;DR: please upload a README.md if you can, with training description, eval metrics, etc.

Loved your webpage at https://people.cs.kuleuven.be/~pieter.delobelle/robbert/ by the way :)

iPieter commented 4 years ago

Thank you for adding the model type! And we'll work on writing a readme for the huggingface repo soon.