dccuchile / beto

BETO - Spanish version of the BERT model
Creative Commons Attribution 4.0 International
492 stars 63 forks source link

Code for running benchmark #6

Closed manueltonneau closed 4 years ago

manueltonneau commented 4 years ago

Muchisimas gracias para la contribución :)

I am currently pre-training BERT for another language and am hoping to benchmark my model against mBERT just like you did on tasks such as POS in other languages than English. Do you have any resources you could share (code, repos, etc..) and that I could use to do this benchmark?

gchaperon commented 4 years ago

Hi! Thanks for your interest :)

Sure! I was responsible for finetuning for the conll2002 task and the MLDoc dataset. My scripts can be found here. This is very much a WIP so my code is quite messy.

Also, I based my scripts of off the amazing work from :hugs: , so my scripts are similar to their examples.

manueltonneau commented 4 years ago

Thanks a lot for your reply :)