search

dbmdz / berts

DBMDZ BERT, DistilBERT, ELECTRA, GPT-2 and ConvBERT models
MIT License
155 stars 12 forks source link

Tensorflow checkpoint for Italian BERT #15

Closed federicoruggeri closed 3 years ago

federicoruggeri commented 4 years ago

Hello there, First of all, thank you very much for your awesome work! Such repositories are of great help. I was wondering if it is possible to have access to tensorflow checkpoints for the italian pre-trained version of BERT (or if there's already some available). I'm currently looking for a good pre-trained italian model for research.

Thanks in advance! Best, Federico

stefan-it commented 4 years ago

Hi @federicoruggeri ,

no problem, you can download the checkpoints here:

$ wget https://schweter.eu/cloud/berts/bert-base-italian-xxl-cased.tar.gz
$ wget https://schweter.eu/cloud/berts/bert-base-italian-xxl-uncased.tar.gz

Btw: I'm planing to release an ELECTRA model very soon for Italian (actually it is fully trained, it just needs some proper evaluation) :)

stefan-it commented 3 years ago

Model checkpoints are availabe (see link below), and also released the mentioned ELECTRA models, see this repository for more information!

So I'm closing the issue for now :)