search

stefan-it / turkish-bert

Turkish BERT/DistilBERT, ELECTRA and ConvBERT models
482 stars 42 forks source link

Electra Model #14

Closed cbalkig closed 4 years ago

cbalkig commented 4 years ago

Stefan, where can I download the ELECTRA model? Again I need TF checkpoints, I'll fine-tune for MRQA. Thanx a lot!

stefan-it commented 4 years ago

Hi @balki7 ,

the ELECTRA models can be downloaded from the Hugging Face model hub:

TF checkpoints can be downloaded from here:

wget https://schweter.eu/storage/electra-small-turkish-cased/electra-small-turkish-cased-tf.tar.gz
wget https://schweter.eu/storage/electra-base-turkish-cased/electra-base-turkish-cased-tf.tar.gz

Vocab is not included in the archives, but it's the same as for BERTurk, so you can download it from here.

I'm not sure what implementation you're using together with the TF checkpoints, so I can't recommend a config.json (but I think it should be the discriminator configuration, unless you want to play around with the generator model for masking stuff).

cbalkig commented 4 years ago

Thanx Stefan.