Electric model release?

google-research / electra

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Apache License 2.0

2.33k stars 352 forks source link

Electric model release? #142

Open donglixp opened 3 months ago

donglixp commented 3 months ago

Hi @clarkkev ,

To train Electric, use the same pre-training script and command as ELECTRA. Pass "electra_objective": false and "electric_objective": true to the hyperparameters. We plan to release pre-trained Electric models soon!

Is there still any plan to release pre-trained Electric models soon?