Is `google/electra-small-generator` small or small++ ?

google-research / electra

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Apache License 2.0

2.31k stars 351 forks source link

Is `google/electra-small-generator` small or small++ ? #68

Closed richarddwang closed 4 years ago

richarddwang commented 4 years ago

Hi, I notice that the Electra small and Electra base in GLUE benchmark are Electra-small++ and Electra-base++ in table 8.

To correctly compare my reproduced results, I am wondering whether google/electra-small-discriminator and google/electra-base-discriminatoron Huggingface models hub are also Electra-small++ and Electra-base++ ?

clarkkev commented 4 years ago

They are also the ++ models.