google-research / electra

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
Apache License 2.0
2.31k stars 351 forks source link

How to Change Embedding Size of the Model? #95

Open FeryET opened 3 years ago

FeryET commented 3 years ago

Hello.

In this file we have the option to change embedding_size but after setting it, it's get overwritten in line 115. I have tried to change the embedding size by hardcoding a value in line 116, but apparently it's not possible to set a smaller embedding size.(32 in my case) Is there any way to change the embedding size?