richarddwang / electra_pytorch

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
324 stars 41 forks source link

providing datasets #1

Closed amy-hyunji closed 4 years ago

amy-hyunji commented 4 years ago

Hi, thanks for the great codes!

I am trying to train electra from scratch using your codes here. Could you upload the datasets you used on training? (Drives, links, etc..) I just wanted to make sure that I get the same results before trying other experiments.

Thanks :)

richarddwang commented 4 years ago

Hi, all datasets I used here coming from huggingface/nlp, which you only need to execute the code and it will download and preprocess for you, few days needed I guess.

amy-hyunji commented 4 years ago

Thanks!