search

dmlc / gluon-nlp

NLP made easy
https://nlp.gluon.ai/
Apache License 2.0
2.56k stars 538 forks source link

Pre-training scripts should allow resuming from checkpoints #1526

Open szha opened 3 years ago

szha commented 3 years ago

Description

Currently, the ELECTRA pre-training script can't resume from last checkpoint. It will be useful to enhance the script to resume from checkpoints.

nandinib1999 commented 3 years ago

Hi, is this issue open for contribution? If yes, I would like to work on it.

leezu commented 3 years ago

Hi @nandinib1999, contributions to GluonNLP are always welcome. Let us know if you have any questions.

nandinib1999 commented 3 years ago

Thanks a lot! I will try to set up the codebase tonight and will come back in case of any doubts.