Closed rootofmylife closed 3 years ago
@rootofmylife
I guess that maybe we need some default params to ignore these problems. Thanks!
This is indeed the cause of the crash.
If training with BERT, I recommend the config biaffine-dep-roberta-en
.
lr
and warm_up
in this file are 5e-5
and 0.1
, which are empirically better for fine-tuning.
Yeah, I see. Thanks
Hi,
I have used your new release code, but when I trained the model, there are some errors related to configurations.
To reproduce, I used this command line to train a model on Google Colab.
I also tried with this command line (
lr_rate
andwarmup
are included):But the errors about missing
lr_rate
andwarm_up
still occur.To solve above problems, I have to create a new
config.ini
file and include 2 above params and it works.I guess that maybe we need some default params to ignore these problems. Thanks!
Sorry, I don't have any screenshot or capture errors to this issue, because I have a model training now. But I will update it later.