[Hyperparameter Inquiry] Can't Reproduce ACE05 Results

helloeve / mre-in-one-pass

Implementation for Extracting Multiple-Relations in One-Passwith Pre-Trained Transformers

Apache License 2.0

80 stars 20 forks source link

[Hyperparameter Inquiry] Can't Reproduce ACE05 Results #4

Closed zhijing-jin closed 4 years ago

zhijing-jin commented 4 years ago

Hi Haoyu,

Nice work on this MRE one-pass! I noticed that the commands in README.md are for SemEval 2018. Do you know what are the commands that you run ACE05 with? (We are especially curious about the hyperparameters.)

Thank you in advance for your information!

Best, Zhijing

helloeve commented 4 years ago

The ACE dataset is using the same set of hyper parameter as SemEval except for the number of epochs is 15 instead. However, due to the nature of the randomness of BERT finetuning, we simply run all experiment for 5 times and pick up the best performed one.