search

DFKI-NLP / DISTRE

[ACL 19] Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extraction
https://www.aclweb.org/anthology/P19-1134
Apache License 2.0
85 stars 13 forks source link

The value of AUC and P@N is 0. #6

Open ssnvxia opened 4 years ago

ssnvxia commented 4 years ago

Thank you very much for sharing the code！

When I use the default settings (batch_size = 16), the AUC is 0.414.

But when I use the settings in the paper (batch_size = 8), the value of AUC and P@N is 0.

Am I missing something important?

Thank you !

StarsEater commented 2 years ago

same problem