get Matthew_corr = 0 in eval on CoLA

google-research / albert

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Apache License 2.0

3.23k stars 570 forks source link

get Matthew_corr = 0 in eval on CoLA #205

Open cyjj opened 4 years ago

cyjj commented 4 years ago

I tried multiple times fine-tuning on CoLA ask, but get Matthew_corr keeps to be 0 in evaluation. I have no idea what happened. I checked file conversion part code and make sure conversion work done . Has anyone got same problem?

I run this test in tf-2.0.0-gpu and modify some import code to make it runnable in 2.0.0