Hi, I'm new to this data set. I followed README and run evaluation on example.pred.dev.jsonl. I got the following result.
{
"ex_accuracy": 0.5380596128725804,
"lf_accuracy": 0.45208407552547203
}
I'm not sure what is wrong. Can you give me some hint?
Hi, I'm new to this data set. I followed README and run evaluation on example.pred.dev.jsonl. I got the following result. { "ex_accuracy": 0.5380596128725804, "lf_accuracy": 0.45208407552547203 }
I'm not sure what is wrong. Can you give me some hint?