technion-cs-nlp / LLMsKnow

MIT License
38 stars 4 forks source link

How did you calculate AUC for "Majority"? #3

Closed conan1024hao closed 1 week ago

orgadhadas commented 1 week ago

Hi, Thank you for the interest in our paper. The numbers presented in the table were accuracy and not AUC. AUC for the majority baseline is 0.5 so this was a mistake on our end. We removed it on a revision of the paper.