AUROC evaluation for CXR-to-report task

hyn2028 / llm-cxr

Official code for "LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation"

https://arxiv.org/abs/2305.11490

Apache License 2.0

111 stars 11 forks source link

AUROC evaluation for CXR-to-report task #20

Open danielemolino opened 4 months ago

danielemolino commented 4 months ago

Hi! Thank you so much for your amazion work! I was very intrigued by it, but I have a question, how do you evaluate AUROC on the labels extracted from the Chexpert Labeler? I wasn't able to undestand how to get the probabilities of the classification