scu-zjz / IMDLBenCo

[NeurIPS'24 Spotlight] A comprehensive benchmark & codebase for Image manipulation detection/localization.
https://scu-zjz.github.io/IMDLBenCo-doc
Creative Commons Attribution 4.0 International
77 stars 12 forks source link

Question About Image-level AUC #53

Closed JulieChoo closed 1 day ago

JulieChoo commented 2 days ago

Thank you for your excellent work. I wonder if there is a problem with the image-level AUC evaluation code (see below) ? It seems that thresholding is not required for image-level AUC evaluation.

https://github.com/scu-zjz/IMDLBenCo/blob/1807684d411ae770aabfebec82b33adcf1eb5b4e/IMDLBenCo/evaluation/AUC.py#L43

SunnyHaze commented 2 days ago

@jzzzzh Please check this issue.

jzzzzh commented 2 days ago

Thanks for debugging, I have fix this bug and please check this issue in the dev branch. We will merge it lately.

SunnyHaze commented 2 days ago

Case solved by #54, please check it.

JulieChoo commented 1 day ago

Thank you for your effort. The problem is solved.