ControlNet / LAV-DF

[CVIU] Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization
https://www.sciencedirect.com/science/article/pii/S1077314223001984
Other
73 stars 10 forks source link

AUC calculation #11

Closed javadmozaffari closed 6 months ago

javadmozaffari commented 12 months ago

Hello,

I have thoroughly reviewed your GitHub repository and noticed that there is no corresponding code available for calculating the AUC. I would like to kindly request if it would be possible for you to provide the code for calculating AUC in your repository. If the AUC code is not currently available, I would like to propose developing and contributing it via a pull request.

ControlNet commented 10 months ago

Sorry for the late reply.

Actually the temporal localization is the part we hope to address rather than classification so we didn't provide this parts in the code. For AUC, I believe it is a simple video classification problem so it can be easily evaluated.

The metrics calculation use the AUROC from torchmetrics.

Welcome for any PR contributions.