search

UARK-AICV / AOE-Net

[IJCV] AOE-Net: Entities Interactions Modeling with Adaptive Attention Mechanism for Temporal Action Proposals Generation
https://arxiv.org/abs/2210.02578
19 stars 1 forks source link

How to obtain AUC (test) results #13

Open try-harder12 opened 1 month ago

try-harder12 commented 1 month ago

Hello, I encountered some issues while reproducing the results of your work on the Activity_net dataset. How can I obtain the AUC (test) results? I can get AUC (val) by running the command python main.py --cfg-file config/anet_proposals_CLIP_v1.yaml MODE 'validation' GPU_IDS [0], but I cannot get AUC (test) by running python main.py --cfg-file config/anet_proposals_CLIP_v1.yaml MODE 'testing' GPU_IDS [0]. I don't know how to do it. Can you tell me?

vhvkhoa commented 1 month ago

Hi,

As annotations on test sub-set is not made publicly available by the organizer of ActivityNet-1.3, we could not do evaluation on testing set. Instead, we use our model to do inference on testing videos and upload the results to organizer's website for evaluation.

I'm concerned that the submission portal is closed for a while (may be I'm wrong). However, I have seen many of recent works only reported their performances on validation set of ActivityNet-1.3 due to difficulties in obtaining scores for testing set.