search

facebookresearch / AVT

Code release for ICCV 2021 paper "Anticipative Video Transformer"
Apache License 2.0
152 stars 28 forks source link

Generate submitted file #39

Open interestingzhuo opened 2 years ago

interestingzhuo commented 2 years ago

We can only see the accuracy of validation set, when we run python launch.py -c expts/02_ek100_avt_tsn.txt -l -t.

Can you tell us how to generate the submitted file for the challenge ek100?

rohitgirdhar commented 2 years ago

Please see instructions here: https://github.com/facebookresearch/AVT/blob/main/docs/MODELS.md#epic-kitchens-100-testchallenge-submission

interestingzhuo commented 2 years ago

Please see instructions here: https://github.com/facebookresearch/AVT/blob/main/docs/MODELS.md#epic-kitchens-100-testchallenge-submission

It seems that the script is used to fuse the results of different model. How can I generate the submitted file using only one model, such as "02_ek100_avt_tsn_test_testonly.txt"? ''python launch.py -c expts/02_ek100_avt_tsn.txt -l -t'' can only evaluate the model in the validation set?

rohitgirdhar commented 2 years ago

Hi, apologies for the delay. You can always pass in a single file with weights = 1 and it will generate outputs for that single file. Also since the test set is not public, the code itself can only do evaluation on the val set. For test results you need to submit to the evaluation server.