leonid-pishchulin / poseval

Evaluation of multi-person pose estimation and tracking
Other
210 stars 49 forks source link

Submit the test set result for posetrack2018 and posetrack2017 #35

Closed hbsz123 closed 5 years ago

hbsz123 commented 5 years ago

I have ran all my experiments on posetrack2018 validation set and posetrack2017 validation set Now I want to submit the test set result. Does the posetrack2018 test set consists of all the posetrack2017 test set? If I submit the posetrack2018 result, could you please feed me back with both posetrack2018 and posetrack2017(for comparision with others) test set result?

hbsz123 commented 5 years ago

When I run the convert.py to convert the posetrack2017 format json files to posetrack2018 format, it shows that some videos not exist. I passed these videos and thus only have 210 converted test videos. image

leonid-pishchulin commented 5 years ago

while posetrack 2018 test set is a superset of posetrack 2017 test set, you have to submit to posetrack 2017 challenge separately from posetrack 2018 challenge. Submission to 2017 challenge can be done using posetrack 2017 annotation format, while submission to 2018 challenge can be done using 2018 format.

hbsz123 commented 5 years ago

Thanks for your reply. But as you see, when I convert the test sequences of the 214 videos for posetrack2017 test set to 2018 format, some of the video sequences don't exist(such as (1,1), (1,3), (1,4), (1,5), (1,7732), (1,9611), (1,11204)).How can I deal with these video sequences?

hbsz123 commented 5 years ago

image The json of 2017 test sequences is converted from the original .mat files. When I ran the convery.py code , it reported 'Assertion Error'. Then I changed the code of posetrack18_id2fname.py in this place. Finally I found some '(seqtype_idx, seqidx)' didn't exist in the sequences index.

leonid-pishchulin commented 5 years ago

in order to submit to posetrack 2017 you don't need to convert to 2018, but use 2017 format. You need to provide results for all test sequences in posetrack 2017 datset.

hbsz123 commented 5 years ago

Seems that I can only do like you say Thanks very much