VisionLearningGroup / visda-2018-public

45 stars 33 forks source link

Detection track test set contains no image_list.txt #15

Open Britefury opened 6 years ago

Britefury commented 6 years ago

The detection tract test data set does not contain or have an associated image_list.txt. As a consequence, we cannot determine which file order our prediction files should use.

As a work around, I generated one using the ls command, hoping that its sorting order is the correct one.

Britefury commented 6 years ago

An image list is now available here:

http://csr.bu.edu/ftp/visda/2018/detection/yt_bb_detection_train_sum_gt_clean.txt

caiqi commented 6 years ago

Hi @Britefury have you succeed submitting a result for test set and get the mAP score from codalab server with the providing test image list? I found in another issue https://github.com/VisionLearningGroup/visda-2018-public/issues/16, that, the organizer suggests just removing invalid images. However, even after removing the invalid images, the images can't be matched with the image list in http://csr.bu.edu/ftp/visda/2018/detection/yt_bb_detection_train_sum_gt_clean.txt. Thanks!

Britefury commented 6 years ago

Hi, yes, I have successfully submitted in the test phase. I used the image list at http://csr.bu.edu/ftp/visda/2018/detection/yt_bb_detection_train_sum_gt_clean.txt. I think that the invalid images are not only the empty files but some others too, hence the difference.

caiqi commented 6 years ago

@Britefury Thank you very much for your reply!