jiyanggao / Video-Person-ReID

Video-based Person ReID Method Implementations on MARS
381 stars 110 forks source link

Bug in mars split #6

Open AlekseySh opened 6 years ago

AlekseySh commented 6 years ago

Look like I found the problem in MARS dataset split. For some queries, I can't found right answers in the gallery, (and vice versa). Does anyone have the ​same problem?

=====================================

import numpy as np from scipy.io import loadmat

q = loadmat('/media/re-id/datasets/mars/info/query_IDX.mat')['query_IDX'][0] t = loadmat('/media/re-id/datasets/mars/info/tracks_test_info.mat')['track_test_info']

query_inds = q - 1 gallery_inds = [i for i in range(len(t)) if i not in query_inds]

query_pids = t[query_inds , 2] gallery_pids = t[gallery_inds, 2]

print('This person ids only in query') print(np.setdiff1d(query_pids, gallery_pids)) print() print('This pids only in gallery') print(np.setdiff1d(gallery_pids, query_pids))

============================================

This person ids only in query [ 6 152 436 454 640 782 944 1062 1138 1140 1146 1172 1252 1444]

This pids only in gallery [ -1 0 12 14 154 166 982 1034 1104 1354]

InnovArul commented 6 years ago

Have you found out whats the issue?

Just as an additional note, there are 28 query instances (belonging to 14 query IDs) that doesn't have matching IDs in Gallery. [(6, 2), (152, 2), (436, 2), (454, 2), (640, 2), (782, 2), (944, 2), (1062, 2), (1138, 2), (1140, 2), (1146, 2), (1172, 2), (1252, 2), (1444, 2)]

InnovArul commented 5 years ago

The Mars dataset author clarified about the inconsistency here: https://github.com/liangzheng06/MARS-evaluation/issues/4