search

leonid-pishchulin / poseval

Evaluation of multi-person pose estimation and tracking
Other
211 stars 49 forks source link

MOT Error #7

Closed soulslicer closed 6 years ago

soulslicer commented 6 years ago

Hi all,

When I enable the MOT mode, I get the following error:

Traceback (most recent call last): File "evaluate.py", line 67, in main() File "evaluate.py", line 53, in main metricsAll = evaluateTracking(gtFramesAll,prFramesAll) File "/media/raaj/Storage/video_datasets/posetrack_valscripts/py/evaluateTracking.py", line 121, in evaluateTracking metricsAll = computeMetrics(gtFramesAll, motAll) File "/media/raaj/Storage/video_datasets/posetrack_valscripts/py/evaluateTracking.py", line 82, in computeMetrics metricsMid = mh.compute(accAll[i], metrics=metricsMidNames, return_dataframe=False, name='acc') File "/usr/local/lib/python2.7/dist-packages/motmetrics/metrics.py", line 127, in compute df = df.events File "/usr/local/lib/python2.7/dist-packages/motmetrics/mot.py", line 231, in events self.cached_events_df = MOTAccumulator.new_event_dataframe_with_data(self._indices, self._events) File "/usr/local/lib/python2.7/dist-packages/motmetrics/mot.py", line 271, in new_event_dataframe_with_data raw_type = pd.Categorical(tevents[0], categories=['RAW', 'FP', 'MISS', 'SWITCH', 'MATCH'], ordered=False) IndexError: list index out of range

I checked and it looks like this function makes motAll to be all NANs:

distThresh = 0.5
    # assign predicted poses to GT poses
    _, _, _, motAll = eval_helpers.assignGTmulti(gtFramesAll, prFramesAll, distThresh)

The values that I input to that function are definitely correct as the -e function gives me 100%

soulslicer commented 6 years ago

I realized its because in my dataset, one of my joints is never visible. This causes it to crash in the tracker, because the function below gets populated with nothing:

accAll[i].update( trackidxGT, # Ground truth objects in this frame trackidxPr, # Detector hypotheses in this frame dist # Distances from objects to hypotheses )

soulslicer commented 6 years ago

Same issue referenced elsewhere