search

leonid-pishchulin / poseval

Evaluation of multi-person pose estimation and tracking
Other
211 stars 49 forks source link

'convert.py' is unable to convert COCO ground truth annotation file 'person_keypoints_minival2014.json' #30

Closed ArchNew closed 5 years ago

ArchNew commented 5 years ago

I've noticed poseval recently starts to support coco datasets, due to the newly added file 'convert.py.' Unfortunately, when I try to evaluate some Detectron results from 'https://github.com/facebookresearch/Detectron/blob/master/MODEL_ZOO.md,' it reports:

Traceback (most recent call last):
  File "evaluate.py", line 72, in <module>
    main()
  File "evaluate.py", line 32, in main
    gtFramesAll,prFramesAll = eval_helpers.load_data_dir(argv)
  File "/home/tujun/poseval/py/eval_helpers.py", line 385, in load_data_dir
    data = convert_videos(data)[0]
  File "/home/tujun/poseval/py/convert.py", line 620, in convert_videos
    videos = Video.from_new(track_data)
  File "/home/tujun/poseval/py/convert.py", line 185, in from_new
    assert lm_idx in conversion_table, "Landmark `%s` not found." % (lm_name)
AssertionError: Landmark `head_bottom` not found.

Upon further examination, I found the process stopped when it's trying to convert the ground truth annotation (namely 'person_keypoints_minival2014.json') to posetrack17 format. Is it due to I handle it in a wrong way, or poseval's support for COCO hasn't complete?

leonid-pishchulin commented 5 years ago

the code was never tested with coco dataset, only with the posetrack 2018 annotations that are "coco-like"