How to produce results on COCO test-dev? Thank you.

facebookresearch / detectron2

Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.

https://detectron2.readthedocs.io/en/latest/

Apache License 2.0

30.1k stars 7.42k forks source link

How to produce results on COCO test-dev? Thank you. #275

Closed chenjoya closed 4 years ago

chenjoya commented 4 years ago

❓ Questions and Help

Hi, I have tried to incorporate "coco_2017_testdev": ("coco/test2017", "coco/annotations/image_info_test-dev2017.json"), with detectron2/data/datasets/builtin.py to produce results on COCO test-dev, but it encounter this issue:

File "/home/.../lib/python3.7/site-packages/pycocotools/coco.py", line 142, in getAnnIds
    anns = self.dataset['annotations']
KeyError: 'annotations'

What should we do for producing results on coco_2017_testdev? Thanks!

ppwwyyxx commented 4 years ago

https://github.com/facebookresearch/detectron2/blob/83670010fdf6a646b77bf0b5cefafa1b804a8c6c/detectron2/evaluation/coco_evaluation.py#L57-L59

we only tested this for lvis but seems like this line does not work for COCO.

chenjoya commented 4 years ago

Pretty good. Thanks!