vacancy / NSCL-PyTorch-Release

PyTorch implementation for the Neuro-Symbolic Concept Learner (NS-CL).
http://nscl.csail.mit.edu
MIT License
418 stars 94 forks source link

confusion on dataset names #6

Closed sainaasani closed 3 years ago

sainaasani commented 5 years ago

Hello, Can anyone explain me what is the difference between 'scenes-raw.json' and 'scenes.json' files? The scenes.json files with direct link have the exact same format data as in clevr dataset scenes files.

vacancy commented 4 years ago

The scenes-raw.json refers to the original scenes.json that could be downloaded from the CLEVR website. We actually do NOT use the file.

The scenes.json contains image information with detected bounding boxes, which is the file that we actually use. Copied from the README file:

Next, you need to add object detection results for scenes. Here, we use the tools provided by ns-vqa. In short, a pre-trained Mask-RCNN is used to detect all objects. We provide the json files with detected object bounding boxes at clevr/train/scenes.json and clevr/val/scenes.json.