search

youtubevos / MaskTrackRCNN

MaskTrackRCNN for video instance segmentation based on mmdetection
Apache License 2.0
431 stars 75 forks source link

Running test_video.py does not evaluate? #14

Open iyah4888 opened 5 years ago

iyah4888 commented 5 years ago

Hi thanks for the nice code framework. For evaluation, when I run the tools/test_video.py, it does not properly run the evaluation even if I follow the setup described in the readme.

This is the outcome after finishing running test_video.py

writing results to ./data/rst/testouput.pkl
Starting evaluate segm
Annotations does not exist

If there is anything I missed, it seems that it'd be nice to update the readme for evaluation information. Any comment would be appreciated. Thanks.

iyah4888 commented 5 years ago

I investigated a bit, and found that my "instances_val_sub.json" file does not have 'annotations' in the key list.

That's why by the following line, "ytvos.anns" is empty. https://github.com/youtubevos/cocoapi/blob/f3f9948a1f749fb95797f31a9616872811eea559/PythonAPI/pycocotools/ytvos.py#L66

I downloaded "instances_val_sub.json" from the link as described in readme. The json contains proper file list and other information except the annotations field. Could you provide more instruction?

jcliu0428 commented 5 years ago

The same issue encountered. Have you handled it now? @iyah4888

linjieyangsc commented 4 years ago

Hi @iyah4888 we currently does not release the annotations for the validation set. test_video.py will generate a json result file under the result folder. Please submit the json file to our codalab website to see the result. Thanks!

TyroneLi commented 4 years ago

I investigated a bit, and found that my "instances_val_sub.json" file does not have 'annotations' in the key list.

That's why by the following line, "ytvos.anns" is empty. https://github.com/youtubevos/cocoapi/blob/f3f9948a1f749fb95797f31a9616872811eea559/PythonAPI/pycocotools/ytvos.py#L66

I downloaded "instances_val_sub.json" from the link as described in readme. The json contains proper file list and other information except the annotations field. Could you provide more instruction?

hi,I downloaded the dataset following readme,But I could not figure out which json file is annotations? │ │ ├── instances_train_sub.json │ │ ├── instances_val_sub.json I only get test.json, valid.json and train.json.So these three file belong to instances_train_sub.json....??

TyroneLi commented 4 years ago

Hi @iyah4888 we currently does not release the annotations for the validation set. test_video.py will generate a json result file under the result folder. Please submit the json file to our codalab website to see the result. Thanks!

Hi~If you don't release valid json,how do you eveulate your algorithm as described in your paper using validation dataset?

TyroneLi commented 4 years ago

Any body could offer me an answer how to download instances_train_sub.json and instances_val_sub.json??

evgps commented 4 years ago

Any body could offer me an answer how to download instances_train_sub.json and instances_val_sub.json??

Hi, have you found proper [.json]s with annotations for valid and test?

li-yanling commented 4 years ago

Any body could offer me an answer how to download instances_train_sub.json and instances_val_sub.json??

download from https://youtube-vos.org/dataset/ and rename the json files to corresponding name