search

AutoNUE / public-code

http://cvit.iiit.ac.in/scene-understanding-challenge-2018/
105 stars 49 forks source link

Help understanding evaluation script. #1

Closed kirnh closed 6 years ago

kirnh commented 6 years ago

I am working on evaluating my instance segmentation output on the given dataset. I don't seem to understand the format of the output required by the provided script.

Specifically the below part of the evaluate_instance_segmentation.py script:

# To run this script, make sure that your results contain text files
# (one for each test set image) with the content:
#   relPathPrediction1 labelIDPrediction1 confidencePrediction1
#   relPathPrediction2 labelIDPrediction2 confidencePrediction2
#   relPathPrediction3 labelIDPrediction3 confidencePrediction3
#   ...

What should the LabelIDPrediction be? Is it the class ID? Or is it the encoded ID obtained similar to using ID_TYPE=id in createLabels.py? One more concern is the relPathPrediction in the above text format. It says that the path should be relative to the root directory. I need help understanding what root directory is being referred to, since I could not find the default variable.

kirnh commented 6 years ago

The mail I received with the sample output explains this. It'd be helpful to have the link to them available on the README though.

Thanks!