Open sbucaille opened 4 years ago
Hi @sbucaille , not sure if this is still relevant to you but here goes.
Believe it or not, I had the exact same error code and I found out that the error actually comes from the naming of the split. To make it more clear, I found out about this because I created two new splits, "trainval" and "test". Trainval was working fine, but test wasn't.
There is a FILE_PATTERN expression which apparently causes any split with an 's' in there to fail. When I changed the split from 'test' to 'tet' it actually worked fine. I have to say that this worked for me on the eval.py script, I'm not sure about the vis.py script. Hope it helps you out.
@mrheffels Thank you so much! That actually fixed my problem! I wouldn't have thought that the split name might be the source of the issue :)
Prerequisites
Please answer the following questions for yourself before submitting an issue.
1. The entire URL of the file you are using
https://github.com/tensorflow/models/blob/master/research/deeplab/vis.py https://github.com/tensorflow/models/blob/master/research/deeplab/eval.py
2. Describe the bug
For a school project, I need to train a deep neural network using transfer learning to do segmentation on the PASCAL VOC 2009 dataset, I chose DeeplabV3+. I could tweak the installation steps to adapt it to PASCAL VOC2009 which was ok since it uses the same convention. My training worked fine but when I evaluate my model I got 0 of MIOU accuracy on every classes except the "0" one (which I assume is the background). Apart from that, when I try to visualize it, I got a KeyError from vis.py which I can't find anyone else having the problem.
3. Steps to reproduce
So I tweaked the the download_and_convert_voc2012.sh file to a custom one, but since it is the same convention, nothing really changed, here is the code :
This, indeed produces correct tfrecords. I changed data_generator.py to include my own dataset information :
I'm using it on Google Colab to use GPU's. After having all the data where it is supposed to be, aswell as the model checkpoint xception71_dpc_cityscapes_trainval from https://github.com/tensorflow/models/blob/master/research/deeplab/g3doc/model_zoo.md.
I run the following command to train :
This command works fine, I got my chekpoint which I use for evaluation and visualization.
Evalutation : I run this following command :
But here are the results :
Here the performance are 0 for all the classes that are not 0 (which I assume to be the background)
Then visualization command :
And here I got this error :
4. Expected behavior
A clear and concise description of what you expected to happen.
5. Additional context
Include any logs that would be helpful to diagnose the problem.
6. System information