search

nshaud / DeepNetsForEO

Deep networks for Earth Observation
Other
476 stars 170 forks source link

accuracy of your SegNet model #38

Closed hurricane2018 closed 5 years ago

hurricane2018 commented 5 years ago

@nshaud
I just run the default PyTorch code SegNet_PyTorch_v2.ipynb. However, the accuracy of Vaihingen is about 86%, not as good as your paper. Then I read your paper again, and I found that you have made some change. Do you have any plan to share the code in the BeyondRGB paper?

nshaud commented 5 years ago

Thanks for your interest. The code from the BeyondRGB paper uses multiple data sources (DSM + RGB), it is a multimodal network. I do not have the time right now to update the PyTorch code with this model but I hope to do it in the near future.

hurricane2018 commented 5 years ago

Yes. I know in your paper you use DSM+RGB. However, in the following table, you achieve about 89.4 and 90% on each dataset, when the SegNet was used in your experiment. When I use the Pytorch code in your repository, it only gets about 86%.

image

image

hurricane2018 commented 5 years ago

In addition, what are your training dataset and validation dataset in Vaihingen and Potsdam? You did not explain it in your article.

Are these your training dataset and testing dataset in your article?

segnet_vaihingen_128x128_fold1_iter_60000.caffemodel (112.4 Mo) (backup link): pre-trained model on the ISPRS Vaihingen dataset (trained on tiles 1, 3, 5, 7, 11, 13, 15, 17, 21, 23, 26, 28, 30, validated on tiles 32, 34, 37). potsdam_rgb_128_fold1_iter_80000.caffemodel (112.4 Mo) (backup link) : pre-trained model on the ISPRS Potsdam dataset (RGB tiles, trained on (3, 12), (6, 8), (4, 11), (3, 10), (7, 9), (4, 10), (6, 10), (7, 7), (5, 10), (7, 11), (2, 12), (6, 9), (5, 11), (6, 12), (7, 8), (2, 10), (6, 7), (6, 11), validated on tile (2, 11), (7, 12), (3, 11), (5, 12), (7, 10), (4, 12)).

Best,

nshaud commented 5 years ago

IIRC final results reported on the article are trained on the whole training set and metrics are computed using the ISPRS official test set. Different test splits can have different metrics.