search

cc-ai / kdb

AI can help Visualizing the Impacts of Climate Change. This is an open forum to share our work
https://mila.quebec/en/ai-society/visualizing-climate-change/
Apache License 2.0
19 stars 3 forks source link

Using Cityscapes Validation to Test ADVENT #136

Open tianyu-z opened 4 years ago

tianyu-z commented 4 years ago

I transformed the segmentation map of Cityscapes Validation Datasets (frankfurt, lindau, and munster) into Mask images (by changing the value of the road, sidewalks... to 255 and the rest to 0.) Then, we have 500 pictures in total to evaluate ADVENT.

The JSON files are at /network/tmp1/ccai/data/mask_generation/Cityscapes/structuredData/val and the exact images are at /network/tmp1/ccai/data/Cityscapes/structuredData/val

I used it to validate ADVENT model. The mIOU is between 83.23 and 88.32. Because the "ground truth" is the union of road, sidewalks and anything on the ground rather than "where to flood", the mIOU can only be a reference. If you want to know the detailed performance, please checks the result here: https://www.comet.ml/tianyu-z/advent-ccai/e6eb250447ac4d668c8e2f3225a7fd91?experiment-tab=images

image

vict0rsch commented 4 years ago

I think that's really encouraging! It's able to pick up the main idea (~road + wheels of cars)

vict0rsch commented 4 years ago

(sorry @tianyu-z I had forgotten to press enter!)

tianyu-z commented 4 years ago

Haha, no worries. Thank you for commeting on Sunday!