ozendelait / rvc_devkit

Robust Vision Challenge Devkits
http://www.robustvision.net/
MIT License
107 stars 13 forks source link

Define ScanNet Version used in RVC #5

Closed ozendelait closed 4 years ago

ozendelait commented 4 years ago

2018 RVC used a special version of ScanNet. Will this be repeated 2020?

ozendelait commented 4 years ago

The currently downloaded benchmarking data is this: http://kaldir.vc.in.tum.de/scannet/v1/tasks/rob_tasks/scenes_test.zip

and this expects results for these label/labelids: ["wall","floor","cabinet","bed","chair","sofa","table","door", "window","bookshelf","picture","counter","desk","curtain","refridgerator", "shower curtain","toilet","sink","bathtub","otherfurniture"] [34,35,36,37,38,39,40,41,42,43,44,45,47,49,57,61,66,67,69,72]

In comparision to last RVC, we have to do a relabeling anyways. So there is no requirement anymore to have the ids be disjoint from the cityscapes range. Does the test/training data change; do we use a v2 version of this?

ozendelait commented 4 years ago

Confirmed by email to be the accurate version