search

autonomousvision / kitti360Scripts

This repository contains utility scripts for the KITTI-360 dataset.
MIT License
384 stars 63 forks source link

Request of Ground Truth data for Geometric and Semantic Mapping val and train split #131

Open QingCheng24 opened 4 days ago

QingCheng24 commented 4 days ago

Hi, thank you for the great benchmark!

we want to evaluate our method on the Geometric and Semantic Mapping task. But there's no Ground Truth data for ground_truth_observed_region and ground_truth_conf used in this evaluation script

Thus we ask for these two types of data in order to perform more local evaluation instead of using the evaluation server which provides very limited times per month.

It is also great, if you can provide the processing script!

Much appreciated!

QingCheng24 commented 18 hours ago

Hi Prof. @yiyiliao, could you please give some hints on how to reconstruct the GT data and run the script?

I've built the binary and run it with the same kind of file for both GT and prediction. The files are created based on data_3d_semantics data. But the semantic evaluation failed with a confusion matrix full of zero.

yiyiliao commented 2 hours ago

Hi, thank you for evaluating your method on our benchmark. We withheld the ground truth data for fair comparisons. Could you send me a data example of your result via email (yiyi.liao@zju.edu.cn)? I will look into this.