search

Jiawei-Yao0812 / NDCScene

Official implementation for the ICCV 2023 paper "NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Space"
31 stars 3 forks source link

Request for Test Set Results on SemanticKITTI Benchmark #1

Closed npurson closed 11 months ago

npurson commented 11 months ago

Hi there, I noticed that the provided SemanticKITTI results appear to be reported on the validation set. It would be greatly appreciated if you could provide results for the test set as well, as this would facilitate better comparisons.

Additionally, I think the SemanticKITTI benchmark on Papers with Code typically displays test results, where your reported results may need to be updated to align with this practice.

Jiawei-Yao0812 commented 11 months ago

Thank you for bringing up this important point regarding the SemanticKITTI results. I understand your concern and agree that providing results on the test set is crucial for a comprehensive evaluation.

The mIoU of test set is 12.14 and updated on the SemanticKITTI benchmark on Papers with Code.

Alexander-Yao commented 10 months ago

Sorry for the typo of mIoU

The provided mIoU of test set in NDC-Scene supplementary material should be 12.58 and updated on the SemanticKITTI benchmark on Papers with Code.