Linxius / UrbanScene3D

https://vcc.tech/UrbanScene3D
78 stars 12 forks source link

About Evaluation #12

Closed wangyusenofficial closed 6 months ago

wangyusenofficial commented 7 months ago

Thank you for providing such a high quality dataset. The google share link about evaluation program has expired, can you provide a new link?

Linxius commented 7 months ago

Sorry for the inconvenience. My Google Drive subscription is expired. Please use the link from Dropbox or BaiduYun.

wangyusenofficial commented 6 months ago

Thanks for your reply! I used your latest evaluation protocol to evaluate the Artsci reconstruction result downloaded from the official website. aligned And here is the evaluation results. eval I want to confirm whether this result is reasonable. It seems that the visualization results in fig4 of the paper are better. And do you have any future plans to provide visualization feedback similar to the tanks and temples benchmark? Looking forward to your reply.

Linxius commented 6 months ago

We don't release the original lidar scans due to the copyright. We use much much denser lidar scans for the registration and evaluation in the paper than those provided in the evaluation tool, so the evaluation scores for the real scenes can not reproduced exactly with the provided evaluation tool. I don't have the code for some of the evaluated planning algorithms, so it would be hard for me to add more results for other datasets.

wangyusenofficial commented 6 months ago

Got it, thank you very much~