There may be some bugs in the ranking order of the point cloud registration leaderboard?

paul007pl / MVP_Benchmark

MVP Benchmark for Multi-View Partial Point Cloud Completion and Registration

https://mvp-dataset.github.io/

Apache License 2.0

116 stars 10 forks source link

There may be some bugs in the ranking order of the point cloud registration leaderboard? #10

Closed MaxChanger closed 2 years ago

MaxChanger commented 2 years ago

I don't know if it is correct, I think there may be some bugs in the ranking order of the point cloud registration leaderboard? It looks like it’s currently sorted by submission time, not by some kind of metric.

MaxChanger commented 2 years ago

wutong16 commented 2 years ago

Hi! Sorry for the confusion. The completion and registration challenges share the same set of metrics and the highest priority is assigned to CD_Loss@Com, which is not friendly to the registration trend. We'll try to fix the problem. Currently, we can get the correct ranking by clicking the title of the last column, i.e., MSE@Reg.