Linxius / UrbanScene3D

https://vcc.tech/UrbanScene3D
93 stars 12 forks source link

Questions about evaluation. #6

Closed yxjchly closed 1 year ago

yxjchly commented 1 year ago

Hello, what is the definition of accuracy and completeness in evaluation program? How to understand the meaning of evaluation programlogs? Thanks very much!

yxjchly commented 1 year ago

Can I reference the two papers, that is Benchmarking Structure from Motion Algorithms of Urban Environments and Tanks and Temples Benchmarking Large Scale Scene Reconstruction.

Linxius commented 1 year ago

The value of 90% or 95% accuracy x means that for all the closest points of the vertices of the reconstruction model on the ground-truth model, 90% or 95% of them have a distance less than x. The value of 0.02 m, 0.075 m, or 0.075 m completeness x% means that for all the closest points of the vertices of the ground-truth model on the reconstruction model, x% of them have a distance less than 0.02 m, 0.05 m, or 0.075 m. A smaller 90% and 95% accuracy value mean higher accuracy and a larger 0.02 m, 0.05 m, or 0.075 m completeness value means higher completeness.