tudelft3d / City3D

Large-scale LoD2 Building Reconstruction from Airborne LiDAR Point Clouds
https://github.com/tudelft3d/City3D
GNU General Public License v3.0
237 stars 39 forks source link

Validation: Calculation RMSE between point clouds and reconstructed model. #45

Closed QiaosiLi closed 4 months ago

QiaosiLi commented 4 months ago

We used LiDAR point clouds and city3d to construct building models. As we don't have ground truth data, we would like to calculate the RMSE between point clouds and constructed models to evaluate the reconstruction results as you mentioned in your paper. We only found some libraries that can calculate the distance between two point clouds instead of the point cloud to mesh. As we lack experience in this field, could you share how you calculate the RMSE in your work? If you know any open-source codes about this, it would be great if you could share them with us. Thanks a lot.

LiangliangNan commented 4 months ago

This question seems not relevant to the core methodology of City3D.

RMSE is a measure of the overall difference between the point cloud and the reconstructed mesh. When calculating RMSE between a reconstructed mesh and the input point cloud, we might need to look into two directional RMSE: from the mesh to the point cloud and from the point cloud to the mesh.

Since our primary goal is to evaluate the accuracy of the reconstructed mesh, it should be sufficient to use the Mesh to Point Cloud RMSE. We also see in some other papers researchers used Point Cloud to Mesh RMSE. Of course, you may also combine them by calculating their average.

In our paper we use the "Point Cloud to Mesh RMSE", and we wrote "In the context of surface reconstruction, RMSE is defined as the square root of the average of squared Euclidean distances from the points to the reconstructed model".