search

zju3dv / NeuralRecon

Code for "NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video", CVPR 2021 oral
https://zju3dv.github.io/neuralrecon/
Apache License 2.0
2.03k stars 294 forks source link

ARKit evaluation #44

Closed hyunJIN7 closed 3 years ago

hyunJIN7 commented 3 years ago

Hi, I am a big fan of this project.

I want to evaluation ARKit Reconstruction results. So I'm trying to apply the evaluation.py code to ARKit Recon results. For that, I need a depth map of ARKit Recon results.

NeuralRecon paper says that "we render the reconstructed mesh to the image plane and obtain depth map estimations.". So I tried to find the code to get the depth map from the reconstructed mesh result, but I couldn't find it. Could you tell me what the code for estimating the depth map from the reconstructed mesh ?

Thanks, Hyunjin Kim.

JiamingSuen commented 3 years ago

Hi @hyunJIN7, if the goal is to evaluate ARKit reconstructions, you will need a ground truth reconstruction, which can be obtained from reconstruction software with depth sensors (e.g. LiDAR on the iPad Pro, with 3D Scanner App).

For the depth map rendering code, you can refer to this file for further details.

hyunJIN7 commented 3 years ago

Thank you for your answer. I will try again after getting gt data with 3D Scanner.