how can I convert the depth map into a point cloud, given the accurate camera intrinsics

yenchenlin / nerf-pytorch

A PyTorch implementation of NeRF (Neural Radiance Fields) that reproduces the results.

MIT License

5.33k stars 1.04k forks source link

how can I convert the depth map into a point cloud, given the accurate camera intrinsics #123

Open elenacliu opened 1 year ago

SwcK423 commented 1 year ago

Like the depth map in lego's test folder in the synthetic dataset, which is in png format, what do we do to align it with the nerf coordinates, expecting answer.

GauravNerf commented 5 months ago

depth map in the test folder is not used in the training of the model. it is kept for the user to compare the results after training with gt depth. technically i see the depth map is aligned for every rgb image, so the coordinates of the rgb image may also be the same for depth images, check the transform_test.json