VISION-SJTU / Lightning-NeRF

[ICRA 2024] Lightning NeRF: Efficient Hybrid Scene Representation for Autonomous Driving
MIT License
105 stars 6 forks source link

Can you provide some guidance on preparing the custom dataset? #5

Closed Yellowshuohahaha closed 3 months ago

XJay18 commented 6 months ago

Hi, basically, you need to:

  1. Prepare a dataset with images and camera information;
  2. Obtain corresponding pointcloud data from lidar sensors;
  3. Preprocess pointcloud data (e.g., denoising and downsampling);
  4. Visualize 3D pointcloud along with cameras, and define the foreground region to cover the view frustums;
  5. Implement a custom dataparser in NeRFStudio, which reads images, camera information, and pointcloud data.

You may refer to this link, where I uploaded the code for preprocessing Argoverse2.

Yellowshuohahaha commented 6 months ago

@XJay18 Thank you! It is helpful for me!