graphdeco-inria / gaussian-splatting

Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"
https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/
Other
14.5k stars 1.89k forks source link

Can it be implemented to customize the camera path like instant-ngp, instead of the current video recording-like approach? #410

Open iloveming opened 1 year ago

iloveming commented 1 year ago

Can it be implemented to customize the camera path like instant-ngp, instead of the current video recording-like approach?

yuedajiong commented 1 year ago

The authors are great-masters, but I still try to answer you based on my understanding:

the anwser is: yes!

  1. you can define you wanted path/camera-location-pose-list in any form: a) elevation, azimuth, distance (I like this) b) rotation, translation c) rotation as quaternion d) ...
  2. then use these camera location-pose to capture your digital object; or, if you use video, you can change the physical camera moving path; or, if you use video and the video is ready and can not re-take, you must use colmap to compute SfM, the location-poses are fixed.
  3. convert to GS input required format.
pkq111 commented 10 months ago

How can I retrieve the camera motion trajectory from the training videos?

Haiwei-Shi commented 5 months ago

Hi, have you find the solution? I am also working on this issue. I want to run the path like a python command instead of the interface. Do you find any helpful resources? Thanks a lot.