search

VITA-Group / FSGS

"FSGS: Real-Time Few-Shot View Synthesis using Gaussian Splatting", Zehao Zhu, Zhiwen Fan, Yifan Jiang, Zhangyang Wang
Other
289 stars 18 forks source link

Questions of sparse view camera poses #40

Open ghost opened 3 months ago

ghost commented 3 months ago

Hello, I really appreciate your work. I don’t know much about the work in the field of sparse view 3D reconstruction. After reading your code and comparing the codes of other related works, I found that the camera poses of the training views and test views of sparse perspective 3D reconstruction are all used in the original data set, i.e. the camera pose calibrated using all views. Is my understanding correct? Thank you very much!

zhongyingji commented 2 months ago

I think you are correct. They use point cloud generated from sparse views, e.g., 12 views for mipnerf360, as initialization: https://github.com/VITA-Group/FSGS/blob/main/tools/colmap_360.py#L169.

But they use train/test poses by COLMAP from all views: https://github.com/VITA-Group/FSGS/blob/main/scene/dataset_readers.py#L284-L297

BTW, I am quite curious about the coordinate systems that are used for the above two times. They are different, but the author just initialize the point cloud from sparse views, which does not lie in the same coordinate system with the camera poses.

Correct me if I am wrong🙏