yihua7 / SC-GS

[CVPR 2024] Code for SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes
https://yihua7.github.io/SC-GS-web/
MIT License
428 stars 21 forks source link

请问这些数据不能创建model, 提示No good initial image pair found,数据要求是? #8

Closed wing158 closed 4 months ago

wing158 commented 4 months ago

00000 00038 00203 image 720*800,

yihua7 commented 4 months ago

Hello, here are some of my thoughts on your data:

  1. I believe the problem occurred when you ran COLMAP. Your images actually have a fixed camera pose and white backgrounds, so the camera parameters cannot be estimated by multi-view stereo.

  2. For this type of data, it lacks multi-view information. I hold that dynamic NeRF or dynamic Gaussians cannot be trained, which heavily rely on multi-view photometric consistency.

  3. I strongly suggest you to try those approaches utilizing human body priors, such as Animatable Gaussians, GaussianAvatar, and 3DGS-Avatar. Using SMPL model to represent human shapes and serve as a basis for dynamic deformation makes it possible to reconstruct such scenes.

  4. But I believe these approaches are still difficult on your data, since it seems to be generated by some diffusion model (e.g. AnimateAnyone) and temporal consistency is not promised.

wing158 commented 4 months ago

已解决,用其他扣图软件完成绿幕图片保存并处理,可以完成colmap。 总结:对视频一定要求进行筛选,实现部分角度输出。