search

jzhzhang / ROSEFusion

[SIGGRAPH 2021] ROSEFusion is proposed to tackle the difficulties in fast-motion camera tracking using random optimization with depth information only.
GNU General Public License v3.0
302 stars 48 forks source link

Masking human for indoor camera localization #39

Open bowieshi opened 1 day ago

bowieshi commented 1 day ago

Hi. If I have a RGBD video where a moving human is present. Is it possible for me to mask out the human by some segmentation model and then use ROSEFusion to estimate camera moving trajectory?

jzhzhang commented 1 day ago

ROSEFusion is a frame-to-model pipeline that requires depth information to compute the relative pose for the reconstruction model.

Thus, it depends on the remaining depth pixels after masking out the human. If a substantial number of depth pixels remain, ROSEFusion should function effectively.