vye16 / slahmr

MIT License
459 stars 50 forks source link

Camera motion information #36

Closed carlosedubarreto closed 8 months ago

carlosedubarreto commented 1 year ago

I noticed from the examples that there is a possbility to get the motion that the camera does. where can I get it?

I've found what seems to be camera data in many places, but seems that there is no useful information on those places, image

and inside the npz files from world, they also seems that doesnt have no useful info, for example: image

Is it anywhere else, or maybe is a problem on my installation?

thanks

vye16 commented 1 year ago

Yes, we do map the camera poses from the input video; if the camera is static, then the camera extrinsics (world to camera transform), i.e. cam_t and cam_R will just be zeros and identity respectively. If there is camera motion, then the cam_t and cam_R fields (and the camera.json file) will contain the world to camera rotation and translation.

On Fri, Aug 4, 2023 at 12:46 PM Carlos Barreto @.***> wrote:

I noticed from the examples that there is a possbility to get the motion that the camera does. where can I get it?

I've found what seems to be camera data in many places, but seems that there is no useful information on those places, [image: image] https://user-images.githubusercontent.com/4061130/258515178-686557c9-9b13-4249-9c5b-3bb8558e1297.png

and inside the npz files from world, they also seems that doesnt have no useful info, for example: [image: image] https://user-images.githubusercontent.com/4061130/258515395-8951b7ab-c243-4f20-a44e-6c5a013864b0.png

Is it anywhere else, or maybe is a problem on my installation?

thanks

— Reply to this email directly, view it on GitHub https://github.com/vye16/slahmr/issues/36, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABLOKW2B2RRUBSXCG45DHR3XTVGPRANCNFSM6AAAAAA3ET5PJA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

carlosedubarreto commented 1 year ago

Thanks, maybe inconfused myself, ill trybagain with a better video to be sure im using a video with real motion

linjiangya commented 7 months ago

Yes, we do map the camera poses from the input video; if the camera is static, then the camera extrinsics (world to camera transform), i.e. cam_t and cam_R will just be zeros and identity respectively. If there is camera motion, then the cam_t and cam_R fields (and the camera.json file) will contain the world to camera rotation and translation. On Fri, Aug 4, 2023 at 12:46 PM Carlos Barreto @.> wrote: I noticed from the examples that there is a possbility to get the motion that the camera does. where can I get it? I've found what seems to be camera data in many places, but seems that there is no useful information on those places, [image: image] https://user-images.githubusercontent.com/4061130/258515178-686557c9-9b13-4249-9c5b-3bb8558e1297.png and inside the npz files from world, they also seems that doesnt have no useful info, for example: [image: image] https://user-images.githubusercontent.com/4061130/258515395-8951b7ab-c243-4f20-a44e-6c5a013864b0.png Is it anywhere else, or maybe is a problem on my installation? thanks — Reply to this email directly, view it on GitHub <#36>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABLOKW2B2RRUBSXCG45DHR3XTVGPRANCNFSM6AAAAAA3ET5PJA . You are receiving this because you are subscribed to this thread.Message ID: @.>

How can we detect the camera is static or dynamic if do not set this manually? I tried to input a static camera video however the camera parameters are still changing all the time and the camera is also moving & shaking during visualization. It might have something to do with the third-party SLAM system?