Python Samples, what is the math behind getting the rotation and translation matrix from the recordings

microsoft / HoloLensForCV

Sample code and documentation for using the Microsoft HoloLens for Computer Vision research

MIT License

472 stars 156 forks source link

Python Samples, what is the math behind getting the rotation and translation matrix from the recordings #91

Open Jownathan opened 5 years ago

Jownathan commented 5 years ago

I am using pcloud_compute.py for my thesis and would like to ask some questions.

In recorder_console.py the data from the matrices is extracted from a recording. There are three matrices in the recording: FrameToOrigin, CameraViewTransform and CameraProjectionTransform. The first two are used in both recorder_console.py and pcloud_compute.py to calculate the real world coordinates of the points of the created point cloud, by making a rotation and translation matrix. So my questions are:

What do the three original matrices from the recording contain exactly?
What is the math behind transforming them to a rotation and translation matrix?

I would like to explain the math behind placing the point clouds in the correct position in my thesis.

LisaVelten commented 4 years ago

Hi, I am currenty working on my thesis as well and stumbled over the same problem. I opened a new issue here #119. Maybe you found out some further details and you can help me or this helps you even though your post is from April.. Best, Lisa

yugen12 commented 4 years ago

Same here. Any information you might have would be much appreciated if shared here.

lucivpav commented 4 years ago

I'd also like to know what these matrices mean: FrameToOrigin, CameraViewTransform and CameraProjectionTransform.

LisaVelten commented 4 years ago

Hi, check issue 119 and the zip file I uploaded. I hope this helps.

Am Sonntag, 17. Mai 2020 schrieb Pavel Lučivňák notifications@github.com:

I'd also like to know what these matrices mean: FrameToOrigin, CameraViewTransform and CameraProjectionTransform.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/microsoft/HoloLensForCV/issues/91#issuecomment-629790097, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJMFOZ64S27TCVCOWRWDVF3RR7K6JANCNFSM4HJDQBBQ .