search

marek-simonik / record3d

Accompanying library for the Record3D iOS app (https://record3d.app/). Allows you to receive RGBD stream from iOS devices with TrueDepth camera(s).
https://record3d.app/
GNU Lesser General Public License v2.1
383 stars 57 forks source link

How to get the pointcloud from the USB-streamed depth images #6

Closed j96w closed 3 years ago

j96w commented 3 years ago

Hi, many thanks for this great project. I'm looking for a way to transform the USB-streamed depth images into a pointcloud on my pc, just like the results shown in the app. Could you share the code of how you make the transformation from depth to pointcloud? Thanks!

j96w commented 3 years ago

Oh, I just found your intrinsic_mat function in the demo-main.py. Now I can transform the depth to pointcloud with that. Thanks!

hetryn commented 3 years ago

Hi, apologies for hoping onto this thread. It's my first time playing with this app and 3D images and hoping to get some help.

I have a in my directory some /*.jpg and /*.depth files. How do I use the get_intrinsic_mat_from_coeffs() function to generate point clouds. Should I be looking at some files with coeff values as well?

marek-simonik commented 3 years ago

Hi, the four coefficients are fx, fy, tx, ty (in that order). Please see this section of the Unity streaming library to see how a 3D point is generated using those parameters.

Here you can see a Python script that shows you how to load a .depth file.

P.S. I might be slow to respond on Github, so feel free to send me an email at support@record3d.app.