search

moetsi / Sensor-Stream-Pipe

Open Source Sensor Stream Server and Client for Digitizing Reality
MIT License
70 stars 11 forks source link

Can I also get a ARKIT pose? #15

Closed knsjoon closed 2 years ago

knsjoon commented 2 years ago

Dear Sensor-Stream-Pipe team,

Hello, as I want to use ARKIT rgb / depth / pose data to do 3D reconstruction on my local computer, equipped with GPU, I wonder if Sensor-Stream-Pipe can be modified in anyway to obtain live- arkit poses relative to a world-coordinate frame that ARKIT initializes.

Thank you in advance!

adammpolak commented 2 years ago

Dear Sensor-Stream-Pipe team,

Hello, as I want to use ARKIT rgb / depth / pose data to do 3D reconstruction on my local computer, equipped with GPU, I wonder if Sensor-Stream-Pipe can be modified in anyway to obtain live- arkit poses relative to a world-coordinate frame that ARKIT initializes.

Thank you in advance!

@knsjoon yes that is possible. You would need to extend the current iOS plugin that grabs the RGB to also grab the 3D pose from ARKit.

You could then extend SSP iPhone Reader to include the ability to pull this data in and stream as a new frame struct.