stanfordnmbl / opencap-iphone

Apache License 2.0
0 stars 1 forks source link

Add depth, accelerometer, and gyroscope capture #37

Open suhlrich opened 9 months ago

suhlrich commented 9 months ago

We'd like to record depth, accelerometer, and gyroscope data simultaneous with the video. Then, we'd like to zip them (or combine them into one file somehow) on device and upload the zipped file to the server like usual.

By default, we still want to just record video, and we would pass a parameter through the session status that would indicate when we want to also record these other data streams (https://github.com/stanfordnmbl/opencap-iphone/blob/0534ec8bf3a9174982c43aaf1a814e8faf432d1c/MobileCap/CameraViewController.swift#L53)

For depth map, let's only record it when the device has Lidar (eg: https://developer.apple.com/documentation/avfoundation/additional_data_capture/capturing_depth_using_the_lidar_camera)

Let's make sure the Lidar is capturing the same field of view as the camera, even if it is not able to be full resolution.

xhardcorex commented 9 months ago

Hi Scott! It's possible to receive data, write to the file, archive data and send to the server. I assume that it will take around 25 hours and and prepaid hours should be enough to get this task done.

Could you please provide detailed example with new data that you expect to receive from the phone.

Which type of would do you prefer to use for writing data before archiving (.txt, .json etc.)? Thanks!