search

WKDSMRT / realsense-gstreamer

GStreamer source plugin for the Intel RealSense line of cameras
GNU Lesser General Public License v3.0
30 stars 13 forks source link

Add imu #2

Closed TimConnelly closed 4 years ago

TimConnelly commented 4 years ago

@mhodgson > So the IMU data is handled like audio, which is what I expected. How does that work when the combined buffers are only flowing at 30-ish FPS?

The IMU data will come in at the same rate as the video frames. I don't think a standard audio sink will be able to handle the IMU data and would need custom handling.

I also found a source element for Android sensors, including accelerometer and gyro, which sets the capabilities as "application/sensors" and just pushes out a buffer with the data. Worth considering that route. The relevant code is ahssrc.h/c in gst-plugins-bad.

mhodgson commented 4 years ago

@TimConnelly ok, let's leave as is for now. I think for our use case it's fine. If someone were trying to do real-time IMU-based 6-DOF movement reckoning it might be better to have a separate sink. But we already decided not to make a source with multiple syncs to keep things simple, so all good.