search

google-ar / arcore-android-sdk

ARCore SDK for Android Studio
https://developers.google.com/ar
Other
4.91k stars 1.2k forks source link

Missing documentation on AR recording MP4 metadata #1606

Open Bablakeluke opened 10 months ago

Bablakeluke commented 10 months ago

SPECIFIC ISSUE ENCOUNTERED

ARCore has a wonderful playback and recording feature where a recording is produced as an MP4. The documentation suggests that these MP4's are intended to be played back anywhere and it also describes the general kind of metadata present. However, the binary format of this metadata is not described making it effectively impossible for thirdparty parsing and playback to happen, beyond just the video of course.

VERSIONS USED

All

STEPS TO REPRODUCE THE ISSUE

  1. Obtain an MP4 recording from the ARCore recording API
  2. Attempt to parse the accelerometer or gyroscope samples from it in order to visualise them

WORKAROUNDS (IF ANY)

Inappropriate amounts of reverse engineering!

ADDITIONAL COMMENTS

The metadata appears to be stored in 3 protocol buffers, implying that specification files do exist somewhere within Google already. Publishing these as part of the documentation would be wonderful.

wzj5530 commented 8 months ago

encount same issue

hnj5247 commented 8 months ago

Could you share any idea's if you had figured out any way?