facebookresearch / Ego4d

Ego4d dataset repository. Download the dataset, visualize, extract features & example usage of the dataset
https://ego4d-data.org/docs/
MIT License
361 stars 49 forks source link

Ego-view video not aligned with exo-view video #347

Open Zray26 opened 3 months ago

Zray26 commented 3 months ago

Hi, thanks for sharing this great dataset.

When I check ego_preview.mp4 of indiana_bike_01_2, I found ego-video video is not aligned with those exo-view videos, which is quite clear in the images below: indiana_bike_01_2_misaligned_01 indiana_bike_01_2_misaligned_02

Then I extracted both ego-view and exo-view images from videos under /frame_aligned_videos following code here, and found ego-view is 5 frames behind exo-view. The person raises hand at frame 106 in exoview and at frame 111 in egoview. image image

I wonder if I overlooked any code that makes ego-view and exo-view videos aligned? Or there might be misalignment within several frames for videos in EGOEXO-4D dataset?