OpenAdaptAI / OpenAdapt

AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
https://www.OpenAdapt.AI
MIT License
739 stars 98 forks source link

[Bug]: embedded video recordings don't start at 0:00 #728

Open abrichr opened 3 weeks ago

abrichr commented 3 weeks ago

Describe the bug

In https://github.com/OpenAdaptAI/OpenAdapt/pull/726, setting fix_moov=True makes videos recorded with video.py embedded in github comments start at 0:00 as expected, but video.extract_frames fails.

One possible solution involves comparing video_stream.time_base before and after move_moov_atom, computing the difference, and adjusting timestamps as necessary.

To Reproduce

  1. Set fix_moov=False in finalize_video_writer
  2. Create a recording: python -m openadapt.record foo
  3. Try to visualize it: python -m openadapt.visualize