search

w3c / media-production-workshop

W3C Workshop on Web and Media production
https://www.w3.org/2021/03/media-production-workshop/
21 stars 11 forks source link

Media recording sync to clock #33

Open tidoust opened 2 years ago

tidoust commented 2 years ago

How to synchronize media recording to the audio clock reliably?

Raised in:

chrisn commented 2 years ago

A use case here is a DAW where you want to punch in recording at a precise time and have that synchronised with the audio being played by the DAW.

ulph commented 2 years ago

firing off an event when the first data arrives would probably adress this problem, if that timing information is usable to correlate to an audio context time.

the other piece of the pussle is then the roundtrip latency figures. however, fingerprinting of latency numbers could be a problem. it seems likely those figures would be fuzzed somehow, counteracting the usefulness for use cases like recording alignment.

consider an alternative here - where the accurate roundtrip information is used in some recording entity - optionally doing the alignment of the data implicitly. this could be done either by fudging the time in any event emitted as to match the roundtrip latency offset, or by discarding some data.