Transport stream audio ahead of test start lead to some audio observations to fail

cta-wave / device-observation-framework

This repository contains the WAVE Device Observation Framework. The DPCTF Device Observation Framework determines pass or fail results, based on observations taken of tests which are run on a device by the DPCTF Test Runner. DPCTF is the Device Playback Compatibility Task Force of the CTA WAVE Project (https://CTA.tech/WAVE and standards@CTA.tech for more info).

Other

1 stars 3 forks source link

Transport stream audio ahead of test start lead to some audio observations to fail #93

Open yanj-github opened 2 weeks ago

yanj-github commented 2 weeks ago

While the test runner is presenting the pre-test QR code, the TS audio continues to play. This likely causes audio observations to fail at the beginning, as the OF is unable to detect audio at 0.0ms effectively and cause the audio sample presenting test to fail. Additionally, this issue impacts the accuracy of the duration and start-up delay measurements.

Affected observations:

[OF] When examined as a continuous sequence of timestamped audio samples of the audio stream, the 20ms test audio samples shall be a complete rendering of the source audio track and are rendered in increasing presentation time order.
[OF] Audio start-up-delay: The start-up delay shall be sufficiently low.
[OF] Audio: The playback duration shall match the duration of the CMAF Track.

yanj-github commented 1 day ago

[OF] When examined as a continuous sequence of timestamped audio samples of the audio stream, the 20ms test audio samples shall be a complete rendering of the source audio track and are rendered in increasing presentation time order.

Not OF issue https://github.com/cta-wave/dpctf-tests/issues/205 is raised.

[OF] Audio start-up-delay: The start-up delay shall be sufficiently low.

This is OF issue the fixes will be committed soon.

[OF] Audio: The playback duration shall match the duration of the CMAF Track.

Some of these are OF issue the fixes will be committed soon.

jpiesing commented 1 day ago

@yanj-github As far as reasonable, please could you give a little more information than above about which issues you do not believe are OF bugs & why. IMHO that will help guide what comes next.

yanj-github commented 1 day ago

@jpiesing in case you missed it. I’ve already created an issue https://github.com/cta-wave/dpctf-tests/issues/205 with some initial information. I’ve now added more details about how I debugged the problem to that issue. Please let me know if anything is unclear or if you need further clarification.