cta-wave / dpctf-tests

Repo for DPCTF Tests. We prefer to keep the Tests separated from Test Runner
Other
1 stars 5 forks source link

Test random-access-to-time__t1.html configuration is incorrect #104

Closed rcottingham closed 1 year ago

rcottingham commented 1 year ago

Test random-access-to-time__t1.html configuration is incorrect.

Parameter random_access_time is currently set to 10, which is on the CMAF Fragment boundary, but as per §8.4.1 in the Device Playback Capabilities Specification, a time other than the start of a CMAF Fragment shall be used.

To confirm issue is fixed, please retest using the complete test suite and review results from Observation Framework. OF version to use is available here

For further details on the issue please see: Eurofins CTA WAVE Test Suite validation of the Observation Framework results including analysis 31 Jan 2023.xls

FritzHeiden commented 1 year ago

I updated the test-config.json by setting random_access_time to 11s.

jpiesing commented 1 year ago

@rcottingham Can this issue be closed?

rcottingham commented 1 year ago

Hi @FritzHeiden - please can you confirm you have retested this fix using the OF (https://github.com/cta-wave/device-observation-framework/tree/dpcat)? If so, issue can be closed.

gitwjr commented 1 year ago

@FritzHeiden Appears the code was changed. Can you confirm that this fix was done and check it works?

FritzHeiden commented 1 year ago

I captured the test run so you can check it using the OF

random-access-to-time_2023-04-13 17-33-52.zip

rcottingham commented 1 year ago

Thanks Fritz. Issue can be closed.

N.B. Observation results (8044124a-da10-11ed-a5ac-0242ac110002.zip) show many missing frames - this could be a device or recording issue (taken at 60fps, rather than required 120fps).