I was actioned to give feedback on the current testable requirements covered in the DPCTF spec, from a testing perspective. (This is taken from dpctf-s00001-v011-wtwg-00020-v000-WAVE-DPC-v0.3.5.docx).
I was unclear how much of the text is "outline/questions" to inform the later writing of the sections, and how much was intended to remain in the final spec.
However, I've tried to derive some example specification text, expressing the requirement as a SHALL on the device, to meet the Section 3 notations.
NOTE that these example text are just examples - it's for DCPTF to determine the correct requirements.
8.2.2
A device shall correctly playback a supported media profile track comprising of CMAF segments when data is sequentially provided to the track buffer.
8.3.2
A device shall correctly playback a supported media profile track comprising of CMAF segments when started from a random access point within the track.
8.4.2
A device shall be capable of time accurate playback of a supported media profile track comprising of CMAF segments over long durations (e.g. at least X hours).
8.5.2
A device shall be capable of seamless presentation of media when switching between CMAF tracks at a CMAF fragment boundary, within a CMAF single initialization switching set.
A device shall be capable of ??? presentation of media when switching between CMAF tracks at a CMAF fragment boundary, within a CMAF general constraints switching set.
8.6.2
A device shall correctly playback a supported media profile track comprising of CMAF chunks when its data is sequentially provided to the track buffer.
From this TCTF can derive individual test cases.
NOTE: the following would be the responsibility of TCTF to produce, we don't expect the specification task forces to write these.
For example:
REF
8.2
ASSERTION
Given a CMAF video track comprising of fragments referencing segments and a supported media profile then the device shall playback the content correctly.
TEST PROCEDURE
Device's track buffer is initialised.
Fragment is appended to the track buffer.
Playback is initialised.
Sequential fragments are appended to the buffer sufficient to prevent underflow, for the remainder of the test.
TEST MEDIA
Video to include:
a digital elapsed timeclock incrementing in real time, showing at least a tenth of a second accuracy.
alignment markers, aligned with the required top, bottom, left and right picture edges.
???
PASS CRITERIA
Video is displayed:
Starting with the displayed clock at 00:00:00.0
Smoothly without artefacts, glitches or blank frames.
At the correct aspect ratio.
Color and luminance are rational.
???
REF
8.2
ASSERTION
Given a CMAF audio track comprising of fragments referencing segments and a supported media profile then the device shall playback the content correctly.
TEST PROCEDURE
[...]
TEST MEDIA
Audio to include:
recognisable tone for the first second.
smooth playing music without discontinuities.
PASS CRITERIA
Audio is presented:
starting with the recognisable tone
smoothly without pops, glitches or discontinuities.
REF
8.3
ASSERTION
Given a CMAF video track comprising of fragments referencing segments and a supported media profile when presented with fragments commencing within the track then the device shall play the content commencing at that position.
TEST PROCEDURE
[...]
TEST MEDIA
Video to include:
a digital elapsed timeclock incrementing in real time, showing at least a tenth of a second accuracy.
alignment markers, aligned with the required top, bottom, left and right picture edges.
???
PASS CRITERIA
Video is displayed:
Starting with the displayed clock at XX:XX:XX.X
Smoothly without artefacts, glitches or blank frames.
At the correct aspect ratio.
Color and luminance are rational.
???
REF
8.3
ASSERTION
Given a CMAF audio track comprising of fragments referencing segments and a supported media profile when presented with fragments commencing within the track then the device shall play the content commencing at that position.
TEST PROCEDURE
[...]
TEST MEDIA
Audio to include:
recognisable tone for one second at XX seconds into the stream.
smooth playing music without discontinuities.
PASS CRITERIA
Audio is presented:
starting with the recognisable tone
smoothly without pops, glitches or discontinuities.
REF
8.4
ASSERTION
Given a CMAF video track comprising of fragments referencing segments and a supported media profile then the device shall playback the content correctly over a long duration.
[...]
PASS CRITERIA
After XXX minutes the video is observed. It displays:
clock time of XX:XX:XX.X
Smoothly without artefacts, glitches or blank frames.
At the correct aspect ratio.
Color and luminance are rational.
???
[...]
REF
8.5
ASSERTION
Given a general constraints CMAF Switching Set with CMAF video Tracks and a supported media profile, when switching between tracks then the device shall playback the content at ??? quality.
[...]
REF
8.5
ASSERTION
Given a single initialization CMAF Switching Set with CMAF video Tracks and a supported media profile, when switching between tracks then the device shall playback the content seamlessly.
[...]
REF
8.6
ASSERTION
Given a CMAF video track comprising of fragments referencing chunks and a supported media profile then the device shall playback the content correctly.
[...]
I was actioned to give feedback on the current testable requirements covered in the DPCTF spec, from a testing perspective. (This is taken from dpctf-s00001-v011-wtwg-00020-v000-WAVE-DPC-v0.3.5.docx).
I was unclear how much of the text is "outline/questions" to inform the later writing of the sections, and how much was intended to remain in the final spec. However, I've tried to derive some example specification text, expressing the requirement as a SHALL on the device, to meet the Section 3 notations. NOTE that these example text are just examples - it's for DCPTF to determine the correct requirements.
8.2.2 A device shall correctly playback a supported media profile track comprising of CMAF segments when data is sequentially provided to the track buffer.
8.3.2 A device shall correctly playback a supported media profile track comprising of CMAF segments when started from a random access point within the track.
8.4.2 A device shall be capable of time accurate playback of a supported media profile track comprising of CMAF segments over long durations (e.g. at least X hours).
8.5.2 A device shall be capable of seamless presentation of media when switching between CMAF tracks at a CMAF fragment boundary, within a CMAF single initialization switching set. A device shall be capable of ??? presentation of media when switching between CMAF tracks at a CMAF fragment boundary, within a CMAF general constraints switching set.
8.6.2 A device shall correctly playback a supported media profile track comprising of CMAF chunks when its data is sequentially provided to the track buffer.
From this TCTF can derive individual test cases. NOTE: the following would be the responsibility of TCTF to produce, we don't expect the specification task forces to write these.
For example: