cta-standards / R4WG20-QoE-Metrics

Issue tracking repository for the R4-Wg20 QoE Initiative
9 stars 2 forks source link

Missing aspects of "Video and audio quality" #8

Closed tonihei closed 5 years ago

tonihei commented 5 years ago

The category of "video and audio quality" is so far only defined by the metric "Average Playback Bitrate". This leaves out some important aspects of perceived video and audio quality:

  1. Quality changed during playback: Switching quality up and down (especially for video) is noticeable by the user and reduces the perceived quality compared to a steady format selection.
  2. Playback may not be smooth due to device limitations and playback problems. Typical examples are audio underruns and dropped video frames.

Both aspects should preferably be captured by some metric to provide a full picture.

gheikkila commented 5 years ago

The chapter "Video & Audio Quality Metrics" covers the ITU-T standard P.1203, which does capture these effects. It's currently just an optional metric, as the implementation is a bit more complex than for the other metrics.

mlevine84 commented 5 years ago

WG acknowledge the point raised and the request has been debated extensively within WG. WG has decided to address the point raised in future version of the spec.