w3c / webrtc-nv-use-cases

Use cases for WebRTC NV
https://w3c.github.io/webrtc-nv-use-cases/
Other
32 stars 13 forks source link

Add requirements for low latency streaming use cases #75

Closed aboba closed 2 years ago

aboba commented 2 years ago

This is an attempt to add requirements for low latency streaming use cases. The requirements for game streaming and other low latency streaming uses cases are somewhat different, so they each have their own section.

Partial fix for https://github.com/w3c/webrtc-nv-use-cases/issues/62


Preview | Diff

aboba commented 2 years ago

@fippo PTAL.

drkron commented 2 years ago

Thanks @aboba! I think that this is a great initiative.

What do you think of adding another requirement regarding reduced jitter buffer on the receiving client?

drkron commented 2 years ago

The control of jitter buffer and rendering delay could be generalized to a Quality-of-Service API, where latency is traded for the perceived smoothness (dropped frames, freezes, etc).

aboba commented 2 years ago

@fippo @drkron Added the jitter buffer/rendering control requirements.

aboba commented 2 years ago

Comments from TPAC 2022:

  1. For both use cases: RTCDataChannel in Workers.
  2. For game streaming: Streaming input from GamePad via a worker.
  3. For game streaming: Streaming input from AR/VR headsets (via RTP?).