w3c / webrtc-nv-use-cases

Use cases for WebRTC NV
https://w3c.github.io/webrtc-nv-use-cases/
Other
31 stars 13 forks source link

Section 3.10: A little thought about the one way media use case #93

Open bdrtc opened 1 year ago

bdrtc commented 1 year ago

Very excited to see that the one way media scene has been added to the latest webrtc nv use case. Regarding the scenarios inside, I have a few questions.

  1. About N40, N41, it seems that what we want to add is support for pre-encoded video frames, but does not include pre-encoded audio frames? ,N40 does not describe whether it is an audio encoder or a video encoder?
  2. Live streaming is a typical one way media scene, and live streaming usually requires video to support B-frame transmission and audio to support AAC encoding. Do we need to add such capability requirements to one way media? The advantage of adding these two capability requirements is that when pre-encoded audio and video are injected through the one way media interface and stream to media server via rtp then distributed through the RTMP/HTTP-FLV/HLS/DASH protocol, the media distribution side does not need to do audio conversion (opus->aac), support Video B frames can be used to improve video quality, which is also a common practice in streaming media scenarios, Supporting this capability requires some modification of the protocol layer(rtp, sdp) of webrtc, but it will make webrtc more suitable for live streaming scenarios and more compatible in media part with other live streaming protocols.
dontcallmedom-bot commented 1 year ago

This issue was mentioned in WEBRTCWG-2023-05-16 (Page 15)