matrix-org / waterfall

A cascading stream forwarding unit for scalable, distributed voice and video conferencing over Matrix
Apache License 2.0
97 stars 5 forks source link

Grey frame seen by participants who join several seconds after the call is started (video only) #89

Closed daniel-abramov closed 1 year ago

daniel-abramov commented 1 year ago

The bug is caused by the incorrect RTP timestamp and sequence numbers set for the newly created tracks. This has been introduced during the simulcast implementation to make on-demand subscriptions (unlike the previous non-simulcast version that created local tracks upon reception of remote tracks and added the same track to each participant who tried to subscribe to other participant's feeds).

This goes along with the RTP rewriting story, so must be implemented anyway.