paullouisageneau / libdatachannel

C/C++ WebRTC network library featuring Data Channels, Media Transport, and WebSockets
https://libdatachannel.org/
Mozilla Public License 2.0
1.67k stars 343 forks source link

Bandwidth estimation #710

Open mateusz-osojca opened 1 year ago

mateusz-osojca commented 1 year ago

(Sorry if that is a duplicate but couldnt find it)

Are You guys supporting dynamic bandwidth estimation? Meaning that whenever bandwidth drops we have automatic adjustment of resolution / frame rate?

paullouisageneau commented 1 year ago

libdatachannel doesn't perform video encoding and decoding by itself, so the user has to handle externally anything related to encoding, like bitrate, resolution, and framerate.

Also, for now there is no proper congestion control algorithm implemented in the library, only basic mechanisms like REMB, but GCC might be implemented in the future.

So the short answer is no, you have to do it on the application side.

fengmao31 commented 1 year ago

Can I use datachannel transport the data insteal of that media-sender. what is the different between them in the lower level code. I want to transport some sensor information from my toy car to my client. I want to try its best to use the network bandwidth.

paullouisageneau commented 1 year ago

@fengmao31 It's not a matter of bandwidth usage but a matter of traffic properties and constraints. If you want to transmit real-time video or audio (either already packetized as RTP or raw samples with a packetizer), then use a media track, otherwise for anything else use a data channel.

fengmao31 commented 1 year ago

I donnot want to send the media data. I want to transprot the lidar data.

paullouisageneau commented 1 year ago

I donnot want to send the media data. I want to transprot the lidar data.

Then you should use a data channel.

fengmao31 commented 1 year ago

yes. but I try to set different collect level to control the size of lidar data. I need the rtcp package to know the situation of network change the level of collect to send more or less data. So I donnot know start from the media channel or data channel to finish this expriment.

I think it is a good idea. Even I can both lower the collect size of lidar and add some disks to store the data in the bad network.

Sean-Der commented 1 year ago

Hey @fengmao31

I plan on porting the Google Congestion Controller implementation from Pion soon. I am still learning libdatachannel, but I think it will all fit very nicely.

Essentially it takes the RTCP feedback (TWCC or RFC8888) and will returns an estimate. As the sender it will be your responsibility to send what it recommends (more/less)

paullouisageneau commented 1 year ago

@Sean-Der That's great, actually @kuzux and @ognkrmms have been working on adding TWCC support and GCC in libdatachannel, so you might want to synchronize with them!