Fine-tuning RL-based bandwidth estimator on emulator or in-situ environment - Githubissues

OpenNetLab / AlphaRTC

Evaluation framework for RL-based bitrate control for WebRTC

BSD 3-Clause "New" or "Revised" License

94 stars 37 forks source link

Fine-tuning RL-based bandwidth estimator on emulator or in-situ environment #83

Closed jeongyooneo closed 1 year ago

jeongyooneo commented 2 years ago

Major changes:

Added python-based training loop in rl_training
Added code that connects the training loop (python) and WebRTC receiver (C++) in modules/third_party/cmdtrain

Added codes are highlighted in yellow in the following figure:

Minor changes to note:

N/A

Tests for the changes:

Unit test will be added by additional commits before merge

Other comments:

Checking video quality affected by the bandwidth estimation (RL policy's action) by converting outvideo.yuv to mp4 format:
```
ffmpeg -f rawvideo -vcodec rawvideo -s 320x240 -r 10 -pix_fmt yuv420p -i outvideo.yuv -c:v h264 outvideo.mp4`
```
If this PR is being merged to main, modules/third_party/cmdinfer should be restored

jeongyooneo commented 1 year ago

Closing this PR for now. Will reopen it later if merging to the main branch is needed.