flink-extended / flink-remote-shuffle

Remote Shuffle Service for Flink
Apache License 2.0
191 stars 56 forks source link

[FRS-50] Enable reading buffer floating for better fairness #51

Closed wsry closed 2 years ago

wsry commented 2 years ago

What is the purpose of the change

This solves #50 . It recycles reading buffers before all readers finish and then allocate those buffers back to solve the starvation problem cause by slow tasks occupy reading buffers for too long time.

Brief change log

Verifying this change

This change added tests.