search

apache / celeborn

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
https://celeborn.apache.org/
Apache License 2.0
886 stars 359 forks source link

[CELEBORN-1490][CIP-6] Support process large buffer in flink hybrid shuffle #2873

Closed reswqa closed 2 days ago

reswqa commented 5 days ago

What changes were proposed in this pull request?

This is the last PR in the CIP-6 series.

Fix the bug when hybrid shuffle face the buffer which large then 32K.

Does this PR introduce any user-facing change?

No

How was this patch tested?

UT

RexXiong commented 2 days ago

Thanks. merge to main(v0.6.0)