apache / celeborn

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
https://celeborn.apache.org/
Apache License 2.0
862 stars 351 forks source link

[CELEBORN-1564] Fix actualUsableSpace of offerSlotsLoadAware condition on diskInfo #2688

Closed zaynt4606 closed 2 weeks ago

zaynt4606 commented 4 weeks ago

What changes were proposed in this pull request?

fix offerSlotsLoadAware's actualUsableSpace condition on diskInfo, considering diskReserveSize when updateDiskInfos in StorageManager, so master don't need to calculate usableSpace when offerSlots.

Why are the changes needed?

Does this PR introduce any user-facing change?

No

How was this patch tested?

UT

waitinfuture commented 4 weeks ago

Please run ./dev/reformat before submitting PR

RexXiong commented 2 weeks ago

Merge to main(v0.6.0) and branch-0.5(0.5.2)