search

apache / celeborn

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
https://celeborn.apache.org/
Apache License 2.0
862 stars 351 forks source link

fix offerSlotsLoadAware's actualUsableSpace condition on diskInfo #2687

Closed zaynt4606 closed 4 weeks ago

zaynt4606 commented 4 weeks ago

What changes were proposed in this pull request?

fix offerSlotsLoadAware's actualUsableSpace condition on diskInfo. update StorageManager.updateDiskInfos, considering diskReserveSize when setting usableSpace, so master can get the usableSpace of diskInfo from worker without computing.

Why are the changes needed?

Does this PR introduce any user-facing change?

No

How was this patch tested?

UT