[CELEBORN-1685][FOLLOWUP] CelebornShuffleFallbackPolicyRunner should compute shuffleFallbackCounts via class name of ShuffleFallbackPolicy implementation

apache / celeborn

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

https://celeborn.apache.org/

Apache License 2.0

893 stars 361 forks source link

[CELEBORN-1685][FOLLOWUP] CelebornShuffleFallbackPolicyRunner should compute shuffleFallbackCounts via class name of ShuffleFallbackPolicy implementation #2909

Closed SteNicholas closed 1 week ago

SteNicholas commented 1 week ago

What changes were proposed in this pull request?

CelebornShuffleFallbackPolicyRunner should compute shuffleFallbackCounts via class name of ShuffleFallbackPolicy implementation.

Follow up #2891.

Why are the changes needed?

CelebornShuffleFallbackPolicyRunner computes shuffleFallbackCounts via class name of Option instead of class name of ShuffleFallbackPolicy implementation at present.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

CI.

RexXiong commented 1 week ago

merge to main(v0.6.0)