search

apache / celeborn

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
https://celeborn.apache.org/
Apache License 2.0
896 stars 361 forks source link

[CELEBORN-1504][FOLLOWUP] Start test nodes in random ports to allow multiple builds run in the same ci server #2902

Closed SteNicholas closed 2 weeks ago

SteNicholas commented 2 weeks ago

What changes were proposed in this pull request?

Start test nodes in random ports to allow multiple builds run in the same ci server, which improves the test implementations so that it starts test nodes in random ports instead of using the hardcoded ones.

Follow up #2619.

Why are the changes needed?

The test nodes are started in the hard coded ports, this prevents to run multiple builds in the same CI/CD server at present.

Bump the changes of #2237.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

RemoteShuffleMasterSuiteJ

SteNicholas commented 2 weeks ago

@turboFei, #2901 should also change the flink-1.16 module.

Ping @mridulm, @reswqa.