palantir / k8s-spark-scheduler

A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
Apache License 2.0
175 stars 43 forks source link

Make node sorting deterministic as it otherwise causes flakes #231

Closed Alexis-D closed 1 year ago

Alexis-D commented 1 year ago

All things being equal, compare node names to break ties.

Example flake: https://app.circleci.com/pipelines/github/palantir/k8s-spark-scheduler/1857/workflows/017da816-ce66-4a03-898d-36ddfbe3d850/jobs/6103

Confirmed this works by running the test in a loop:

svc-autorelease commented 1 year ago

Released 0.44.0