twosigma / Cook

Fair job scheduler on Kubernetes and Mesos for batch workloads and Spark
Apache License 2.0
338 stars 63 forks source link

Better version of add-starting-pods #2146

Closed scrosby closed 2 years ago

scrosby commented 2 years ago

Changes proposed in this PR

Why are we making these changes?

Using into here lets clojure use a more optimized codepath where it doesn't make persistent collections for the intermediate states. This means less copying and less garbage. (See docs on persistent! and transient)