twosigma / Cook

Fair job scheduler on Kubernetes and Mesos for batch workloads and Spark
Apache License 2.0
338 stars 63 forks source link

Remove metatransaction filter from match. #2143

Closed scrosby closed 2 years ago

scrosby commented 2 years ago

Changes proposed in this PR

Why are we making these changes?

This should make the database pathway used to load jobs from the database (at match time) more efficient. At this point, we're already filtering to jobs with a commit latch set.