framed-data / overseer

Overseer is a library for building and running data pipelines in Clojure.
Eclipse Public License 1.0
97 stars 10 forks source link

Modify lottery ratio: 3/2 => 4/1 #47

Closed andrewberls closed 9 years ago

andrewberls commented 9 years ago

Overseer uses lottery-style allocation to determine which eligible job to run next. Previously, the preference ratio for unstarted over started was 3/2. This modifies the ratio to 4/1 since we want to highly prioritize unstarted work, and only towards the end of the queue tend towards picking up anything that may died in-flight.

elliot42 commented 9 years ago

:+1: modulo merge conflicts?