m-lab / etl-gardener

Gardener provides services for maintaining and reprocessing mlab data.
Apache License 2.0
13 stars 5 forks source link

k8s job-service should prioritize yesterday #260

Open gfr10598 opened 4 years ago

gfr10598 commented 4 years ago

Yesterday's data should have top priority. Roughly 10% of time should be spent retrying incomplete jobs. (Should not be top priority, because job specific bugs could then halt progress.) Remaining time should be spent running sequential jobs.

gfr10598 commented 4 years ago

KR: m-lab/dev-tracker#578