twosigma / Cook

Fair job scheduler on Kubernetes and Mesos for batch workloads and Spark
Apache License 2.0
338 stars 63 forks source link

Rework Cook dependency injection to reduce parameter passthrough #411

Open wyegelwel opened 7 years ago

wyegelwel commented 7 years ago

Currently if a function depends on configured values, we need to pass that data to that function from the initial graph construction. This often touches many layers of code and causes large unit test churn as we update parameters throughout.

We should look to see if there are better ways to handle dependency injection in clojure or re-structure the code to reduce the amount of this passthrough.

wyegelwel commented 7 years ago

See #371 for discussion about this