ketzacoatl / compute-demo

HA compute / data processing cluster on AWS, built with Terraform, Packer, Nomad, Consul, and SaltStack.
3 stars 0 forks source link

dynamic (load-based) auto-scaling w/ ladder #7

Open ketzacoatl opened 6 years ago

ketzacoatl commented 6 years ago

The purpose of this task is to a) demonstrate this feature as working, and b) come up with an example config that is known to work in our stack. We can determine how to best integrate the results from this work later, this ticket is primarily interested in the first step to demo ladder working.

Note that this can be figured out on any ASG, it does not need to be this compute stack, but I do already have the pieces to run sysbench (generate load), ladder, workers/managers, prometheus, node exporter, grafana, and the initial IAM policy needed for ladder to scale the workers. The basic requirements for running and configuring ladder are in place, but may need some tweaks, and ladder's configuration itself needs more bashing. I ran out of time to understand enough of the pieces of ladder's configuration to get a working example. See https://github.com/themotion/ladder and https://themotion.github.io/ladder/.

Sysbench, example: https://github.com/ketzacoatl/compute-demo/blob/master/nomad-jobs/sysbench.hcl (to generate load, see other nomad jobs)