Open jbeemster opened 6 years ago
I really like this:
Just another possible way, probably easier to implement: https://github.com/snowplow/dataflow-runner/issues/35
That could work as well - could be an idea that you could also store a jobflow-id as a Consul KV pair to be checked also...
This would be based on name and age where rather than passing the jobflow ID you would pass the jobflow name and dataflow-runner would select the newest cluster available that is running.
Thoughts @alexanderdean @BenFradet ?