cuebook / cuelake

Use SQL to build ELT pipelines on a data lakehouse.
https://cuelake.cuebook.ai
Apache License 2.0
283 stars 28 forks source link

Implement failsafe for CueLake and Zeppelin pod deletion #25

Closed vikrantcue closed 2 years ago

vikrantcue commented 2 years ago

Jobs stay in running status when the pod gets killed or evicted due to constraints. Save the state in database and start the job again when pod comes live again.