pangeo-data / jupyter-earth

Jupyter meets the Earth: combining research use cases in geosciences with technical developments within the Jupyter and Pangeo ecosystems.
https://jupytearth.org
Creative Commons Zero v1.0 Universal
28 stars 6 forks source link

Upstream a way to ensure our DaskClusters shut down if our user server does #87

Open consideRatio opened 2 years ago

consideRatio commented 2 years ago

During the cryo meeting last week I said I thought that if a user server shut down, it would make us delete the user's created dask clusters using two separate mechanism, which the k8s native mechanism would be failsafe.

That was incorrect, but I want to explore if we can implement such feature. I opened https://github.com/dask/dask-gateway/issues/451 regarding that and would be interested in trying to implement it if I conclude its viable and its found to be a wanted feature to add to the project. Some complexity will need to be added, so its absolutely a matter of considering if the complexity is worth it.