nils-braun / dask-sql-k8s-deployment

Example for deploying dask-sql (with Dask and Apache Hue) on k8s
MIT License
2 stars 0 forks source link

Hue not connecting to SQL Server database #5

Open kaisark opened 3 years ago

kaisark commented 3 years ago

Hue is not connecting to the SQL Server database. It looks like there is an HTTPConnectionPool error (see attached screenshot).

I followed the following Dask SQL blog post and ran into the error. Did I miss a step?

https://towardsdatascience.com/deploying-a-python-sql-engine-to-your-cluster-76a590940977

2021-02-01 (2)

2021-02-01 (3)_LI

nils-braun commented 3 years ago

I think you were actually doing great, it is just a matter of time. You see in the k8 screenshot, that the dask-sql pod is not ready. The reason is, that is will first Install some additional packages and then will prefetch the data. That can (depending on network conditions) take up to 10 minutes. If you want, you can check with kubectl logs -f <pod> what is going on. I should probably create a docker image where packages are already preinstalled, so the setup time is faster...

And by the way: thank you very much for trying it out!