dask / distributed

A distributed task scheduler for Dask
https://distributed.dask.org
BSD 3-Clause "New" or "Revised" License
1.58k stars 718 forks source link

http://localhost/dask/clusters 404 (Not Found) - when running Dask helm chart on GKE #3161

Open skeller88 opened 5 years ago

skeller88 commented 5 years ago

I'm running Kubernetes on GKE, following steps 1-6. I've installed Dask on the cluster using helm:

helm repo update      
helm install stable/dask

I believe the chart is from https://github.com/helm/charts/blob/master/stable/dask/Chart.yaml.

The kubernetes service is running the dask-3.1.0 chart. I confirmed this with kubectl get svc -o yaml.

The kubernetes dask-jupyter pod is running the daskdev/dask-notebook:1.1.5 Docker image. I confirmed this with kubectl get pods --all-namespaces -o=jsonpath='{range .items[*]}{"\n"}{.metadata.name}{":\t"}{range .spec.containers[*]}{.image}{", "}{end}{end}' |\ sort

When running the jupyter notebook, I am seeing a lot of these errors in the Chrome console (Ctrl+Shift+J). They appear every few seconds: GET http://10.10.0.50/dask/clusters?1555537293299 404 (Not Found)

Replace the ip address with the ip address of the kubernetes node running the jupyterhub notebook.

What I've tried:

My issue seems to be the same issue as https://github.com/dask/dask/issues/4711. But I see that dask-labextension is now installed in the daskdev Docker image, which is pulled in by the dask helm chart. So it's unclear to me what to investigate next.

quasiben commented 5 years ago

Thanks @skeller88 I think this issue on the dask-kubernetes page may be helpful: https://github.com/dask/dask-kubernetes/issues/177

For reference can you post with the docker image version and where the helm chat came from ? I think there are multiple version of dask helm

skeller88 commented 5 years ago

Updated my question @quasiben. Is that the info you're looking for?

GenevieveBuckley commented 3 years ago

Were you able to get things working @skeller88?