search

JahstreetOrg / spark-on-kubernetes-helm

Spark on Kubernetes infrastructure Helm charts repo
Apache License 2.0
199 stars 76 forks source link

Modify the parameters of the SparkMagic config to connect jupyter notebook with the k8s cluster #78

Open rrcic opened 2 years ago

rrcic commented 2 years ago

Hi. I'm confused that what should be filled in url

"kernel_python_credentials" : {
    "username": "",
    "password": "",
    "url": "http://localhost:8998",
    "auth": "None"
  },

I have depolyed the livy chart on a kubernetes cluster(based on the ACK which is provided by AliCloud). And I have deployed jupyter notebook and sparkmagic on my laptop. Now I'm trying to connect the jupyter notebook with the kubernetes cluster. So I have to figure out how to modify the Spark magic config JSON.