jupyter / help

:sparkles: Need some help or have some questions? Please visit our Discourse page.
https://discourse.jupyter.org
291 stars 97 forks source link

jupyterlab remote yarn/spark processing - any alternatives to sparkmagic #488

Open kherrmann2 opened 5 years ago

kherrmann2 commented 5 years ago

Hey all, I'm trying to connect a jupyterlab notebook to submit spark jobs to a kerberized Hortonworks setup running hive/spark/livy.

I had been trying to get sparkmagic to work with jupyterlab, but it appears that it is not compatible, as it chokes whenever I attempt to create an endpoint, though it works fine in jupyter notebook.

I'm curious if jupyter lab has a means to connect to a remote livy server or similar so we can run jobs on a remote cluster.

Thank you!