itsjafer / jupyterlab-sparkmonitor

JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
https://krishnan-r.github.io/sparkmonitor/
Apache License 2.0
92 stars 23 forks source link

JupyterHub on k8s Integration #33

Closed zpol95 closed 3 years ago

zpol95 commented 3 years ago

Has anyone had success installing this extension on JupyterHub singleuser lab notebooks?

Using: jupyterlab-sparkmonitor version 4.1.0 pyspark==3.1.1 jupyterlab==3.1.9

and doing a copy of the ipython directory in this repo to /home/.ipython and setting IPYTHONDIR=/home/.ipython

I'm attempting to install via pip and have managed to get the extension to show as installed. The 'conf' variable exists and is usable, but when I start a Spark context no UI elements display. It does however, write out to a sparkmonitor_kernelextension.log

I'm wondering if maybe there's some necessary configuration I need to provide that I haven't.