krishnan-r / sparkmonitor

Monitor Apache Spark from Jupyter Notebook
https://krishnan-r.github.io/sparkmonitor/
Apache License 2.0
172 stars 55 forks source link

UI not visible in notebook #7

Closed cristina-grosu closed 6 years ago

cristina-grosu commented 6 years ago

I'm running spark and jupyter notebook in a docker container and I configured the sparkmonitor extension is loaded in the config files. I am running a Spark job in the notebook using the example provided in the github repo. However, even though the job is completed and i can see the final results and the stages in the logs, the UI does not display the screen shots described. What could happen?

krishnan-r commented 6 years ago

Firstly thank you for your interest in the project.

Here are some possible issues that could be the reason

Check the browser console for any errors and if the frontend javascript extension has started.

The IPython kernel extension has to be configured in the config files. Since you are running in a container your environment could be different. A log file is created by the kernel extension in the same folder as the notebook.

Check the jupyter console for any errors.

Since you are using docker, you may try this docker container,( which was working the last time I checked) if you want to see what it does.

cristina-grosu commented 6 years ago

I tested the docker container and it looks that it is not working.

krishnan-r commented 6 years ago

Yes there seems to be a problem. It is not working. I shall look into it.

cristina-grosu commented 6 years ago

I get a similar error to #6 indeed. I tried to solve it by installing ipywidget, without any positive result. Keep us up to date.

krishnan-r commented 6 years ago

I think I have identified the issue. Please see #6 and lets continue the discussion there. Closing this for now.