search

mozilla / jupyter-spark

Jupyter Notebook extension for Apache Spark integration
Mozilla Public License 2.0
193 stars 34 forks source link

Spark Web UI port not 4040 #44

Closed simonwhite71 closed 6 years ago

simonwhite71 commented 6 years ago

Hi, this is a great utility but if I have multiple spark contexts running on the same node they get assigned different web UI ports 4040, 4041 etc. However the spark monitor is hard coded to 4040 so they all see the same jobs, is it possible to make this configurable or even better have it detect the web UI port at runtime?

simonwhite71 commented 6 years ago

sorry just noticed this was a duplicate