Hi, this is a great utility but if I have multiple spark contexts running on the same node they get assigned different web UI ports 4040, 4041 etc. However the spark monitor is hard coded to 4040 so they all see the same jobs, is it possible to make this configurable or even better have it detect the web UI port at runtime?
Hi, this is a great utility but if I have multiple spark contexts running on the same node they get assigned different web UI ports 4040, 4041 etc. However the spark monitor is hard coded to 4040 so they all see the same jobs, is it possible to make this configurable or even better have it detect the web UI port at runtime?