search

radanalyticsio / openshift-spark

72 stars 83 forks source link

Questions about spark.ui.reverseProxy and spark.ui.reverseProxyUrl #96

Open odunybrad opened 5 years ago

odunybrad commented 5 years ago

Thanks for providing this useful container.

I have a question about two spark configs: spark.ui.reverseProxy and spark.ui.reverseProxyUrl. It seems the official document says "Use it with caution, as worker and application UI will not be accessible directly, you will only be able to access them through spark master/proxy public URL. " For spark.ui.reverseProxyUrl it says "Make sure this is a complete URL including scheme (http/https) and port to reach your proxy."

However, in your scripts/launch.sh, you manually set spark.ui.reverseProxy to true and spark.ui.reverseProxyUrl to \.

Shall we keep the default setting of False? Thanks!

elmiko commented 5 years ago

thanks for the question, this really depends on your deployment platform. iirc, we set those parameters to make it easier for openshift to expose the route to the web ui.

perhaps @tmckayus could provide a little more detail.