search

radanalyticsio / openshift-spark

72 stars 83 forks source link

Copy local spark configuration to $SPARK_HOME/conf #16

Closed tmckayus closed 7 years ago

tmckayus commented 7 years ago

Rather than have the pod creator set the SPARK_CONF_DIR environment variable to point to a directory with a modified spark configuration, this change simply copies the contents of $UPDATE_SPARK_CONF_DIR to $SPARK_HOME/conf during startup. This gives us a simple overwrite semantic so that only files being changed must be specified.

tmckayus commented 7 years ago

This detail should be added to a README or the usage script.