Context has run-options field that should be passed directly into spark-submit. It stores as a raw string that can't be directly passed using process api, so it should be correctly split into Seq[String]. The current implementation doesn't work correctly. For example it's impossible to start worker with following options because second argument contain space: --driver-java-options '-Xdebug -Xrunjdwp:transport=dt_socket,address=15000,server=y,suspend=y'
Context has
run-optionsfield that should be passed directly into spark-submit. It stores as a raw string that can't be directly passed using process api, so it should be correctly split intoSeq[String]. The current implementation doesn't work correctly. For example it's impossible to start worker with following options because second argument contain space:--driver-java-options '-Xdebug -Xrunjdwp:transport=dt_socket,address=15000,server=y,suspend=y'