Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics systems with user-provided monitoring probes.
This runs before or after copying of the files mentioned with —files in spark submit ?
That is not very clear.
Guess the order of execution should be mentioned in the doc.
This runs before or after copying of the files mentioned with —files in spark submit ? That is not very clear. Guess the order of execution should be mentioned in the doc.