hashicorp / nomad-spark

DEPRECATED: Apache Spark with native support for Nomad as a scheduler
44 stars 16 forks source link

Distributing this fork as diff or patch #13

Closed tantra35 closed 6 years ago

tantra35 commented 6 years ago

This allow very quickly build custom spark distributions with required versions of spark, and take to account mainline(for example spark 2.3.1 already upcoming, but this fork not ready for it)

barnardb commented 6 years ago

Unfortunately Maven's convention of putting version numbers in the pom files use for building means that a patch isn't quite enough, because the very least version numbers in the new pom files have to be adapted. But you can get a long way with e.g. git cherry-pick v2.3.0..nomad-on-spark-2.3.0.

There is now a nomad-on-spark-2.3.1 branch and v2.3.1-nomad-0.7.0-20180722 release. Apologies for the wait.