Fix sbt build. - Githubissues

apache-spark-on-k8s / spark

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/

https://spark.apache.org/

Apache License 2.0

612 stars 118 forks source link

Fix sbt build. #344

Closed mccheah closed 7 years ago

mccheah commented 7 years ago

Remove extraneous Feign dependency that we no longer use in submission v2.
Exclude Jackson from various modules to ensure every Jackson module is forced to 2.6.5 (the version Spark uses).
Fix a linter error only caught by sbt.
Add Kubernetes module to sparktestsupport and other SBT infrastructure

mccheah commented 7 years ago

I didn't include the Kubernetes integration tests in the SBT build just yet - I'm not sure how we would translate the Maven steps into the appropriate SBT ones. It's probably fine to leave that for a future patch.

ash211 commented 7 years ago

The difference between this PR and https://github.com/apache-spark-on-k8s/spark/pull/274 previously is that the ./dev/run-tests via SBT doesn't run the new k8s tests without the change here to dev/sparktestsupport/modules.py