[DCOS-44632 ] Use checksums in `make test-jars` to reduce CI build time - Githubissues

mesosphere / spark-build

Used to build the mesosphere/spark docker image and the DC/OS Spark package

52 stars 34 forks source link

[DCOS-44632 ] Use checksums in `make test-jars` to reduce CI build time #449

Closed samvantran closed 6 years ago

samvantran commented 6 years ago

What changes are proposed in this PR?

Resolves DCOS-44632

To reduce CI build times this PR:

updates the Makefile target to download a pre-built jar and compare checksums instead of always running sbt assembly. This is because the source code does not change often.
no longer builds the Lightbend mesos-integration jar as we have not been running those tests for some time.
some README cleanup

How was this patch tested?

Compared to master branch, build time is reduced by ~15 minutes; roughly 20%.