search

gettyimages / docker-spark

Docker build for Apache Spark
MIT License
679 stars 369 forks source link

Bump to Spark 2.2.1 #34

Closed krystiannowak closed 6 years ago

krystiannowak commented 6 years ago

@dylanmei - not sure why we can't just download Spark binary (the one without Hadoop) directly from http://archive.apache.org/dist/spark/spark-2.2.1/ the same way as the Hadoop distribution is downloaded - do you have any hint? In terms of geo-distribution the dynamic Lua closer script be used as in this PR.

aigor commented 6 years ago

Wote for this pull request!

dylanmei commented 6 years ago

@krystiannowak before 2.2.1 the CF url was both reliable and fast. Seems like the archives aren't being placed here anymore. cc @bryceageno

bryceageno commented 6 years ago

@krystiannowak sorry for being a little late.

krystiannowak commented 6 years ago

@bryceageno No worries! Best is it finally appeared on https://hub.docker.com/r/gettyimages/spark/tags/ :)