search

sequenceiq / docker-spark

Apache License 2.0
765 stars 282 forks source link

Spark_v1.3.0-ubuntu with scala_v2.11.4 #29

Closed gone-phishing closed 9 years ago

gone-phishing commented 9 years ago

I'm currently using the spark:1.3.0-ubuntu image built against scala_2.10.4 Can we please have the same image built against scala_2.11.4 as we are facing dependency failure issues.

matyix commented 9 years ago

This is the default version coming with the Spark release - it's the usual Scala dependency hell ... the Dockerfile and the whole project is open source, there are instructions of how to built the image, so I guess you can add whatever Scala version you want.

If we divert from the default that others will complain - that's the whole point of open source, you can fork the repository and add your change and build the image. The whole change should not take more than 5 minutes ...

gone-phishing commented 9 years ago

@matyix The spark 1.3.0 page lists building instructions for scala 2.11.4 which is basically adding a -Dscala 2.11.4 part to the mvn build command. So it shouldn't take long for sure. I'll be happy to contribute if you can help me on how to proceed. (And no I don't want to divert from default, I myself am using this base image. I want a separate image build against scala_2.11 which should add to the variety of images being provided by the organisation :)