search

hashicorp / nomad-spark

DEPRECATED: Apache Spark with native support for Nomad as a scheduler
44 stars 16 forks source link

spark 2.4.0 with scala 2.12 support? #22

Closed wlk closed 5 years ago

wlk commented 5 years ago

Can you clarify if spark 2.4.0 with scala 2.12 is supported?

I couldn't find any information about compatible releases.

It looks like your examples project: https://s3.amazonaws.com/nomad-spark/spark-examples_2.11-2.4.0.jar is published only for 2.11

cgbaker commented 5 years ago

Hi Wojciech,

I didn't not compile 2.4.0 using 2.12, just 2.11. I will publish new binaries for 2.12 asap. Thanks for pointing this out.

cb

On Fri, Mar 8, 2019 at 6:08 AM Wojciech Langiewicz notifications@github.com wrote:

Can you clarify if spark 2.4.0 with scala 2.12 is supported?

I couldn't find any information about compatible releases.

It looks like your examples project: https://s3.amazonaws.com/nomad-spark/spark-examples_2.11-2.4.0.jar is published only for 2.11

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/hashicorp/nomad-spark/issues/22, or mute the thread https://github.com/notifications/unsubscribe-auth/ABmPT4jKM85BA1GWNa3XpWEi6ITzEX_pks5vUkTCgaJpZM4blJor .

alkagin commented 5 years ago

Hi,

Any news on spark 2.4.0 w scala 2.12? The last Spark release (2.4.3) uses scala 2.12 as default.

cgbaker commented 5 years ago

Hi, I'm sorry, I've been caught up in core Nomad work. I'll try to do this ASAP.

On Tue, May 21, 2019, 11:11 Andrea notifications@github.com wrote:

Hi,

Any news on spark 2.4.0 w scala 2.12? The last Spark release (2.4.3) uses scala 2.12 as default.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/hashicorp/nomad-spark/issues/22?email_source=notifications&email_token=AAMY6TYIXSBOWSMHPCXTGEDPWQGITA5CNFSM4G4UTIV2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODV4HIWY#issuecomment-494433371, or mute the thread https://github.com/notifications/unsubscribe-auth/AAMY6T3V7MUAEKBNRX2EZJ3PWQGITANCNFSM4G4UTIVQ .

cgbaker commented 5 years ago

I have updated the last 2.4.0 with a 2.12 build. I have also uploaded a 2.12 build of the examples to the S3 bucket: https://nomad-spark.s3.amazonaws.com/spark-examples_2.12-2.4.0.jar

Apologies for the delay on this. On the next set of releases, I'll try to remember to release 2.12 distributions as well.

cgbaker commented 5 years ago

Spark 2.4.3 with Scala 2.12 has been release: https://github.com/hashicorp/nomad-spark/releases/tag/v2.4.3.0