Move to Spark 2.0 - Githubissues

hammerlab / guacamole

Spark-based variant calling, with experimental support for multi-sample somatic calling (including RNA) and local assembly

Apache License 2.0

84 stars 21 forks source link

Move to Spark 2.0 #566

Open arahuja opened 8 years ago

arahuja commented 8 years ago

It seems like this will involve:

removing/moving references org.apache.spark.logging
upgrading ADAM
upgrading spark-testing-base to 2.0.0_0.4.4

@ryan-williams have you tried this out already, I remember you were looking at the ADAM upgrade

ryan-williams commented 8 years ago

I haven't paid much attention to their 2.0.0-upgrade efforts yet, so I don't have a good sense of what that will entail.

fnothaft commented 8 years ago

I haven't paid much attention to their 2.0.0-upgrade efforts yet, so I don't have a good sense of what that will entail.

They're pretty simple. It's mostly been POM/CI changes thus far, as well as moving away from org.apache.spark.Logging. The big impacts were that there were a variety of methods that were deprecated in Spark 1.x that got removed, and then org.apache.spark.Logging got removed.