search

saurfang / spark-sas7bdat

Splittable SAS (.sas7bdat) Input Format for Hadoop and Spark SQL
http://spark-packages.org/package/saurfang/spark-sas7bdat
Apache License 2.0
89 stars 40 forks source link

[WIP] Minimal change to compile for scala 2.12 / Spark 3 #58

Closed srowen closed 4 years ago

srowen commented 4 years ago

This just adjusts Spark and Scala versions for Spark 3 + Scala 2.12. It compiles and most tests pass, except the one concerning SQLContext implicits.

This removes the cross compile but I think it's likely that it's possible to maintain cross-compatibility with Scala 2.11 and Spark 2.4, so I could change that.

Just a WIP for now.

srowen commented 4 years ago

Closed in favor of the much better #59