Cross compiled to Scala 2.12

FINRAOS / MegaSparkDiff

A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations of possible data sources. Multiple execution modes in multiple environments enable the user to generate a diff report as a Java/Scala-friendly DataFrame or as a file for future use. Comes with out of the box SparkFactory and SparkCompare tools.

https://finraos.github.io/MegaSparkDiff/

Apache License 2.0

49 stars 26 forks source link

Cross compiled to Scala 2.12 #69

Open rajrao opened 3 years ago

rajrao commented 3 years ago

Are there any plans to release this library cross compiled to Scala 2.12?

Currently, I am getting this error: NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)Lscala/collection/mutable/ArrayOps;

The code runs on a databricks cluster running Scala 2.11, but does not run on Scala 2.12.

matthewgillett commented 2 years ago

We just released a new version of this library (version 0.3.0) with Spark 3 and Scala 2.12.

Please check if this new version works for your use case.

kamjacobs commented 1 year ago

I'm facing the same issue. Could you please elaborate on the process of setting up this version? (I'm facing the error in Databricks)

bibhu107 commented 2 months ago

Hi guys, I am facing this error using spark 3.3.1 and scala 2.12.15. Has anyone fixed it yet