yaooqinn / itachi

A library that brings useful functions from various modern database management systems to Apache Spark
https://itachi.readthedocs.io/
Apache License 2.0
53 stars 4 forks source link

Transition to SBT #3

Closed MrPowers closed 3 years ago

MrPowers commented 3 years ago

Think it'll be good to use SBT cause it's more popular amongst Scala programmers.

SBT is having trouble finding org.apache.spark.sql.QueryTest and import org.apache.spark.sql.test.SharedSparkSession.

Screen Shot 2021-02-05 at 9 10 43 AM

What needs to be added to the build.sbt file to access those classes?

yaooqinn commented 3 years ago

let me try to fix that and bring CI alive

yaooqinn commented 3 years ago

lgtm. merged to master

yaooqinn commented 3 years ago
libraryDependencies += "org.apache.spark" %% "spark-core" % sparkVersion % "test" classifier "tests"
libraryDependencies +=
  "org.apache.spark" %% "spark-catalyst" % sparkVersion % "test" classifier "tests"
libraryDependencies += "org.apache.spark" %% "spark-sql" % sparkVersion % "test" classifier "tests"
libraryDependencies += "org.apache.spark" %% "spark-hive" % sparkVersion % "test" classifier "tests"

is missing