search

target / data-validator

A tool to validate data, built around Apache Spark.
Other
100 stars 34 forks source link

Switch testing to JDK17 #188

Open colindean opened 3 months ago

colindean commented 3 months ago

Progress toward #186

This may not work OOTB, because I don't know how well the Spark 2.3 path will work, if at all. If it doesn't, I might just rip it out since we want to move off of that ancient Spark version to satisfy #186 in its entirety.

colindean commented 3 months ago

I'm able to get tests to pass locally when using JDK17 and Spark 3.5.1 but not JDK17 with Spark 2.3.4. This is a pretty solid death knell for 2.3.4 in our world and means we're closer to #186 than I thought.