target / data-validator

A tool to validate data, built around Apache Spark.
Other
100 stars 34 forks source link

Ratchet up to newer baseline #186

Open colindean opened 3 months ago

colindean commented 3 months ago

Target's internal baseline is rebasing onto these facts:

166 will handle Spark 3.5.1 and sets the stage for JDK 17. It enables Scala 2.12, too, but keeps Scala 2.11. We'll want to roll off Scala 2.11 and onboard 2.13.

I don't think we've got anything that cares about the underlying distro.

After #166 is merged, we'll need to do some testing and work to ensure operability on JDK 17, including bumping CI workflows.

https://github.com/target/data-validator/blob/2eb1389be9355189be5ed6a174b62d33a0cb517c/.github/workflows/ci.yaml#L25

https://github.com/target/data-validator/blob/2eb1389be9355189be5ed6a174b62d33a0cb517c/.github/workflows/release.yaml#L24

https://github.com/target/data-validator/blob/2eb1389be9355189be5ed6a174b62d33a0cb517c/.github/workflows/scala-steward.yaml#L27