Various changes to prepare for the upcoming release of Spark 4.0.
Add build support for Scala 2.13 and make necessary changes to compile Glow
Fix known incompatibilities with 4.0 using the current Spark master branch and 4.0.0-SNAPSHOT maven artifacts
Set up scaffolding for running tests against Spark 4.0. The tests are currently disabled since there's no release artifact, but I've verified that they pass against current master.
Provide necessary configuration to run tests on JDK 17 (and simplify the test configuration along the way)
Add a separate conda development environment file for Python dependencies that will be updated.
What changes are proposed in this pull request?
Various changes to prepare for the upcoming release of Spark 4.0.
master
branch and4.0.0-SNAPSHOT
maven artifactsmaster
.How is this patch tested?
(Details)