projectglow / glow

An open-source toolkit for large-scale genomic analysis
https://projectglow.io
Apache License 2.0
262 stars 107 forks source link

Revert "upgrade spark version from 3.1 to 3.2, with shim" #506

Closed williambrandler closed 2 years ago

williambrandler commented 2 years ago

Reverts projectglow/glow#501

There are still issues to be resolved here to upgrade to Spark 3.2

Notebook tests must be run on Databricks runtime 10.4 to confirm it works with Spark 3.2.1