This version of Glow bumps the dependency on Spark from 3.1.2 to 3.2.1. And the hadoop dependency to 3.3.1
This release includes a new Glow Docker container projectglow/open-source-glow:1.2.1 and projectglow/databricks-glow:1.2.1. And new container for Hail projectglow/databricks-hail:0.2.93. Please see projectglow's dockerhub for more information.
Important:
All tests pass except Hail on Spark 3. Hail will upgrade to Spark 3.2 once Amazon EMR and Google Dataproc do (https://github.com/hail-is/hail/issues/11707). All notebook tests that use Hail remain on runtime 9.1 (Spark 3.1.2) until we have a version of hail that is compiled against 3.2.1. Other continuous integration notebook tests use Databricks runtime 10.4 (Spark 3.2.1)
What changes are proposed in this pull request?
Release v1.2.1. There are now in Maven Central and pypi.
This version of Glow bumps the dependency on Spark from 3.1.2 to 3.2.1. And the hadoop dependency to 3.3.1
This release includes a new Glow Docker container
projectglow/open-source-glow:1.2.1andprojectglow/databricks-glow:1.2.1. And new container for Hailprojectglow/databricks-hail:0.2.93. Please see projectglow's dockerhub for more information.Important:
All tests pass except Hail on Spark 3. Hail will upgrade to Spark 3.2 once Amazon EMR and Google Dataproc do (https://github.com/hail-is/hail/issues/11707). All notebook tests that use Hail remain on runtime 9.1 (Spark 3.1.2) until we have a version of hail that is compiled against 3.2.1. Other continuous integration notebook tests use Databricks runtime 10.4 (Spark 3.2.1)