projectglow / glow

An open-source toolkit for large-scale genomic analysis
https://projectglow.io
Apache License 2.0
264 stars 111 forks source link

Docker containers for Glow runtime environment on Databricks #420

Closed a0x8o closed 2 years ago

a0x8o commented 2 years ago

What changes are proposed in this pull request?

Series of Docker containers to provide a Glow runtime environment on Databricks. All containers are in ./docker/databricks These containers have been tested with a GWAS simulation pipeline with Glow + VEP at scale

How is this patch tested?

(Details)

williambrandler commented 2 years ago

please also update the nightly testing jobs configuration jsons to use,

"spark_version": "9.1.x-scala2.12" projectglow/databricks-glow:9.1

https://github.com/projectglow/glow/blob/master/docs/dev/jobs-config-hail.json https://github.com/projectglow/glow/blob/master/docs/dev/jobs-config.json

currently building the new databricks-glow container, should be up in ~20mins

codecov[bot] commented 2 years ago

Codecov Report

Merging #420 (5028585) into master (de6f36d) will not change coverage. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #420   +/-   ##
=======================================
  Coverage   93.63%   93.63%           
=======================================
  Files          95       95           
  Lines        4824     4824           
  Branches      466      466           
=======================================
  Hits         4517     4517           
  Misses        307      307           

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 6c9bde1...5028585. Read the comment docs.