DataBiosphere / azul

Metadata indexer and query service used for AnVIL, HCA, LungMAP, and CGP
Apache License 2.0
6 stars 2 forks source link

Parquet to BigQuery import for Azure-backed AnVIL snapshots #6409

Open hannes-ucsc opened 1 month ago

hannes-ucsc commented 1 month ago

A test snapshot was made available in TDR dev:

https://ucsc-gi.slack.com/archives/C03TPJS54DC/p1720727529206979?thread_ts=1720545248.520269&cid=C03TPJS54DC

achave11-ucsc commented 1 month ago

Assignee to consider next steps.

hannes-ucsc commented 4 days ago

Once the blocker lands, we can spike this to attempt to index that snapshot in anvildev and anvilbox and see what breaks.