gather data, prepare presentation

[quinnwai]

[bwalsh]

Select files for chr1: patient 1-10

• Complete processing, collecting metrics: Save & maintain metrics between runs
• After runs, observe disk utilization, if we run out of diskspace, we may need to implement #36
• Write issues/fix bugs along the way.
• Save & maintain cache between runs
• Use metrics to generate figures.

Repeat for expanded datasets to chr2,3 ... Repeat for expanded datasets to p11, 12 ...

Tech note: document work, architecture digram, document bugs, limitations

• as part of processing, and documenting limitations what workarounds are necessary &/or useful
• nohup is your friend
• terra workflow (as / if needed)

note ⚠️ use notebooks for figure creation & exploratory data analysis, not for running "jobs"

• notebooks are notoriously non reproducible.
• tests, and "cleanroom" scripts are reproducible

[quinnwai]

Structure of Presentation

Info to Add

• 5x performance decrease in Terra vs raw GCP, matched hardware (8 CPUs, memory, etc)

[quinnwai]

presenting today 💯