dchaley / deepcell-imaging

Tools & guidance to scale DeepCell imaging on Google Cloud Batch
7 stars 2 forks source link

Set up GCP Batch results table #201

Closed dchaley closed 3 months ago

dchaley commented 3 months ago

As we add more test variables (e.g. spot vs standard) we need to take note of those properties in benchmark results.

Add a column for this.

dchaley commented 3 months ago

Maybe, we should just add a new table for batch results. Wdyt @lynnlangit ?

lynnlangit commented 3 months ago

Maybe, we should just add a new table for batch results. Wdyt @lynnlangit ?

yes please do

dchaley commented 3 months ago

Created table: deepcell-401920.benchmarking.results_batch

Removed columns: kernel, gcp_service, is_first_run Added column: provisioning_model

dchaley commented 3 months ago

Fun fact: we ran into a "time travel" feature/bug: https://stackoverflow.com/questions/68984952/bigquery-drop-table-column-ddl-bug/69291989#69291989