Specify --out-bucket to submit results to google cloud bucket. Filenames include a hash of the results so runs don't clobber each other and we don't waste space on identical results.
Output a "manifest" JSON for each run that points to the output and also includes a lot of info to improve reproducibility: the arguments, benchmark config, git info for the guacamole checkout, environment variables, and others.
Gzip results
Small performance tweaks to demeter.json. Lowering the memory given to executors resulted in a job failure so that is left basically alone (did lower memoryOverhead slightly).
--out-bucket
to submit results to google cloud bucket. Filenames include a hash of the results so runs don't clobber each other and we don't waste space on identical results.demeter.json
. Lowering the memory given to executors resulted in a job failure so that is left basically alone (did lower memoryOverhead slightly).Here's the bucket we can use for these results: https://console.cloud.google.com/storage/browser/variant-calling-benchmarks-results/