change clinvar submitters table partitions

broadinstitute / seqr-loading-pipelines

hail-based pipelines for annotating variant callsets and exporting them to elasticsearch

MIT License

22 stars 20 forks source link

Closed jklugherz closed 5 months ago

jklugherz commented 5 months ago

make them equal to the clinvar vcf min partitions to hopefully reduce flakiness of the join. this is mostly a guess

yesterday's test run succeeded but after multiple attempts

jklugherz commented 5 months ago

@bpblanken yeah, I'm basing it off of a hunch and this cherry picked comment in a hail thread from 5 years ago https://discuss.hail.is/t/dataproc-workers-lost-after-intensive-task/1014/5