We want to atomically update gnomAD and ClinVar Hail Tables. Currently, they are overwritten in place. Instead data pipelines should write to a new directory (maybe use the build ID) and update a configuration file with the new URLs when they are ready. The worker should read URLs from the configuration file.
We want to atomically update gnomAD and ClinVar Hail Tables. Currently, they are overwritten in place. Instead data pipelines should write to a new directory (maybe use the build ID) and update a configuration file with the new URLs when they are ready. The worker should read URLs from the configuration file.