This change restores the Pathlike.name aspect of the somalier_sites reference path in the context of the extract job. Without this, the batch job tries to append a full gs:// path to the batch mounted storage, leading to job failure as it tries to read /io/batch/hash/sites/gs://cpg-common-main/references/somalier/sites.hg38.vcf.gz.
The somalier extract jobs are failing (e.g.) because of changes to cpg-utils
reference_path
function. The somalier extract job was changed in this PR.The
reference_path
function used to be incpg_utils.hail_batch
, it would return aPath
object like so:Following the update,
reference_path
(now incpg_utils.config
) returns a stringThis change restores the
Pathlike.name
aspect of thesomalier_sites
reference path in the context of the extract job. Without this, the batch job tries to append a fullgs://
path to the batch mounted storage, leading to job failure as it tries to read/io/batch/hash/sites/gs://cpg-common-main/references/somalier/sites.hg38.vcf.gz
.