search

populationgenomics / hail

Scalable genomic data analysis.
https://hail.is
MIT License
1 stars 1 forks source link

Add support for public-ip-address in dataproc #346

Closed illusional closed 3 months ago

illusional commented 3 months ago

Internal addresses only (no-address) is set by default when creating a Dataproc 2.2 image version cluster. You can use the gcloud dataproc clusters create --public-ip-address flag to enable public IP addresses. [source]

Old batch: https://batch.hail.populationgenomics.org.au/batches/474533/jobs/1 Which uses: --image-version=2.1.2-debian11

New batch: https://batch.hail.populationgenomics.org.au/batches/474657/jobs/1 Which uses --image-version=2.2.5-debian12

And the error just looks like a timeout for public requests (during cluster initialisation)