search

HumanCellAtlas / dcp2

Shared artifacts concerning the Human Cell Atlas (HCA) Data Coordination Platform (DCP)
4 stars 2 forks source link

Lungmap `dev` snapshot is in wrong location #47

Closed hannes-ucsc closed 2 years ago

hannes-ucsc commented 2 years ago

All snapshots from the dev refresh are in the us-central1 BQ location. When incorporating those snapshots into Azul, we had to remove the Lungmap snapshot (lungmap_dev_20210412__20210414) because it is in the US location. All snapshots indexed by one Azul instance must be in the same location so that they can be covered by a single BQ slot commitment.

We can either create a new Azul instance specifically for Lungmap or copy the snapshot to us-central1. The former would cause continuing cost for maintaining that instance and for the corresponding cloud infrastructure. The latter would be a one-time operation.

hannes-ucsc commented 2 years ago

Name of copy should match new naming convention with project ID in dataset name.

theathorn commented 2 years ago

No longer planning to support a lungmap dev catalog.