NASA-IMPACT / csdap-cumulus

SmallSat Cumulus Deployment
Other
1 stars 1 forks source link

Copy thumbnails from csdap-cumulus-prod-public to csdap-cumulus-prod-protected #288

Closed chuckwondo closed 10 months ago

chuckwondo commented 11 months ago

Copy thumbnails from the csdap-cumulus-prod-public bucket to the csdap-cumulus-prod-protected bucket so that we can "migrate" from current prod to CBA prod, once it is ready. This can be achieved with an AWS Batch job.

Acceptance criteria:

chuckwondo commented 10 months ago

I created an s3 inventory for the csdap-cumulus-prod-public bucket and kicked off an S3 Batch copy operation to copy all files (thumbnails) from csdap-cumulus-prod-public to csdap-cumulus-prod-protected in preparation for data migration to CBA prod.

There are 2 collection that do not have thumbnails in the csdap-cumulus-prod-public bucket: (a) planet (PSScene3Band), which we're already aware of, and the thumbnails are already in the protected bucket, ready for migration, and (b) WV04_MSI_L1B___1.

@krisstanton or @jsrikish, do either of you know why collection WV04_MSI_L1B___1 has no thumbnails in the public bucket?

chuckwondo commented 10 months ago

All thumbnails have been successfully copied alongside their corresponding granule files.