NOAA-PSL / observation-archive

Tools to assemble observational archive record
Apache License 2.0
0 stars 0 forks source link

Add script and logs to execute and document renaming of 2000-2014 ocean observation buckets #60

Closed amschne closed 1 year ago

amschne commented 1 year ago

This PR adds the python script to rename the ocean observation buckets in AWS-S3:noaa-reanalyses-pds/observations/ocean/benchmark-3-md5/ to correct timestamp bucket names. The bucket names representing timestamps were mislabeled 00Z, despite the data representing times valid at 12Z. UFS-RNR expects ocean observations to be valid at 12Z, so the python script also fixes the data for use with UFS-RNR. The following changes are included:

The script was executed to competition on June 13, 2023 for all ocean observation data within the aforementioned S3 bucket for years 2000-2014 (inclusive). The bucket names were copied as to not remove the original buckets, therefore leaving duplicated data in the bucket that can be cleaned up as needed.