search

google-research / arco-era5

Recipes for reproducing Analysis-Ready & Cloud Optimized (ARCO) ERA5 datasets.
https://cloud.google.com/storage/docs/public-datasets/era5
Apache License 2.0
287 stars 22 forks source link

Added a script to find ambiguous data in gcs bucket. #42

Closed dabhicusp closed 1 year ago

dabhicusp commented 1 year ago

Added a Script which will find is there any ambiguous data which was downloaded in wrong directory of GCS Bucket. Using of the this script I found this all files which is downloaded in wrong directory.

raw/ERA5GRIB/HRES/Daily/1979/1979010100_hres_invariant.grb2 raw/ERA5GRIB/HRES/Daily/2007/20080421_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2007/20080720_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2017/20180702_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2017/20180703_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2017/20180711_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2017/20180717_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2017/20180719_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2017/20180722_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2017/20180725_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2017/20180726_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2017/20180729_hres_dve.grb2 raw/ERA5GRIB/HRES/Daily/2018/20180101_hres_z.grb2 raw/ERA5GRIB/HRES/Daily/2021/20210229_hres_qrqs.grb2 raw/ERA5GRIB/HRES/Daily/2021/20210229_hres_tw.grb2 raw/ERA5GRIB/HRES/Daily/2021/20210231_hres_o3q.grb2 raw/ERA5GRIB/HRES/Daily/2021/20210231_hres_qrqs.grb2 raw/ERA5GRIB/HRES/Daily/2021/20210231_hres_tw.grb2

raw/ERA5GRIB/HRES/Month/1989/198905_cape_hres.grb2 raw/ERA5GRIB/HRES/Month/2020/20201206_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201207_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201208_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201209_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201210_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201211_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201212_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201213_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201214_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201215_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201216_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201217_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201218_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201219_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201220_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201221_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2020/20201222_hres_tw.grb2 raw/ERA5GRIB/HRES/Month/2021/19790101_hres_zm.grb2