search

google-research / arco-era5

Recipes for reproducing Analysis-Ready & Cloud Optimized (ARCO) ERA5 datasets.
https://cloud.google.com/storage/docs/public-datasets/era5
Apache License 2.0
287 stars 22 forks source link

Fix for expver dimension #56

Closed DarshanSP19 closed 11 months ago

DarshanSP19 commented 11 months ago

Added the fix for expver dimension for recent months data.

DarshanSP19 commented 11 months ago

Hey @alxmrs We for the majority of the data files this fix seems working (Verified after back filling the data). But following two variables are hitting the assertion assert disjoint_nans, "The nans are not disjoint in expver=1 vs 5". It seems like data itself is inappropriate. 

cloud_base_height
convective_inhibition
DarshanSP19 commented 11 months ago

@alxmrs After verifying the code for April, May and June 2023 data, It seems that the changes are required for data ingestion. As the data for April and May also downloaded on 21st September so it should be fresh enough for the process further.

alxmrs commented 11 months ago

Thanks for the discussion in this PR.