geoschem / integrated_methane_inversion

Integrated Methane Inversion workflow repository.
https://imi.readthedocs.org
MIT License
26 stars 22 forks source link

bugfix to catch errors in TROPOMI variables #128

Closed sabourbaray closed 1 year ago

sabourbaray commented 1 year ago

Name and Institution (Required)

Name: Sabour Baray Institution: Environment and Climate Change Canada

Describe the update

In the recently updated RPRO dataset, there appear to be some edge cases where an orbit file can be opened correctly, but still return a hdf5 error when trying to read a variable later on. This can interrupt the process of reading all TROPOMI files for a given time period.

I've shared another script that validates our local TROPOMI cache with the Copernicus repository by comparing exact filesizes, so I've double checked the files in our download process. It may be the case that these are files that could be problematic for any user.

Moving the error-catch to include all variables fixes this problem for me.