search

aiddata / geo-datasets

Scripts for preparing datasets in GeoQuery
http://geoquery.org
MIT License
20 stars 11 forks source link

PM2.5 Update #182

Closed sgoodm closed 4 months ago

sgoodm commented 5 months ago

Updating to version V5GL04

https://sites.wustl.edu/acag/datasets/surface-pm2-5/

sgoodm commented 5 months ago

Code updated for k8s flows and currently debugging some pipeline specific issues

sgoodm commented 5 months ago

Pipeline actually finished running fine. The "errors" were HDF5-DIAG warnings that seem to have been tied to a version mismatch between dependencies within netcdf4. 

HDF5-DIAG: Error detected in HDF5 (1.10.8) thread 1:
  #000: ../../../src/H5A.c line 485 in H5Aopen_by_name(): can't open attribute
    major: Attribute
    minor: Can't open object
  #001: ../../../src/H5Aint.c line 543 in H5A__open_by_name(): unable to load attribute info from object header
    major: Attribute
    minor: Unable to initialize object
  #002: ../../../src/H5Oattribute.c line 497 in H5O__attr_open_by_name(): can't locate attribute: '_QuantizeBitGroomNumberOfSignificantDigits'
    major: Attribute
    minor: Object not found

Relevant issues: https://github.com/SciTools/iris/issues/5187 https://github.com/tobac-project/tobac/issues/388#issuecomment-1847647486

And it seems like 1.6.0 of netcdf4 may be where some of the features being warning about as missing were added (we had 1.5.7 in the container) https://github.com/Unidata/netcdf4-python