search

metno / pyaro

Interface for reading different airquality measurement databases for intercomparison with transport-model-data.
https://pyaro.readthedocs.io
GNU Lesser General Public License v2.1
0 stars 2 forks source link

Ability to read metadata without reading whole data set & temporal subsets #50

Open lewisblake opened 2 weeks ago

lewisblake commented 2 weeks ago

Notes from pyaerocom 28.10.24:

Two requests from pyaro: 1) We want a cheap way to access the data_revision without reading the data. 2) We want a way to read temporal subsets of the data.

Originally posted by @lewisblake in https://github.com/metno/pyaerocom/issues/1302#issuecomment-2441206637

heikoklein commented 2 weeks ago

Temporal subsets can be read using the TimeBoundsFilter (I just recognize that the API on readthedocs doesn't work #51 ). Some readers, e.g. the netcdf-rw filter implement that directly, i.e. before reading the data, while other readers just filter after reading. Maybe this solves already issue 2?

Issue 1 is absolutely valid, now that all datasets should have a revision #37 .

lewisblake commented 2 weeks ago

Awesome, thanks for the update!