VForWaTer / metacatalog

Modular metadata management platform for environmental data.
https://vforwater.github.io/metacatalog
GNU General Public License v3.0
3 stars 1 forks source link

Spatial data #188

Closed AlexDo1 closed 1 year ago

AlexDo1 commented 1 year ago

This PR should enable the upload of spatial data as netCDF files / folders (currently DWD RADKLIM) to metacatalog.

The changes to the io-extension code are still to be considered as a draft and are not yet tested. Most importantly, the netCDF READER lacks functionality to filter the data by temporal and spatial extent, which is strictly necessary, as accessing the whole dataset with entry.get_data() is extremely slow and potentially crashes the Python kernel.

Also, some revisions and bugfixes are included.

codecov[bot] commented 1 year ago

Codecov Report

Merging #188 (8de9d1d) into master (e95c325) will decrease coverage by 1.13%. The diff coverage is 31.85%.

@@            Coverage Diff             @@
##           master     #188      +/-   ##
==========================================
- Coverage   62.68%   61.54%   -1.14%     
==========================================
  Files          68       70       +2     
  Lines        3256     3352      +96     
==========================================
+ Hits         2041     2063      +22     
- Misses       1215     1289      +74     
Flag Coverage Δ
e2e 61.54% <31.85%> (-1.14%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
metacatalog/api/__init__.py 100.00% <ø> (ø)
metacatalog/db/revisions/__init__.py 100.00% <ø> (ø)
metacatalog/ext/io/extension.py 100.00% <ø> (ø)
metacatalog/ext/io/deleter.py 38.00% <8.33%> (-9.37%) :arrow_down:
metacatalog/ext/io/importer.py 50.37% <8.82%> (-13.36%) :arrow_down:
metacatalog/ext/io/reader.py 66.66% <20.00%> (-7.85%) :arrow_down:
metacatalog/models/datasource.py 67.50% <20.00%> (-2.30%) :arrow_down:
metacatalog/api/add.py 49.27% <50.00%> (-0.48%) :arrow_down:
metacatalog/db/revisions/rev10.py 50.00% <50.00%> (ø)
metacatalog/db/revisions/rev9.py 50.00% <50.00%> (ø)
... and 3 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.