Make metadata a STAC - Githubissues

dlr-eoc / ukis-pysat

The ukis-pysat package provides generic classes and functions to query, access and process multi-spectral and SAR satellite images

Apache License 2.0

27 stars 8 forks source link

Make metadata a STAC #98

Closed fwfichtner closed 3 years ago

fwfichtner commented 4 years ago

Make our metadata a SpatioTemporal Asset Catalogs to be interoperable with other tools. We should also be able to extent it if we need more. @MWieland what do you think about this?

pystac might help with that.

And when we're on it we could make the creation of Cloud Optimized GeoTIFFs a default.

fwfichtner commented 3 years ago

We will break a lot of backwards compatibility for ukis_psyat.data.

MWieland commented 3 years ago

That is true, but it will make ukis-pysat future proof concerning all aspects related to metadata. In my opinion the benefits overweight the problems related to backwards compatibility by far. Compatibility, moreover, will potentially be affected almost exclusively by the way the metadata are returned (in particular the keys). Method calls should (almost) not be affected as far as I can see for now, since STAC follows a very similar approach to our current custom implementation. Even the returned metadata will be in the same file format (JSON) contain the same subset of attributes that we anyway follow already. Accessing metadata will change to some degree, but we gain the benefit of more flexibility, standardization and interoperability plus the options related to distributed catalogue queries etc.

fwfichtner commented 3 years ago

We should also dicsuss how we want to handly datetime, here's the best practice.

MWieland commented 3 years ago

Roadmap to move ukis_pysat.data to STAC

[x] Return metadata as pystac Items
[x] Develop our own STAC-API search class (inspired by sat-search)
[ ] Observe developments for Landsat Collection 2 STAC access and change to new STAC-API as soon as it becomes operational -> this would effectively remove dependencies for pylandsat and landsatxplore
[ ] ESA Scihub is not likely to support STAC in the near future, but we should ensure that items returned by queries with sentinelsat are converted on the fly to STAC Items according to best practises. Currently we do this hardcoded and only for a small subset of attributes. Perhaps even sentinelsat may support this feature in the next release.

MWieland commented 3 years ago

Reopening since discussion around this topic are still ongoing.

MWieland commented 3 years ago

Major point that we are currently still missing is the conversion of metadata to STAC best practises for specific sensors. This should also specifically include the image band list as is described in detail in #23

fwfichtner commented 3 years ago

As soon as we are happy we should consider adding this to stacindex @MWieland.

fwfichtner commented 3 years ago

Let's create new issues, specific for each topic.