Open-EO / openeo-geopyspark-driver

OpenEO driver for GeoPySpark (Geotrellis)
Apache License 2.0
25 stars 4 forks source link

Better temporal intersection for extra_validation #757

Closed EmileSonneveld closed 1 month ago

EmileSonneveld commented 2 months ago

Committed script to find temporal extent for layer here: https://git.vito.be/projects/BIGGEO/repos/openeo-deploy/pull-requests/15/overview

First the code would only take the temporal extent from the layer catalog when the user did not specify something. But for one process graph a user specified a huge and wrong temporal extent, confusing the is_layer_too_large code. Now the code takes an intersection of the user and catalog temporal extent.

EmileSonneveld commented 2 months ago

Wait, I did a huge COPERNICUS_30 query and got different dates than what I extracted from the data. For North East Africa I got dates from 2012-05-05 to 2014-12-01

EmileSonneveld commented 2 months ago

@soxofaan would this in the layer catalog be fine? "temporal": {"interval": [["2010-12-12", null]], "step": "infinite"} (non standard) or "temporal": {"interval": [["2010-12-12", null]], "skip_validation": true} or maybe add skip_validation to some other part of the layer