r-geoflow / geoflow

Tools to Orchestrate Geospatial (Meta)Data Management Workflows and Manage FAIR Services
https://github.com/r-geoflow/geoflow/wiki
Other
40 stars 14 forks source link

Implement `entity$enrichSpatialCoverageFromDB` fun as alternative to inherit spatial coverage when `skipDataDownload` is true #350

Closed eblondel closed 9 months ago

eblondel commented 10 months ago

When dealing with huge DB tables, the default behavior of geoflow to read the full content of a DB table can result in a bottleneck. Such default behavior, which is common to data fetched from files (local or remote) and DBs, is required to inherit properties that used to enriched the entity. This is essentially the spatial properties, including the srid and spatial coverage.

When skipDataDownload (previously called skipFileDownload, see #349 ) is enabled, we remove the bottleneck, but we lose the spatial properties inheritance.

A method called enrichSpatialCoverageFromDB is going to be developed to get these spatial properties through dedicated SQL queries.

Development sponsored by IRD @IRDnamik @kikislater @juldebar