r-geoflow / geoflow

Tools to Orchestrate Geospatial (Meta)Data Management Workflows and Manage FAIR Services
https://github.com/r-geoflow/geoflow/wiki
Other
40 stars 14 forks source link

Decouple data zip scanning and detection of sourceType/uploadType from method `enrichWithData` #384

Closed eblondel closed 2 months ago

eblondel commented 2 months ago

So far, data zip scanning to inherit sourceType and uploadType for data objects discovered in a data directory was delegated to the entity$enrichWithData method.

This has a huge side effect when we activate the global workflow option skipEnrichWithData to avoid reading larga data files. In that case the enrichWithData method is then not triggered, and actual data sourceType (and propagation to uploadType) is not performed. For a geosapi action, the uploadType is then kept as other and the upload operation is skipped.

cc @helraynal