r-geoflow / geoflow

Tools to Orchestrate Geospatial (Meta)Data Management Workflows and Manage FAIR Services
https://github.com/r-geoflow/geoflow/wiki
Other
41 stars 14 forks source link

Unable to make iso19115 with geoflow #368

Closed kikislater closed 12 months ago

kikislater commented 12 months ago

Since ~ 1 or 2 months, I'm not able to reproduce the workflow available here : https://github.com/r-geoflow/geoflow/blob/master/inst/extdata/workflows/config_metadata_gsheets_iso19115.json to generate iso19115 xml

Just job.json and job-logs.txt with empty entities subfolder created

Output from console :

> geoflow::executeWorkflow("/tmp/iso19115.json")
Loading required package: geometa
Loading required package: ows4R
Error in ct$setEdition(edition, locales = geoflow::get_locales_from(edition)) : 
  unused argument (locales = geoflow::get_locales_from(edition))
Error in withVisible(...elt(i)) : 
  Workflow failed during execution, check logs at:

Last line outputs from log:


[geoflow][my-workflow][INFO] Validating entities 
[geoflow][my-workflow][INFO] Validation issues --> 
  row        col    type                                                           message
1   1 Identifier WARNING                  Key is omitted, default key 'id' will be applied
2   1    Subject WARNING Keyword topic's 'taxonomy' is not a recognized ISO keyword topic.
3   1       Date WARNING                   key 'edition' is not a recognized ISO date key.
4   1       Type WARNING             Key is omitted, default key 'generic' will be applied
5   2 Identifier WARNING                  Key is omitted, default key 'id' will be applied
6   2    Subject WARNING Keyword topic's 'taxonomy' is not a recognized ISO keyword topic.
7   2       Date WARNING                   key 'edition' is not a recognized ISO date key.
8   2       Type WARNING             Key is omitted, default key 'generic' will be applied
[geoflow][my-workflow][INFO] Parsing 2 entities from tabular source 
[geoflow][my-workflow][INFO] Parsing entity 1 
[geoflow][my-workflow][ERROR] Data dir doesn't exist! 
[geoflow][my-workflow][INFO] Parsing entity 2 
[geoflow][my-workflow][INFO] Successfuly fetched 2 entities! 
[geoflow][my-workflow][INFO] Enrich metadata entities from directory of contacts 
[geoflow][my-workflow][INFO] 0000-0002-5870-5762 
[geoflow][my-workflow][INFO] 0000-0002-5870-5762 
[geoflow][my-workflow][INFO] geoflow 
[geoflow][my-workflow][INFO] julien.barde@ird.fr 
[geoflow][my-workflow][INFO] wilfried.heintz@inrae.fr 
[geoflow][my-workflow][INFO] emmanuel.blondel1@gmail.com 
[geoflow][my-workflow][INFO] wilfried.heintz@inrae.fr 
[geoflow][my-workflow][INFO] emmanuel.blondel1@gmail.com 
[geoflow][my-workflow][INFO] julien.barde@ird.fr 
[geoflow][my-workflow][INFO] julien.barde@ird.fr 
[geoflow][my-workflow][INFO] wilfried.heintz@inrae.fr 
[geoflow][my-workflow][INFO] 0000-0002-5870-5762 
[geoflow][my-workflow][INFO] 0000-0002-5870-5762 
[geoflow][my-workflow][INFO] geoflow 
[geoflow][my-workflow][INFO] julien.barde@ird.fr 
[geoflow][my-workflow][INFO] wilfried.heintz@inrae.fr 
[geoflow][my-workflow][INFO] emmanuel.blondel1@gmail.com 
[geoflow][my-workflow][INFO] wilfried.heintz@inrae.fr 
[geoflow][my-workflow][INFO] emmanuel.blondel1@gmail.com 
[geoflow][my-workflow][INFO] julien.barde@ird.fr 
[geoflow][my-workflow][INFO] julien.barde@ird.fr 
[geoflow][my-workflow][INFO] wilfried.heintz@inrae.fr 
[geoflow][my-workflow][INFO] Successfuly loaded 2 entities! 
[geoflow][INFO] Check package dependencies for action 'geometa-create-iso-19115' 
[geoflow][INFO] The following packages have been imported for action 'geometa-create-iso-19115': 
  package installed version
1 geometa      TRUE   0.7.1
2   ows4R      TRUE   0.3.6
====================================================================================================
Workflow Execution
====================================================================================================
[geoflow][my-workflow][INFO] Executing workflow job... 
----------------------------------------------------------------------------------------------------
[geoflow][my-workflow][INFO] Executing software actions 'onstart' ... 
----------------------------------------------------------------------------------------------------
[geoflow][my-workflow][INFO] Executing entity actions ... 
[geoflow][my-workflow][INFO] Workflow mode: entity 
[geoflow][my-workflow][INFO] Workflow with 1 actions 
[geoflow][my-workflow][INFO] Action 1: geometa-create-iso-19115 
[geoflow][my-workflow][INFO] Create entity job dir at '/home/sylvain/geoflow-g2oi/jobs/20231006181931/entities/my-geoflow-record' 
[geoflow][my-workflow][INFO] Creating 'data' directory: /home/sylvain/geoflow-g2oi/jobs/20231006181931/entities/my-geoflow-record/data 
[geoflow][my-workflow][INFO] Creating 'metadata' directory: /home/sylvain/geoflow-g2oi/jobs/20231006181931/entities/my-geoflow-record/metadata 
[geoflow][my-workflow][INFO] Entity working directory: /home/sylvain/geoflow-g2oi/jobs/20231006181931/entities/my-geoflow-record 
[geoflow][my-workflow][INFO] SkipDataDownload is false: copying and fetching data... 
[geoflow][my-workflow][INFO] Executing Action 1: geometa-create-iso-19115 - for entity my-geoflow-record 
eblondel commented 12 months ago

As indicated in the DESCRIPTION, geometa needs to be installed from remote Github (pending rev 0.8) and not from CRAN, since the multi-lingual support is being set for ISO 19115 (see https://github.com/r-geoflow/geoflow/issues/298). You still run the geometa latest from CRAN (0.7.1), or you might have reinstalled that one few months ago, which is causing the issue.

The error unused argument (locales = geoflow::get_locales_from(edition)) is transparent and means that you use a version of geometa for which ISOCitation$setEdition() didnt support yet the locales argument.

PS: I'm working on a geometa release for CRAN, but for this library they are more checks due to the number of scripts/classes.