gbif / pipelines

Pipelines for data processing (GBIF and LivingAtlases)
Apache License 2.0
40 stars 28 forks source link

K8s: Revise the install-workflow.sh and run-workflow-schema-migration.sh occurrence scripts #1015

Closed muttcg closed 7 months ago

muttcg commented 8 months ago

The install-workflow.sh and run-workflow-schema-migration.sh scripts are used for pipelines reinterpretation scripts and Jenkins projects.

marcos-lg commented 7 months ago

I created this script to run the wfs in airflow: https://github.com/gbif/occurrence/blob/feature/stackable-hadoop-3-test/occurrence-download/install-workflow-airflow.sh

It's pretty simple since we can't change the params of the dag but we can add more options if we need them.