monarch-initiative / dipper

Data Ingestion Pipeline for Monarch
https://dipper.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
57 stars 26 forks source link

Add environment variables for single source runs #789

Closed kshefchek closed 5 years ago

kshefchek commented 5 years ago

This is another refactor of the jenkins pipeline that uses environment variables to enable single source runs and optionally write to /dev vs /ttl on data.monarch.

Down the line we may consider to put this pipeline into its own repo and make a multibranch pipeline, where each branch corresponds to a single source. See https://jenkins.io/doc/book/pipeline/multibranch/#creating-a-multibranch-pipeline

Example in jenkins: https://ci.monarchinitiative.org/view/dipper/job/build-flybase-test/configure