monarch-initiative / dipper

Data Ingestion Pipeline for Monarch
https://dipper.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
57 stars 26 forks source link

NCBIGene (and friends) #893

Closed TomConlin closed 4 years ago

TomConlin commented 4 years ago

Ultimately about further reducing errors in the Jenkins pipeline logs. Turns out dbxrefs were yet another source of these errors and finding them to fix meant first improving out logging behaviour a little bit.

A side effect is we now have access to all the command line arguments in all the ingests so some of the hoops we now jump through should just go away instead of continuing to grow stale and increasing in number.

(edit) Added a number of log file reducing commits so there is less boilerplate on expected/known behaviour