monarch-initiative / monarch-ingest

Data ingest application for Monarch Initiative knowledge graph using Koza
https://monarchinitiative.org
14 stars 1 forks source link

Post initial QC ingest cleanup #220

Closed kevinschaper closed 2 years ago

kevinschaper commented 2 years ago

Some cleanup and scope limiting after our initial look at the cat merged graph.

Panther ingest is just making edges now and no longer creating any gene nodes

Since we don't have a strategy yet to only get publication nodes from the reference source, I commented out the pub to gene ingests & the alliance pub ingest from the pipeline. They're still there, but I think we should feel confident about our core graph plus ontologies before we look at solving that problem.

I also included checks in the pipeline to not re-run ingests when the output files already exist.

fixes #219 #218 #216 #222