search

Knowledge-Graph-Hub / kg-covid-19

An instance of KG Hub to produce a knowledge graph for COVID-19 response.
https://github.com/Knowledge-Graph-Hub/kg-covid-19/wiki
BSD 3-Clause "New" or "Revised" License
79 stars 26 forks source link

Add support for compressed exports at merge step #310

Closed deepakunni3 closed 4 years ago

deepakunni3 commented 4 years ago

This, along side latest changes on deepakunni3/kgx repo should get our pipeline going without the long merge step.

justaddcoffee commented 4 years ago

Looks good, thanks Deepak!

I think we'll need to remove this line from the Jenkinsfile too

justaddcoffee commented 4 years ago

I think we'll need to remove this line from the Jenkinsfile too

took the liberty, hope that's okay

deepakunni3 commented 4 years ago

@justaddcoffee Thanks for merging this in 👍

deepakunni3 commented 4 years ago

Okay.. good catch on removing the extra pigz line. But we should be removing both the pigz lines since the merge step will generate merged-kg.tar.gz and merged-kg.nt.gz by itself.

justaddcoffee commented 4 years ago

Okay, no problem - made a quick PR here: https://github.com/Knowledge-Graph-Hub/kg-covid-19/pull/311