Refactor common NDE, RDP, outbreak pipelines

NIAID-Data-Ecosystem / nde-crawlers

Harvesting infrastructure to collect and standardize dataset and computational tool metadata

Apache License 2.0

0 stars 0 forks source link

Refactor common NDE, RDP, outbreak pipelines #22

Open flaneuse opened 2 years ago

flaneuse commented 2 years ago

Convert the separate but redundant infrastructure shared between the NDE, RDP, and outbreak projects into a common set of crawlers, with a filtered portion of the API being redirected to each separate project.

Related to #16 (custom query filters for NDE).