NIAID-Data-Ecosystem / nde-discovery-api

NIAID Data Ecosystem Discovery API, based on BioThings SDK
Apache License 2.0
0 stars 0 forks source link

Filter out types returned to only ComputationalTool and Dataset #1

Closed flaneuse closed 2 years ago

flaneuse commented 2 years ago

Within the NIAID Data Ecosystem API, add a custom QueryBuilder to filter out any records where @type is not Dataset or ComputationalTool. This will be the equivalent of running this query by default on every single query, before the user-specified query is run.

NOTE: we should ensure that all Software or SoftwareSourceCode types are converted to ComputationalTool within the individual crawling scripts.

Examples: https://github.com/data2health/resource-discovery-api/blob/main/web/pipeline.py https://github.com/biothings/mygene.info/blob/master/src/web/pipeline/build.py https://docs.biothings.io/en/latest/tutorial/web.html

jal347 commented 2 years ago

Other examples: https://github.com/SmartAPI/smartAPI/blob/0.10.x/src/pipeline.py