nestauk / dap_aria_mapping

Mapping technology innovation to support The Advanced Research and Innovation Agency (ARIA)

MIT License

1 stars 0 forks source link

55 docs with topics #56

Closed emily-bicks closed 1 year ago

emily-bicks commented 1 year ago

Description

Adds pipeline to tag documents with topics from a taxonomy

Fixes #55

Modifies 3 scripts:

getters/taxonomies: changes s3 file path for cooccurrence taxonomy
getters/openalex: adds getter to fetch labeled openalex data
getters/patents: adds getter to fetch labeled patents data

Adds 1 script:

pipeline/label_docs_with_taxonomy.py: labels documents with taxonomy labels at all levels using a specified taxonomy and saves outputs either to s3 (default) or locally

ampudia19 commented 1 year ago

Fixes look good, merge away :)