Adds an evaluation directory to entity_processing including a script to generate a validation sample and a notebook that analyses the validation sample. Contains a summary of pre- and post-processing suggestions based on entity labels.
modify's the patents pipeline query slightly to collect patents from 2007 - 2023
removed the post-processing pipeline I initially pulled from ai_genomics
Fixes # (issue)
This would close #6
Instructions for Reviewer
THE ONLY NEW SCRIPTS ARE IN ENTITY_PROCESSING/EVALUATION
If you'd like to generate the sample I was discussing,
Description
Adds an evaluation directory to entity_processing including a script to generate a validation sample and a notebook that analyses the validation sample. Contains a summary of pre- and post-processing suggestions based on entity labels.
modify's the patents pipeline query slightly to collect patents from 2007 - 2023
removed the post-processing pipeline I initially pulled from ai_genomics
Fixes # (issue)
This would close #6
Instructions for Reviewer
THE ONLY NEW SCRIPTS ARE IN ENTITY_PROCESSING/EVALUATION
If you'd like to generate the sample I was discussing,
python dap_aria_mapping/pipeline/entity_processing/evaluation/generate_validation_sample.pyI've set a random seed so can be reproducible.
Checklist:
notebooks/pre-commitand addressed any issues not automatically fixeddevREADMEs