add member/stages to stop words - Githubissues

BritishGeologicalSurvey / stratigraph

Network stratigraphy through text mining

GNU Lesser General Public License v3.0

4 stars 0 forks source link

add member/stages to stop words #12

Open rachelheaven opened 3 years ago

rachelheaven commented 3 years ago

Stop words list might need extending with Member and Stage

metazool commented 3 years ago

https://github.com/BritishGeologicalSurvey/stratigraph/blob/stop-more/data/found.json (on the stop-more branch) shows the effects of adding Member, Bed, Beds (generated by integration/test_linking.py and committed locally)

1071 terms identified by the NER (see https://github.com/BritishGeologicalSurvey/stratigraph/blob/stop-more/data/sort_missing_names.json) but not resolved to Linked Data URLs, this resolves 67 of them. Do the links make sense to someone who knows the domain well?