WormBase / ACKnowledge

Author Curation to Knowledgebases
MIT License
1 stars 1 forks source link

filter out short sentences from classifier #299

Closed draciti closed 4 months ago

draciti commented 4 months ago

https://docs.google.com/spreadsheets/d/1jED2i4fhx4xrCAQctLmy92b_otbzlJvvdWs-Sc5YmXs/edit#gid=749480811

for example sentences highlighted in yellow in tab 00065342

valearna commented 4 months ago

@draciti ready on dev and prod. I'm filtering out sentences with 20 or less characters

draciti commented 4 months ago

Excellent, tested on prod. Worked out well. Closing this, but adding to the agenda if we want to go even a little higher with the number. In the minutes: 'Valerio filtered in GROBID sentences that have less than 20 characters. Do we want to change that number to 30? E.g. extracted for WBPaper00065342: VNC, Ventral nerve cord'