Add optional preprocessing pipelines

INCATools / ontology-access-kit

Ontology Access Kit: A python library and command line application for working with ontologies

Apache License 2.0

110 stars 24 forks source link

Open hrshdhgd opened 1 year ago

hrshdhgd commented 1 year ago

roman numerals: A function call to convert arabic to Roman numerals (or maybe vice versa? )
stop word removal: similar to --exclude-tokens implemented in PR here
plural: I think the Lemmatization pipeline already take scare of this?

cmungall commented 1 year ago

roman numerals can be covered by synonymizer?

matentzn commented 1 year ago

Yes, but not easily: you will need one rule per numeral? Or are you thinking an extension to synonymiser?