philterd / phileas

The PII and PHI redaction engine
https://www.philterd.ai
Apache License 2.0
16 stars 3 forks source link

Add text preprocessing options for NER filter #72

Open jzonthemtn opened 3 months ago

jzonthemtn commented 3 months ago

Add text preprocessing options for NER filter. The options should go in Philter's configuration file since they apply to the model and not to a filter profile.

jzonthemtn commented 3 months ago

Actually, all configuration should go in the filter profile. Even though the model is the same the text might be different. (And at some point the model could be specified by the filter profile.)