Is your feature request related to a problem? Please describe.
The built-in normalize and get_words work for the English language. But they might not for other languages.
Maybe users should be able to override these functions.
Describe the solution you'd like
An option to provide our own functions. Maybe take advantage of PyYAML Python tags:
normalize: !!python/name: module.function
Describe alternatives you've considered
Natively support multiple languages. Use smarter algorithm to split sentences, see #3.
Is your feature request related to a problem? Please describe. The built-in
normalize
andget_words
work for the English language. But they might not for other languages. Maybe users should be able to override these functions.Describe the solution you'd like An option to provide our own functions. Maybe take advantage of PyYAML Python tags:
Describe alternatives you've considered Natively support multiple languages. Use smarter algorithm to split sentences, see #3.
Additional context /