Use generators to reduce memory consumption on lengthy text

bigwhoop / sentence-breaker

Sentence boundary disambiguation (SBD) - or sentence breaking - library written in PHP.

MIT License

39 stars 6 forks source link

Closed dinamic closed 2 years ago

bcremer commented 2 years ago

Hi @dinamic,

I'm currently working on a fully lazy and generator based implementation here: https://github.com/bigwhoop/sentence-breaker/pull/13

Please feel free to try and give feedback.

bigwhoop commented 2 years ago

The implementation was finished by @bcremer and has been merged and released in version 4.