Text surrounded by quotes seems to not get segmented?

nipunsadvilkar / pySBD

🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.

MIT License

813 stars 84 forks source link

Text surrounded by quotes seems to not get segmented? #45

Closed RuABraun closed 5 years ago

RuABraun commented 5 years ago

>>> s = '"I just love doing this sort of thing. It\'s great."'
>>> seg.segment(s)
['"I just love doing this sort of thing. It\'s great."']
>>> s = '"I phoned the \'Rape Helpline\' yesterday. They suggested I buy a balaclava."'
>>> seg.segment(s)
['"I phoned the \'Rape Helpline\' yesterday. They suggested I buy a balaclava."']

nipunsadvilkar commented 5 years ago

This is the design choice of pragmatic_segmenter Refer: https://github.com/diasks2/pragmatic_segmenter/issues/13