search

michigan-com / summarizer

Python text summarizer
https://pypi.python.org/pypi/summarizer
MIT License
31 stars 4 forks source link

Period is getting removed during tokenization? #4

Closed neurosnap closed 8 years ago

neurosnap commented 8 years ago

https://api.michigan.com/v1/article/75995706/

Goaltender Petr Mrazek turned aside 15 Ovechkin shots the last time the teams played (Nov. 10), a 1-0 Red Wings victory.\nThere’s not much of a plan or strategy, said Mrazek, other than being ready for the challenge.

turns into:

Goaltender Petr Mrazek turned aside 15 Ovechkin shots the last time the teams played (Nov. 10), a 1-0 Red Wings victory There’s not much of a plan or strategy, said Mrazek, other than being ready for the challenge.

migreva commented 8 years ago

https://www.youtube.com/watch?v=UtVjRG7PB_4&feature=youtu.be&t=9s

neurosnap commented 8 years ago

Haven't seen this since, can't replicate in summarizer, going to close issue for now.