GateNLP / gateplugin-Twitter

A suite of tools designed for processing Tweets

GNU Lesser General Public License v3.0

1 stars 0 forks source link

Closed greenwoodma closed 5 years ago

greenwoodma commented 5 years ago

It appears the some hashtags can send the hashtag tokenizer into an infinite loop. For example

hahahahahahahahahahahahahahaahahahahahahahahaahahaahhahaahahahahahahahahahahahahahahahah

greenwoodma commented 5 years ago

at least add support for interrupting into the inner loop