Closed OfirArviv closed 4 years ago
Thanks for catching, that's what happens when you port from Perl and don't think about Python .match vs. .search behavior. I think there might be another bug in there, so take a look at the repo again in a little bit if you're using whitespace_tokenize.
Bug: m is none (in line 180) due to the use of search and then match. Search match a the expression in the entire string, match in the beginning of the string.
This seems to be the desired behavior. But need confirmation.