Open rmarronnier opened 5 years ago
The self.tokenize_and_stem method successively stems each element of the tokens array.
self.tokenize_and_stem
tokens
Maybe it could benefit from using fibers ?
@watzon : What do you think ? I can investigate and prepare a PR if you want.
Might be worth investigating
watzon
commented
5 years ago watzon
commented
5 years ago
The
self.tokenize_and_stemmethod successively stems each element of thetokensarray.Maybe it could benefit from using fibers ?
@watzon : What do you think ? I can investigate and prepare a PR if you want.