https://github.com/rigatoni/linguine-python/blob/dev/linguine/transaction.py
Looking mainly in lines 55-75 of this file, Cleanups are not checked for if they are in the list of token-based operations, and they always work on the corpus rather than the tokenized corpus. The code needs to be changed to fix that issue.
https://github.com/rigatoni/linguine-python/blob/dev/linguine/transaction.py Looking mainly in lines 55-75 of this file, Cleanups are not checked for if they are in the list of token-based operations, and they always work on the corpus rather than the tokenized corpus. The code needs to be changed to fix that issue.