Open jpeddicord opened 5 years ago
I think it can be by building up strings and looking backwards. Should save on some logic and extra storage; speed may be slightly improved as well.
See remove_common_tokens in preproc.rs
I think it can be by building up strings and looking backwards. Should save on some logic and extra storage; speed may be slightly improved as well.
See remove_common_tokens in preproc.rs