Closed convergence-lab closed 11 months ago
need to fix Tokenizer.cpp:655 as follows.
- std::string pfxs(pfx.as_string()); + std::string pfxs(pfx);
Fixed in https://github.com/Helsinki-NLP/opus-fast-mosestokenizer/pull/3 / v0.0.8.4
need to fix Tokenizer.cpp:655 as follows.