Closed alexei-gl closed 5 years ago
New options implemented: -T strict tokenization (treat tokenization discrepancies as fatal errors) -S ignore sentences mismatch (continue evaluate even is sentences mismatch) Some bugs fixed along the way.
New options implemented: -T strict tokenization (treat tokenization discrepancies as fatal errors) -S ignore sentences mismatch (continue evaluate even is sentences mismatch) Some bugs fixed along the way.