Update tokenizer_spm.py to issue warning message only when 'spm' is used

mjpost / sacrebleu

Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons

Apache License 2.0

1.03k stars 162 forks source link

Closed Pogayo closed 1 year ago

Pogayo commented 1 year ago

Fixes issue 219 by printing the warning only when 'spm' is used. https://github.com/mjpost/sacrebleu/issues/219

martinpopel commented 1 year ago

Thanks a lot.