Calculate sentence-level and corpus-level BLEU with tokenizer flores101(or flores200) on GPU

mjpost / sacrebleu

Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons

Apache License 2.0

1.03k stars 162 forks source link

Calculate sentence-level and corpus-level BLEU with tokenizer flores101(or flores200) on GPU #227

Closed ElizabethUniverse closed 1 year ago

ElizabethUniverse commented 1 year ago

Hello, I'm Liza Is it possible to calculate sentence-level BLEU scores with tokenizer flores101 on GPU? I think it would be great, because it will saves a lot of time. Currently sentence_bleu calculates 1000 scores in 1 minute, and it would be greate to speed up this. Thank you a lot!

BramVanroy commented 1 year ago

I'd suggest to instead parallellize your code over multiple cores. GPU does not make much sense here.

ozancaglayan commented 1 year ago

Hello,

Unfortunately GPU would not be very helpful in this case and there are no plans to add GPU support to sacreBLEU.

Thanks!