facebookresearch / fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
MIT License
29.86k stars 6.32k forks source link

fairseq-generate #5351

Open chaos130 opened 9 months ago

chaos130 commented 9 months ago

My only question is that faireseq-translate can not translate all input sentence. The more details is represented in follow picture.

image
iknunyants commented 8 months ago

I managed to solve it by using --required-batch-size-multiple 1 option, while the default one is 8. That's why you get 872 (109 * 8).