Open davidmrau opened 3 months ago
The stopping criteria only works for batch size = 1. I don't get an error, but no stopping criteria is applied at all for batch size > 1
Hi, can you try the transformers version specified in the docker file? I can not reproduce this error on my side.
The stopping criteria only works for batch size = 1. I don't get an error, but no stopping criteria is applied at all for batch size > 1