If you use a batch size that is not evenly divisible by the number of workers available the remainder of the batch is not generated. With 4 workers and a batch size of 25 you should see a generation task like 7/6/6/6 instead it does 6/6/6/6 and drops the remaining batch count.
papuSpartan
commented
1 year ago
If you use a batch size that is not evenly divisible by the number of workers available the remainder of the batch is not generated. With 4 workers and a batch size of 25 you should see a generation task like 7/6/6/6 instead it does 6/6/6/6 and drops the remaining batch count.