Batch Inference

[LifeIsSoSolong]

thanks for your great work.

Your code only support inference with batchsize=1, How to modify your code to inference with batchsize>1?