I want to accelerate the inference process by predicting images in batch, how can I do it?
I read your code to know you predict images by crop it several times and concat them into an array, but that seems to slow down the process if I want to inference muti images at the same time. Can you offer me some ideas or which api should I use to make it happen?
I want to accelerate the inference process by predicting images in batch, how can I do it?
I read your code to know you predict images by crop it several times and concat them into an array, but that seems to slow down the process if I want to inference muti images at the same time. Can you offer me some ideas or which api should I use to make it happen?