Currently I'm trying to process a set of images at once, which should result in a performance increase.
I can create the trt plan with batch sizes by setting the input like torch.zeros((BATCH_SIZE, 3, HEIGHT, WIDTH)), but it seems like this doesn't produce proper outputs?
Is there a way to use this repo with batch support?
Currently I'm trying to process a set of images at once, which should result in a performance increase.
I can create the trt plan with batch sizes by setting the input like torch.zeros((BATCH_SIZE, 3, HEIGHT, WIDTH)), but it seems like this doesn't produce proper outputs?
Is there a way to use this repo with batch support?
Thanks!