Using tensorrt version 7.1.3.4,
with batch size 8, yolov4csp takes upto 220ms for 1280x1280 images on a Tesla T4 GPU.
But with tkdnn using same version (7.1.3.4)
batchsize 8, image size 1280x1280, it is taking upto 450ms on a Tesla T4 GPU
TKDNN occupies 6GB on the GPU whereas naive TRT uses nearly 3GB
Any reason why is this the case?
Or am I doing something wrong?
Using tensorrt version 7.1.3.4, with batch size 8, yolov4csp takes upto 220ms for 1280x1280 images on a Tesla T4 GPU.
But with tkdnn using same version (7.1.3.4) batchsize 8, image size 1280x1280, it is taking upto 450ms on a Tesla T4 GPU TKDNN occupies 6GB on the GPU whereas naive TRT uses nearly 3GB Any reason why is this the case? Or am I doing something wrong?