search

ceccocats / tkDNN

Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms
GNU General Public License v2.0
717 stars 209 forks source link

[RUNNING ON SCALEDYOLOV4 TENSORRT] #201

Closed bobbilichandu closed 2 years ago

bobbilichandu commented 3 years ago

Hardware: GPU: Tesla T4 Software: tensorrt-7.1.3 cudnn - 8 I was wondering if I already have a tensorrt engine build, how to use tkDNN to fast up my inference. Currently we are facing an issue while using scaledyolov4, inference is linear with batching, so we want to reduce inference further. I already have tensorrt engine built for 1280x1280 for batchsize 1,4,16. I was wondering how to use tkDNN along with it. TIY!

mive93 commented 3 years ago

Hi @chandu1263, I don't get the question, what do you want to do?

mive93 commented 2 years ago

Closing for inactivity. Feel free to reopen.