search

ceccocats / tkDNN

Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms
GNU General Public License v2.0
718 stars 209 forks source link

tkDNN vs TensorRT #241

Closed elias-work closed 3 years ago

elias-work commented 3 years ago

Hopefully this isn't a silly question and it is ok to ask here, I am having a hard time finding the answer. I am looking into accelerating my yolov4 inference on desktop hardware, and currently am using TensorRT itself. I am wondering what tkDNN effectively does in addition: is it mainly for jetson boards, performance improvements over TensorRT, more supported models, etc.?

mive93 commented 3 years ago

Hi @elias-work, indeed it is what you guessed. tkDNN is an easy to use and to integrate wrapper to tensorRT to optimize custom models of NN for C++ applications.