search

cyrusbehr / tensorrt-cpp-api

TensorRT C++ API Tutorial
MIT License
543 stars 66 forks source link

support cuda toolkit 11.7 and driver 12.1 #45

Closed sammilei closed 5 months ago

sammilei commented 5 months ago

Thanks for the code base! I was able to run it with cuda toolkit 12.1. However, I would need to use it on 11.7. TensorRT-8.6.1.6 requests these lib in version 12. I also tried to soft link these to 11 but the it didn't get through.

libcublas.so.12 => not found
libcublasLt.so.12 => not found

I saw your previous version uses TensorRT-8.2.1.8 but that is for up to cuda 11.5.

Thank you in advance for any suggestions!

cyrusbehr commented 5 months ago

I'm confused about your question. You can download TensorRT 8.6 for CUDA 11.x. That version does not require CUDA 12.

image

cyrusbehr commented 5 months ago

It could be something with your environment. I don't have CUDA 12 installed on my system and it works fine.

sammilei commented 5 months ago

Thanks! Can you show what driver version do you use?

sammilei commented 5 months ago

I solved the problem. I removed the nvidia-tensorrt and reinstalled with cuda 11.7. I started with 12.1 as toolkit for the nvidia-tensorrt.

cyrusbehr commented 5 months ago

I assumed that was the issue. Glad you resolved it.