Closed toplinuxsir closed 2 years ago
Firstly ,tkdnn doesn't support tensorrt8 yet .Secondly ,if you are using gcc 10.3 ,it likely won't work there have been issues reported on the gcc forum about gcc 10.3 not being able to compile a simple cuda program and Nvidia supports only till gcc 10.2 ,if gcc 10.3 is a must for you then you could try one of the patches mentioned here https://github.com/NVIDIA/nccl/issues/494
@perseusdg Thanks! I will test again.
TensorRT8 is now supported on tensorrt8 branch. Every model and data type is properly working.
Compile with gcc-10, tensorrt version 8.0.1 The error: