Open EternalSaga opened 2 years ago
I run the model yolov5m.onnx in Nvidia V100 GPU and the inference succeeded. Will check Xavier. It seems like library path issue.
I run the model yolov5m.onnx in Nvidia V100 GPU and the inference succeeded. Will check Xavier. It seems like library path issue.
It's wired that the link path is a '�'. It's hard for me to find the linking path.
FWIW, setting engine decryption in OrtTensorRTProviderOptions
to false fixed the issue for me:
trtOpts.trt_engine_decryption_enable = false;
Using OrtTensorRTProviderOptionsV2
instead of OrtTensorRTProviderOptions
can solve this problem, as OrtTensorRTProviderOptions
is a C structure whose initialization values are mostly undefined. For specific usage, you can refer to the official example: click here for C API example.
Describe the bug When I was running yolov5 onnx modle on jetson xavier nx with onnxruntime 1.10 version, I encountererd this error.
Urgency Normal
System information
To Reproduce I checked out the onnxruntime git tag to 1.10. I don't use the latest 1.11 version because 1.11 needs tensor rt 8.2 but the tensor rt version on jetson is 8.0 at present. Apparently, the 1.11 version cannot be built successfully with the --use_tensorrt flag.
I build onnxruntime from source on jetson xavier nx, the build command is
After building, I copied all lib.so and include directory to a single folder. Then I linked these files manually to build my application.
The application reference codes and models are comes from this repo
I tried to use tensorrt instead of normal cuda inference.
After building, the application show the error as above. Furthermore, this application could under the normal cuda successfully. Expected behavior I hope the application can output inference results.
Screenshots If applicable, add screenshots to help explain your problem.
Additional context yolov5