search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.87k stars 2.94k forks source link

trtexec works, onnxruntime failed to load #19180

Open HuaHua-Xiao opened 10 months ago

HuaHua-Xiao commented 10 months ago

Describe the issue

I can run trtexec fine, but loading trtexec's pre-built engine with ONNX Runtime gives me an error. How can I solve this? Thank you!

log

To reproduce

mask2former model

Urgency

No response

Platform

Linux

OS Version

Ubuntu 20.04.6 LTS

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

onnxruntime-linux-x64-gpu-1.16.3.tgz

ONNX Runtime API

C++

Architecture

X86

Execution Provider

TensorRT

Execution Provider Library Version

TensorRT-8.6.1.6 cuda_11.7 NVIDIA-SMI 460.39 Driver Version: 460.39 Tesla V100

chilo-ms commented 10 months ago

Could you share the whole log with us? that helps us debug. Also, if possible, could you share the pre-built engine?

HuaHua-Xiao commented 10 months ago

Could you share the whole log with us? that helps us debug. Also, if possible, could you share the pre-built engine?

Thank you. Can you e-mail me? The file is too big.