zerollzeng
commented
8 months ago Your onnx is invalid, it failed with onnxruntime
$ polygraphy run model.onnx --onnxrt
[I] RUNNING | Command: /home/scratch.zeroz_sw/miniconda3/bin/polygraphy run model.onnx --onnxrt
[I] onnxrt-runner-N0-01/12/24-08:07:21 | Activating and starting inference
[I] Creating ONNX-Runtime Inference Session with providers: ['CPUExecutionProvider']
Traceback (most recent call last):
File "/home/scratch.zeroz_sw/miniconda3/bin/polygraphy", line 8, in <module>
sys.exit(main())
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/tools/_main.py", line 70, in main
status = selected_tool.run(args)
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/tools/base/tool.py", line 171, in run
status = self.run_impl(args)
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/tools/run/run.py", line 228, in run_impl
exec(str(script))
File "<string>", line 21, in <module>
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/comparator/comparator.py", line 213, in run
run_results.append((runner.name, execute_runner(runner, loader_cache)))
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/comparator/comparator.py", line 98, in execute_runner
with runner as active_runner:
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/backend/base/runner.py", line 60, in __enter__
self.activate()
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/backend/base/runner.py", line 95, in activate
self.activate_impl()
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/util/util.py", line 694, in wrapped
return func(*args, **kwargs)
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/backend/onnxrt/runner.py", line 44, in activate_impl
self.sess, _ = util.invoke_if_callable(self._sess)
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/util/util.py", line 663, in invoke_if_callable
ret = func(*args, **kwargs)
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/backend/base/loader.py", line 40, in __call__
return self.call_impl(*args, **kwargs)
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/util/util.py", line 694, in wrapped
return func(*args, **kwargs)
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/polygraphy/backend/onnxrt/loader.py", line 68, in call_impl
return onnxrt.InferenceSession(model_bytes, providers=providers)
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 383, in __init__
self._create_inference_session(providers, provider_options, disabled_optimizers)
File "/home/scratch.zeroz_sw/miniconda3/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 424, in _create_inference_session
sess = C.InferenceSession(session_options, self._model_path, True, self._read_config_from_model)
onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Load model from /home/scratch.zeroz_sw/github_bug/3590/model.onnx failed:Node (/MaxPool) Op (MaxPool) [ShapeInferenceError] Attribute strides has incorrect size
peter5232
RajUpadhyay
lix19937
Environment
TensorRT Version:
NVIDIA GPU: RTX 4090
NVIDIA Driver Version: 535.129.03
CUDA Version: 11.8
CUDNN Version: 8.9.6.50
Operating System: ubuntu 22.04
Python Version (if applicable): 3.9
Tensorflow Version (if applicable):
PyTorch Version (if applicable): 1.13
Baremetal or Container (if so, version):
Relevant Files
Model link: https://www.dropbox.com/scl/fi/vzgb4iew1lvj64h6adnjt/model.onnx?rlkey=vqq56hc2t91r7b1m078ks7ycl&dl=0
Steps To Reproduce
I want to transform onnx to engine by using code
trtexec --onnx=model.onnx --saveEngine=model.trt --verbose. Then an error was reported./MaxPool: at least 5 dimensions are required for input.But I don't know why! The maxpool that reported the error is used here.