search

NVIDIA / TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
https://developer.nvidia.com/tensorrt
Apache License 2.0
10.87k stars 2.14k forks source link

dynamic shape with stepsize #4247

Closed linkedqueue closed 2 weeks ago

linkedqueue commented 2 weeks ago

Hi, we get a problem where a torch model only support image shapes which are multiple of 16, and the input shape is dynamic. But tensorrt dynamic shape only support min, opt and max, and it seems to have a step-size of 1 in the range of [min,max], which would cause the illegal input for my network. I wonder how to deal with it, i search the nvidia document and google, no answer. Any suggestions? Thanks a lot

lix19937 commented 2 weeks ago

Can you upload the dynamic onnx ?

linkedqueue commented 2 weeks ago

Can you upload the dynamic onnx ?

Hi, I solve it by using shape operator in onnx，thanks for the advice.