Closed HolyWu closed 2 weeks ago
Can you try specifying a dim as dynamic? like https://github.com/pytorch/TensorRT/blob/main/examples/dynamo/engine_caching_example.py#L132-L136
No issue if the model was compiled with dynamic input spec in the first place.
To Reproduce
Environment
conda
,pip
,libtorch
, source):