-
## ❓ Question
I was following [the documentation](https://pytorch.org/TensorRT/user_guide/dynamic_shapes.html#dynamic-shapes) on compiling a model with dynamic input shape. When saving the compil…
-
## ❓ Question
im able to `torch.export` and generate an ExportedProgram with no issues for my model. upon compiling with `torch_tensorrt`...
```python
ep = torch.export.load("...")
example_inpu…
-
Hi! Thanks for making this tensorrt conversion, it is really fast!!
Is there a way to run the inference on image sequence instead of single frame?
Thanks!
-
There are many different GPUs, cuda versions or platforms, so your pre-built TRT engine file can not suitable for all.
If you release the conversion script/tool/procedure, it may great help for so…
luuil updated
3 weeks ago
-
I am trying to convert the open source e5-large TF model to TensorRT. This is the model - https://huggingface.co/intfloat/multilingual-e5-large. I am getting below error
[libprotobuf FATAL external…
-
## Bug Description
when I use dynamic shape in trt, will raise error,
```
ERROR:torch_tensorrt [TensorRT Conversion Context]:ITensor::getDimensions: Error Code 4: Internal Error (Tensor [SLICE…
-
### System Info
- CPU architecture: x86_64
- Host memory: 256GB
- GPU
+ Name: NVIDIA A30
+ Memory: 24GB
- Libraries
+ TensorRT-LLM: v0.11.0
+ TensorRT: 10.1.0
+ CUDA: 12.6
+ NVID…
-
I am attempting to convert the pretrained weights of the KeepTrack model to TensorRT for inference. As I am new to TensorRT and ONNX, I would greatly appreciate any guidance or suggestions on how to s…
-
I have my own pretrained pytorch model that I want to convert to a TensorRT model (.engine), I run this python script:
import torch
from torch2trt import torch2trt
model = torch.load(‘/home/tto/h…
-
@maudzung
Hi,Maudzung, nice work! I'm trying to use TensorRT to speed up the inference. Do you have some scripts that transfer the Complex-YOLOv4-Pytorch from pytorch(pth file) to TensorRT?
Thank…