-
## Bug Description
When fallback is encountered, the torchscript may contain `.` in the name of parameters, e.g., `x.1` and `input.1`. Such torchscript models, after saved to disk, cannot be loadeā¦
-
## Description
I use the [quantization toolkit](https://github.com/NVIDIA/TensorRT/tree/main/tools/pytorch-quantization) to quantize my model.
but TensorRT threw the exceptions when convert ā¦
twmht updated
2 years ago
-
after the model is converted into .trt we want to do inference on video.
-
**What's the issue, what's expected?**:
sb deploy -f local.ini
> TASK [Copying Context] *********************************************************
> fatal: [localhost]: FAILED! => {"msg": "Failed ā¦
-
## Description
According to a presentation material from 2017 ([8-bit Inference with TensorRT](https://on-demand.gputechconf.com/gtc/2017/presentation/s7310-8-bit-inference-with-tensorrt.pdf)) someā¦
-
## Description
Hello, I try to run PTQ-int8 use pytorch-quantization and convert the model into onnx and than tensorrt.
The calibration and torch.onnx.export works correct and the output onnx mā¦
-
Trtexec works fine without specifying a int8 cache file, but throws a error when loading int8 cache file.
**/usr/src/tensorrt/bin/trtexec --onnx=erfnet.onnx --int8 --saveEngine=erf_int8.engine --ā¦
-
I have converted the ResNet50 to int8 using ResNet50 calibration cache. Although there has been an increase in inference speed, I'm not able to quantify the accuracy. Is there a Python code to evaluatā¦
-
```
from mmdeploy.apis import torch2onnx
from mmdeploy.apis.tensorrt import onnx2tensorrt
from mmdeploy.backend.sdk.export_info import export2SDK
import os
img = r"F:/MM/2048CS/Image_2022062416ā¦
-
I convert Swin-Transformer from Pytorch to ONNX and TensorRT and got slow speed:
Pytorch: 0.6s
TensorRT:0.59s
ONNX: 0.92s
Here is my configure:
```
_base_ = [
'../_base_/base_instance-seg_dā¦