-
## Description
When I convert a model to int8 quantized model using existing calibration cache file (just generated in last run), there is "Segmentation fault" error as shown in the image below. Bu…
-
### Checklist
- [X] I have searched related issues but cannot get the expected help.
- [X] 2. I have read the [FAQ documentation](https://github.com/open-mmlab/mmdeploy/blob/master/docs/en/faq.md) bu…
-
-
### 🐛 Describe the bug
I'm trying to convert a resnet18 to TensorRT. It works fine when setting `enabled_precisions` to `torch.float` and to `torch.float16`. It doesn't work with `torch.int8`.
`…
domef updated
2 years ago
-
Hi there,
I am following the instructions in your google colab notebook ([here](https://github.com/Linaom1214/TensorRT-For-YOLO-Series/blob/main/Examples.ipynb)).
I start by downloading the mode…
-
## Description
The official example does not work with INT8, but works well with FP32 & FP16.
My kick off command :
```python
python3 build_engine.py \
--onnx "/home/hailong.ma/convert_tools/…
-
本机环境CUDA11.3 CUDNN 8.4.1.50 TensorRT-8.4.1.5
python3.8
torch 1.12.0+cu113
torchaudio 0.12.0+cu113
torchvision 0.13.0+cu113
onnxruntime 1.12.0
onnxr…
-
run eval.py:
```
python eval.py --trained_model=../Downloads/yolact_edge_54_800000.pth --score_threshold=0.8 --top_k=100 --image=test_Color.jpg --use_tensorrt_safe_mode
Config not specified. Parse…
-
## Description
### For fp16 (trt_log_level: trt.Logger.INFO)
2022-09-08 17:36:02,762 - mmdeploy - INFO - Start pipeline mmdeploy.backend.tensorrt.onnx2tensorrt.onnx2tensorrt in subprocess
2022-…
-
(InvalidArgument) Pass tensorrt_subgraph_pass has not been registered. Please use the paddle inference library compiled with tensorrt or disable the tensorrt engine in inference configuration!