-
### Search before asking
- [X] I have searched the YOLOv5 [issues](https://github.com/ultralytics/yolov5/issues) and found no similar bug report.
### YOLOv5 Component
Export
### Bug
I'm trying t…
-
## Description
Hi, guys.
After converting the onnx to the trt engine with the link below,
The inference time is 5ms in trt8.2.3 and 80ms in trt8.4.3.
## Environment
**TensorRT Version**: …
-
When I export my yolov7.onnx file with the following command
`python3 ./export.py --onnx ../model/yolov7.onnx --engine model.trt -p int8 -v --calib_input ../data/images/ --calib_batch_size 256`
…
-
## Description
I used the pytorch_quantization toolkit to convert the Centerpoint RPN part in mmdetection3d in order to get int8 model, and I was able to successfully export the pytorch model to onnx…
-
When I convert .pth to .engine model on the windows10 system. It successfully converted .onnx, but failed trt ,with an error occured as "Error Code 2: Internal Error (Assertion cublasStatus == CUBLAS_…
-
## ❓ Question
I'm trying to run a pretrained resnet50 model from torch.torchvision.models. enabled_precisions is set to torch.half.
Each time I load the same resnet50 torchscript, using the same i…
-
Hi,
I was trying to use FP16 and INT8.
I understand this is how you prepare a FP32 model.
```
model = onnx.load("/path/to/model.onnx")
engine = backend.prepare(model, device='CUDA:1')
inpu…
-
### Checklist
- [X] I have searched related issues but cannot get the expected help.
- [X] 2. I have read the [FAQ documentation](https://github.com/open-mmlab/mmdeploy/blob/master/docs/en/faq.md) bu…
-
https://github.com/PaddlePaddle/PaddleDetection/issues/5719#issue-1206059590
延续上面的问题
换了ppdet2.2/2.3,推理过程分别使用了inference benchmark官方github提供量化导出模型和自己训练的模型,fp16和fp32都可以正常推理,只有int8不行。
训练过程中确定使用了s…
-
2022-01-16 13:13:51 [INFO] Use GPU
2022-01-16 13:13:51 [INFO] Use TRT
2022-01-16 13:13:51 [INFO] Use manual set dynamic shape
Traceback (most recent call last):
File "deploy/python/infer.py", li…