-
## Description
Say we have an onnx model defined as follows:
```
class MyModel(torch.nn.Module):
def forward(self, x):
x = x + 1
return x
model = MyModel().eval()
dummy =…
-
due to a bug in torch_tensorrt: https://github.com/pytorch/TensorRT/issues/1465#issuecomment-1347630727
One requires 1.3.0, but kaggle has only support for python3.7. This leads to a syntax error.…
-
### Checklist
- [X] I have searched related issues but cannot get the expected help.
- [X] 2. I have read the [FAQ documentation](https://github.com/open-mmlab/mmdeploy/tree/main/docs/en/faq.md) but …
-
Hello, I'm trying to do int8 calibration on an ONNX model with C++ API. I see there are samples of INT8 with caffemodel and ONNX MNIST. But how to quantize an ONNX model? Is there any samples or guida…
-
## Description
I am running inference on a model that I have build from python code through TensorRT API. All the layers are forced to run convolution in INT8 precision.
The minimalistic networks …
-
Hello every one
I allow myself to ask for your help, I followed the tutorial to switch to int8 everything sucked well to create not without difficulty but I do have a model model_b1_gpu0_int8.engi…
-
## Description
Hello，I'm trying to convert a quantized onnx model (with QDQ nodes) and convert it to tensorrt int8 model.
The converted trt int8 model, however, has a huge performance drop, the outp…
-
hello, i am using tensorrt8.3 to convert my onnx model to int8 model,
the special thing is that my onnx model contains a custom DCNV2 plugin, The python implementation of DCNV2 is based on the follow…
-
It seems that the detection results are relatively poor. You can see that there is missed pedestrian in the back-left image. And the 3d box for the car in the back-image is inaccurate.
Besides, run…
-
### Checklist
- [X] I have searched related issues but cannot get the expected help.
- [X] 2. I have read the [FAQ documentation](https://github.com/open-mmlab/mmdeploy/tree/main/docs/en/faq.md) but …