-
I am attempting to build a docker container that uses the image: nvcr.io/nvidia/l4t-tensorrt:r8.6.2-devel on a Jetson Orin
At the same time, I am trying to install onnxruntime-gpu using the followi…
-
**Information:**
- Chainner version: 0.12.5
- OS: Windows 11
**Description**
Using converted ONNX models with TensorRT executor fails due to lacking shape data information. To reproduce, convert…
-
from diffusers import StableDiffusionPipeline
pipe = StableDiffusionPipeline.from_pretrained("echarlaix/stable-diffusion-v1-5-inc-int8-dynamic").to("cpu")
# for reducing memory consumption get a…
-
### Describe the issue
During static quantization with percentile calibration, the following crash happens with onnxruntime-gpu 1.17.0:
Collecting tensor data and making histogram ...
Traceback (…
-
When performing Resnet18 PTQ using TRT-modelopt, I encountered the following issue when compiling the model with TRT.
First off, I started with a pretrained resnet18 from torchvision. I replaced t…
-
Hello,
I tried to convert model from onnx to tensorflow by CLI. Tensorflow successfully started up but there is runtime error without any details except this one:
```Traceback (most recent call last…
-
Can anyone help with this? I haven't found a related solution yet. I have almost no experience with Python, so step-by-step guidance would be greatly appreciated.
Thanks a lot!
D:\a\_work\1\s\onnxr…
-
Hey, nice work,
the dynamic batching flow is a bit broken I think
it works fine if the engine is built on one shape, but when built with
```
min_shape = (1, 360, 640) # Minimum shape with ba…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
### Describe the issue
Cannot quantize a model with quantize_dynamic. Need to quantize just to measure latency, no need to actually get good results. quantize_static works.
### To reproduce
…