-
### 问题确认 Search before asking
- [X] 我已经搜索过问题,但是没有找到解答。I have searched the question and found no related answer.
### 请提出你的问题 Please ask your question
solov2怎样进行模型压缩,或者tensorrt加速?
参照paddleslim里面的…
-
### System Info
- GPU (Nvidia GeForce RTX 4070 Ti)
- CPU 13th Gen Intel(R) Core(TM) i5-13600KF
- 32 GB RAM
- 1TB SSD
- OS Windows 11
Package versions:
- TensorRT version 9.2.0.post12.dev5
…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### Ultralytics YOLO Component
_No …
-
![image](https://user-images.githubusercontent.com/18310166/89138548-87d19680-d56e-11ea-99f5-156156ff02e5.png)
-
version : tensorrt 7.2 、 onnx-tensorrt7.2
I use the onnx-tensorrt command to parser yolov5
"auto parser = UniquePtr(nvonnxparser::createParser(*network, gLogger.getTRTLogger()));"
yolov5 ca…
-
### System Info
- CPU architecture: `x86_64`
- GPU: NVIDIA H100 80GB
- TensorRT-LLM: `v0.8.0` (docker build via `make -C docker release_build CUDA_ARCHS="90-real"`) and `0.9.0.dev2024032600`
- Tri…
bprus updated
3 months ago
-
### System Info
GPU: rtx8000
Diver version: 525.85.05
Cuda version: 12.0
Syetem: ubuntu20.04
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own mod…
-
The inference speed of the int 8 quantization version of SDXL is much slower than that of fp16. I am runing trt9.3 sdxl demo and here is the result. (I changed shape to 768x1344 manually)
fp16 : pyt…
-
### Search before asking
- [X] I have searched the YOLOv5 [issues](https://github.com/ultralytics/yolov5/issues) and found no similar feature requests.
### Description
Exporting my model in…
-
### Describe the issue
Hello,
I'm trying to quantize an ONNX model to INT8 using the ONNX Runtime tools provided [here](https://github.com/microsoft/onnxruntime/blob/main/onnxruntime/python/tools/…