-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussi…
-
### Search before asking
- [X] I have searched the YOLOv5 [issues](https://github.com/ultralytics/yolov5/issues) and found no similar feature requests.
### Description
Exporting my model in…
-
### Description of the bug:
I'm trying to understand how to pass quantization config to convert function of ai_edge_torch. But whenever I pass the representative dataset, it causes the colab noteboo…
-
## Description
A clear and concise description of the issue.
## Environment
**TensorRT Version**: 8.5
**NVIDIA GPU**: Jetson Orin Nano
**CUDA Version**: 11.4
**CUDNN Version*…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar feature requests.
### Description
When export to TensorRT…
-
I was looking at a past issue (see below) regarding how to set-up my custom dataset for INT8 calibration. I was just wondering what subset of the dataset indicated in the YAML file is used for calibra…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### Ultralytics YOLO Component
Expo…
-
### 🚀 The feature, motivation and pitch
**Background:**
Fp32 arithmetic typically is avoided in the embedded (microcontroller) domain, due to tight cycle and memory constraints. Hence, sensors usu…
-
# Summary
* We (engineering at @neuralmagic) are working on support for int8 quantized activations.
* This RFC is proposing an _incremental_ approach to quantization, where the initial support for q…
-
reference: https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/blogs/quantization-in-TRT-LLM.md#performance
![image](https://github.com/user-attachments/assets/1bb20225-3eb2-4641-b5ba-f027…