search

THU-MIG / yolov10

YOLOv10: Real-Time End-to-End Object Detection [NeurIPS 2024]
https://arxiv.org/abs/2405.14458
GNU Affero General Public License v3.0
10k stars 992 forks source link

int8 quantization support #131

Open qiangxinglin opened 5 months ago

qiangxinglin commented 5 months ago

Firstly, thanks to all of you for the bravo project!

Currently, the model seems like does not support int8 quantization. Any plan on it?

jameslahm commented 5 months ago

Thanks for your interest! Does https://github.com/openvinotoolkit/openvino_notebooks/blob/0ba3c0211bcd49aa860369feddffdf7273a73c64/notebooks/yolov10-optimization/yolov10-optimization.ipynb help?

yoloyash commented 5 months ago

Thanks for your interest! Does https://github.com/openvinotoolkit/openvino_notebooks/blob/0ba3c0211bcd49aa860369feddffdf7273a73c64/notebooks/yolov10-optimization/yolov10-optimization.ipynb help?

Hi, this is post-training quantization (ptq). Is there any source for quantization-aware training (qat)?