-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and f…
-
Hi all,
I have been trying to apply **post-training-quantization** to a custom vision model (pretrained vgg16 model) which I have already finetuned using "xpu" (Intel GPU Max Series). I have saved …
-
General approach:
- FP training as a reference baseline / target
- PTQ as a baseline for quantization
- QAT results
- (optional) QAT starting from the FP checkpoint (i.e., finetuning)
- ana…
-
Hi @william-silversmith ,
I have a situation where my igneous execution is stuck at one point and does not seem to progress. And I don't see any notable logs or outputs. Would you be able to guid…
-
## Description
what is the right way to calibrate a hybrid quantization model ?
i built my tensorrt engine from ONNX model by the sub code, i selected the ``` class Calibrator(trt.IInt8EntropyCa…
-
Hi, I was investigating why HubSpot pageviews are not getting received by my HubSpot. When I install the HubSpot tracking script directly on the front-end, pageviews events are sent to `https://track.…
-
Thanks for the excellent work!
The paper says "QuIP# is also the first PTQ method where 3-bit models scale better than 4-bit models.", but the experiment results shown in the Table 2,3 and 4 are …
-
Are there any runnable demos of using Sparse-QAT/PTQ (2:4) to accelerate inference, such as applying PTQ to a 2:4 sparse LLaMA for inference acceleration? I am curious about the potential speedup rati…
-
## Example Workflow
- Run slash command > opens dialogue/modal > fill out form with event format, time, location, notes, links to store website, links to event rules or handbooks.
- Notify groups of …
-
**请将下面信息填写完整,便于我们快速解决问题,谢谢!**
**问题描述**
PaddleOCR rec_ppocr_v3 模型进行PTQ量化,导出inference.pdiparams .pdmodel 进行测试是正确的
推理命令
python tools/infer/predict_rec.py --use_gpu=False --use_onnx=True --rec_model…
CtSTS updated
2 months ago