search

felixdittrich92 / OnnxTR

OnnxTR a docTR (Document Text Recognition) library Onnx pipeline wrapper - for seamless, high-performing & accessible OCR
https://github.com/mindee/doctr
Apache License 2.0
17 stars 1 forks source link

[quantization] Test 8bit quantization #7

Closed felixdittrich92 closed 2 months ago

felixdittrich92 commented 2 months ago

https://github.com/microsoft/onnxruntime/blob/main/onnxruntime/python/tools/quantization/quantize.py

And different onnxruntime optimization levels

https://onnxruntime.ai/docs/performance/model-optimizations/graph-optimizations.html

https://onnxruntime.ai/docs/performance/model-optimizations/