-
The developed model needs to be quantizated before compling on the edge TPU or coral
-
Hi @TropComplique ,
Have you ever tried to quantize the model by Quantization-aware training? If so, how is the result?
I am trying to create_training_graph in model.py [at line 72](https://gith…
-
- I am able to apply Object detection with Mask-RCNN using detectron2 and getting good results for my custom dataset. but when i try to use the same architecture with d2go to create a mobile deployabl…
-
Thanks for your great work in advance!
I have some questions about the following description:
https://github.com/snowkylin/tensorflow-handbook/blob/3b4abc38f8dfdaba32258b1aa1f726cc95bb7a82/docs/z…
-
Can activation quantization also be introduced in Hqq as well? Or if not, is there any process/method can further quantize the activation after using Hqq to quantize the weight?
-
RKNN Toolkit 1.7.0 的文档里提到,
> 从 1.7.0 版本开始,RKNN Toolkit 支持加载 ONNX 量化模型。目前支持的量化模型是通过 onnxruntime(版本为 1.5.0 至 1.5.2 之间)的 static quantization 方法得到的。
文档里的链接现在已经失效,目前 onnxruntime 对应量化章节的 url 是 https:/…
-
### Describe the problem
We have a model that has accuracy issue with depthwiseconv, I attached two models, one is right before the depthwise conv node, the result of DSP and CPU has small differ…
-
**System information**
- TensorFlow version (you are using): tf-nightly
- Are you willing to contribute it (Yes/No): No, this has a broader impact in the TFLite conversion & quantization API design.…
-
### Summary
Last year, we released [pytorch-labs/torchao](https://github.com/pytorch-labs/ao) to provide acceleration of Generative AI models using native PyTorch techniques. Torchao added support …
-
As mentioned in https://github.com/microsoft/onnxruntime/pull/7033 ORT added support for converting QDQ internally into the quantized equivalent. Since this is done via graph transform, it should work…