-
### Community Note
* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the…
bflad updated
1 month ago
-
Hi,
Is there any random number involved in the quantization process except the random value in stochastic rounding scheme?
I ask because I noticed that if I turn on quantization and feed a batch…
-
https://tensorflow.google.cn/lite/performance/quantization_spec
from this document we can see the post-training quantization do asymmetric quantization for activations, do symmetric quantization for …
-
Hi:
I tried QAT on a model and exported the encodings. Then, I used the qnn-onnx-converter with --quantization_overrides and --input_list trying to put min/max/scale value after QAT into the converte…
-
## Description
## Environment
**TensorRT Version**: 8.5
**NVIDIA GPU**: Jetson Orin Nano developer kit 8gb
**NVIDIA Driver Version**:
**CUDA Version**:11.4
**CUDNN Version…
-
Hi,
Thanks for the great work!
Have your team tried QAT/PTQ int8 quantization on star operations? After all, the networks are usually quantized before deploying in real production.
Thanks for…
-
Hello,
I converted one of my models from tflite to rknn with rknn-toolkit2@2.1.0.
However, when I try to infer it in rv1106 I get this error:
> E RKNN: unsupport cpu Transpose op, op name: Transp…
-
Hello,
I'm having trouble using XportDNN tool for quantization of an VGG-16 custom model. We retrained the original VGG-16 Network with our own dataset. The Prototex file looks pretty similar t…
-
I am accelerating a custom pytorch network using Vitis-AI. After following the steps below the model is quantized and the .xmodel is compiled, however the accuracy of the model takes a huge hit going …
-
**Has anyone tested per-channel quantization on YOLOv2?**
The report [http://cs231n.stanford.edu/reports/2017/pdfs/808.pdf]() shows, more than 15% mAP drop on YOLOv2 PASCAL VOC 2007 testset, when u…