-
I would like to train the network with my own quantizer, it is possible to deploy such a model onto the board?
The weights of the network are quantized in low precision but stored in fp32. All the mo…
-
## Description
what is the right way to calibrate a hybrid quantization model ？
i built my tensorrt engine from ONNX model by the sub code, i selected the ``` class Calibrator(trt.IInt8EntropyCa…
-
The test suite keeps failing trying to download these files.
The size of these things is going to impact us at scale.
The size of the model is going to make deployment by PyPi problematic and we m…
-
-
你好，在google 的一篇论文Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference提到：关于add量化时不进行特别的操作，只是在部署时需要将其放缩到同一尺度下进行运算；关于concatenation拼接操作，需要限制拼接模块的输入输出都在同一尺度下。请问关于这两个操作…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [ x] I am using the latest TensorFlow Model Garden release and TensorFlow 2.
- [x ] I am reporti…
-
今取り組んでることとか課題とかのTODO List
- [ ] Docgen周りのリファクタリング (気が向いたら)
- [ ] metal backend
- [ ] cl-waffe2/nn -> generic
- [ ] Stable Diffusion Inference
# Environments / Backends
- [ ] Testing on CCL…
-
### 💡 Your Question
Hi,
I am just checking, I see in the provided results that Yolo-NAS-L does not suffer much reduction in performance going to Yolo-NAS-INT8-L. Can I check what exactly is meant …
-
When performing Resnet18 PTQ using TRT-modelopt, I encountered the following issue when compiling the model with TRT.
First off, I started with a pretrained resnet18 from torchvision. I replaced t…
-
First,I tried the quantization function in mnist, and it works well.
Then,I tried the quantization function on the SSD provided in caffe-jacinto-models and the original SSD.
Both of them failed with…