-
I wrote my code with tensorflow 2.0, some of my code used tf.compat.v1, I'm trying to do quantization aware training for my model, however, I cannot find any functions except keras related quantizatio…
-
### 💡 Your Question
Hi,
I am just checking, I see in the provided results that Yolo-NAS-L does not suffer much reduction in performance going to Yolo-NAS-INT8-L. Can I check what exactly is meant …
lpkoh updated
10 months ago
-
**Describe the Issue**
Activity Regularizer not working with quantization aware training (QAT). TypeError: An op outside of the function building code is being passed a "Graph" tensor.
**System in…
-
Hello,
I am interested in using your algorithm to train a model without utilizing Sensitivity Aware and vector quantization, but instead focusing on using Morton sorting and compression, and then s…
-
hello, when I running the example quantization aware training or range learning, the top 1 accuracy decreases to 0.1 and keeping unchanged. Did anyone meet this problem?
-
# Model Request
### Which model would you like to see in the model zoo?
A quantized MobileNet (doesn't matter which version) could be fine. TensorFlow has published end to end quantized [MobileNet…
-
Hello,
Firstly, thank you for your work on this repository. The implementation of Quantization Aware Training (QAT) and Post Training Quantization (PTQ) is very helpful.
I've been trying to appl…
-
### 🐛 Describe the bug
Hello,
I am running llama3-70b and mixtral with VLLM on a bunch of different kinds of machines. I encountered wildly different quality performance on A10 GPUs vs A100/H…
-
Review of *Guide to Quantization and Quantization Aware Training using the TensorFlow Model Optimization Toolkit*
> TF's model optimization Toolkit (TFMOT) contains tools that you can use to quanti…
-