-
Not an issue, just wanted to let you guys know that your VAE takes very well to quantization.
Post-encoding, I quantized each channel to one of 16 (4-bit) (or even 8 (3-bit), but a bit more visual lo…
-
## **Summary**
This is a design discussion RFC for contributing some device-agnostic compression algorithms, like the post training quantization(QDQ quant format) and structural sparsity supported …
-
Hello, I am trying to implement PTQ(Post training quantization).
Among them, layer fusion is essential to proceed with static quantization.
When using the E2E conformer model of espnet1, conv, line…
-
### Prerequisites
- [X] I have read the [documentation](https://hf.co/docs/autotrain).
- [X] I have checked other issues for similar problems.
### Backend
Colab
### Interface Used
CLI
### CLI Co…
-
Hi! Following on from the issue https://github.com/oneapi-src/oneDNN/issues/1864, I have been doing some further investigation and it looks like it's relatively straightforward to add quantized bias b…
-
### Summary
Last year, we released [pytorch-labs/torchao](https://github.com/pytorch-labs/ao) to provide acceleration of Generative AI models using native PyTorch techniques. Torchao added support …
-
For support and discussions, please use our [Discourse forums](https://discourse.mozilla.org/c/deep-speech).
If you've found a bug, or have a feature request, then please create an issue with the f…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am using the latest TensorFlow Model Garden release and TensorFlow 2.
- [x] I am reporting…
-
**System information**
TensorFlow version (you are using): TF 2.13.0
Are you willing to contribute it (Yes/No): No
Describe the feature and the current behavior/state.
Dear TF developers, I'm …
-
Review of *Guide to Quantization and Quantization Aware Training using the TensorFlow Model Optimization Toolkit*
> TF's model optimization Toolkit (TFMOT) contains tools that you can use to quanti…