-
# Summary
* We (engineering at @neuralmagic) are working on support for int8 quantized activations.
* This RFC is proposing an _incremental_ approach to quantization, where the initial support for q…
-
I wanted to learn how product quantization works, and this repository provided excellent code to understand how it works. As I had been learning Rust for a few months now, I decided to re-write the `p…
-
PAMI 2011
[https://lear.inrialpes.fr/pubs/2011/JDS11/jegou_searching_with_quantization.pdf](https://lear.inrialpes.fr/pubs/2011/JDS11/jegou_searching_with_quantization.pdf)
论文主要有两个贡献
1. 提出了pr…
-
I'm confused with the equation (12), what means the outer product of sw and sx? The activation is per-token quantization?
-
It's possible that I'm missing something due to unfamiliarity with the codebase, but it looks to me like vpq_dataset and train_pq are collapsing all the subspaces into a single codebook. E.g. if you …
-
### System Info
```
OS:
Operating System: Ubuntu 20.04.6 LTS
Kernel: Linux 5.4.0-146-generic
Architecture: x86-64
CPU:
Architecture: x86_64
CPU op-mode(s):…
-
### Description
Based on some of the benchmarking tests that I ran from OpenSearch, there is a significant drop in recall ( appx. 0.03) for 8 bits irrespective of space type, confidence interval or…
-
One of our customer is asking if we could consider supporting the following extension:
https://github.com/timescale/pgvectorscale
Thanks
-
## 🐛 Bug
I am not able to generate the translation with a transformer model trained according to the Iterative Product Quantization instructions (https://github.com/pytorch/fairseq/tree/master/ex…
-
product quantization would be a good start