-
### Description
### Acceptance criteria
### Context
-
Hi,
Me and my friend have been reading the code for a while and we were looking for some ideas for contributing.
@ankane, you mentioned product quantization in #27. Is this still an issue? We would …
-
In 2013, there are two important improvements of Product Quantization. Optimized Product Quantization non-parametric solution [2] was equivalent to the Cartesian k-means [1] and performed better than …
-
### Description
There have been multiple discussions around supporting higher vector quantization levels (e.g. more than scalar quantization can provide).
We (elastic) have been doing some researc…
-
### Description of the bug:
Hello,
I'm encountering an issue when trying to export a model to tflite with quantization. It appears that the tensor shapes are being altered incorrectly somewher…
-
Currently CAGRA-Q does quantization after building the graph. This can certainly improve search performance. But it could be even better to improve build performance if distance computations while bui…
-
## Introduction
This document outlines a high level proposal for providing efficient, yet easy to use k-NN in OpenSearch in low-memory environments. Many more details to come in individual compone…
-
## 🐛 Bug
I followed instructions to use the Iterative Product Quantization provided here: (https://github.com/pytorch/fairseq/tree/master/examples/quant_noise)
I succeeded to create a transformer …
-
## Description
I am trying to figure out if TensoRT and the `pytorch_quantization` module support post-training quantization for vision transformers.
The following piece of code follows the `pyt…
-
Achieving Faster Open-Source Llama3 Serving with SGLang Runtime (vs. TensorRT-LLM, vLLM)
https://lmsys.org/blog/2024-07-25-sglang-llama3/
gemma 2 update
https://huggingface.co/google/gemma-2-2b
…