qdrant / quantization

Apache License 2.0
6 stars 4 forks source link

Bq with u8 alignment support #25

Closed IvanPleshkov closed 5 months ago

IvanPleshkov commented 5 months ago

For multivector 128-dim alignment is too large. This PR introduces generic BQ storage with u128 and u8 alignment.

In u128 case there are no any changes for backward compatibility. In u8 case there is a flexible alignment: if dim >= 128, alignment is 128 and simd is optimized for 128-bit alignment (the same for 64 and 32).