asg017 / sqlite-vec

A vector search SQLite extension that runs anywhere!
Apache License 2.0
4.21k stars 133 forks source link

`float16` and `bfloat16` support #27

Open asg017 opened 5 months ago

asg017 commented 5 months ago
create virtual table vec_movies using vec0(
  synopsis_embedding float16[768]
);

create virtual table vec_movies using vec0(
  synopsis_embedding bfloat16[768]
);

Also vec_quantize_float16() / vec_quantize_bfloat16()?

maruel commented 3 months ago

bfloat16 would be awesome for storage efficiency.