Default to `bf16` - Githubissues

unum-cloud / usearch

Fast Open-Source Search & Clustering engine × for Vectors & 🔜 Strings × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍

https://unum-cloud.github.io/usearch/

Apache License 2.0

2.27k stars 143 forks source link

Default to `bf16` #465

Closed ashvardanian closed 3 months ago

ashvardanian commented 3 months ago

The new default behavior is to use bf16 when constructing new indices on modern CPUs. This should positively affect both throughput and recall compared to f16.