lanterndata / lantern

PostgreSQL vector database extension for building AI applications
https://lantern.dev
GNU Affero General Public License v3.0
790 stars 57 forks source link

Save and load usearch options from index header page #101

Closed var77 closed 1 year ago

var77 commented 1 year ago

Description

With this changes we will keep the necessary usearch options (dimensions, ef, ef_construction, m, metric_kind) in our index header when building index and in scans read the options from index header instead of index options. Also we will add ef and ef_construction params in usearch index header, and make it reload the values when loaded from file as you can see in this PR .

By doing this we can omit all the parameters when building index from file, as we will get the required values from the usearch header and save them in our index header to be used on table scans.

Currently the tests are failing, as the old versions of index files are being used, they need to be replaced in the bucket with newer versions.