asg017 / sqlite-vss

A SQLite extension for efficient vector search, based on Faiss!
MIT License
1.59k stars 58 forks source link

Ability to attach uuid or arbitrary identifier to index #127

Open Volland opened 3 months ago

Volland commented 3 months ago

As far as I can see, VSS uses the rowid field to correlate the index and data in a table. For lacalfirst applications that use sync and replications of a databases cross devices rowid is not reliable identifier

Also Rowid isn’t stable in SQLite. It’ll change between vacuum calls unless the Rowid is aliased https://www.sqlite.org/rowidtable.html To make cross-device and replication sync possible we need some kind of identifier to correlate