search

0hq / tinyvector

A tiny nearest-neighbor embedding database built with SQLite and Pytorch. (In development!)
MIT License
772 stars 24 forks source link

SQLite data corruption issues + Indexes need testing #2

Open 0hq opened 1 year ago

0hq commented 1 year ago

There seem to be some critical issues with the indexes, starting with BruteForceIndexMutable. Replicate by creating a new table, creating a new brute_force index, adding vectors, then querying, then restarting?

Full testing of each index is needed.