vercel / modelfusion

The TypeScript library for building AI applications.
https://modelfusion.dev
MIT License
1.06k stars 76 forks source link

Support sqlite vector search module #157

Closed bjsi closed 8 months ago

bjsi commented 8 months ago

There's a sqlite extension to support vector search called sqlite-vss. This would be a welcome addition to modelfusion because sqlite is like a stepping stone between the in-memory JSON vector DB and a "proper" vector DB like pinecone. The advantage it has over the in-memory JSON approach is that it doesn't take up a bunch of RAM, so I can deploy prototypes quickly for free without upgrading to paid tiers 😄. Also it's less setup than pinecone.

I would be glad to implement this myself because I'm already familiar with sqlite-vss if that sounds good to you.

lgrammel commented 8 months ago

@bjsi awesome idea! there are some existing example (in-memory vector db, pinecone). Ideally this would be a separate extension, similar to extensions/pinecone. Let me know if you have any questions :)

bjsi commented 8 months ago

Great! I'll have a go and let you know if I run into any issues :)