khoj-ai / khoj

Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.
https://khoj.dev
GNU Affero General Public License v3.0
12.64k stars 640 forks source link

Index data in SQLite DB #504

Open Victor239 opened 11 months ago

Victor239 commented 11 months ago

Would love to see this be able to work on data stored in SQLite too.

sabaimran commented 11 months ago

Neat idea! @Victor239 , do you mind sharing more about your use case? What kind of data would you want to search on?

Victor239 commented 11 months ago

There are some smaller apps I'd like to use it with but mainly because Logseq (an app which has been mentioned elsewhere on this GitHub) is getting a database mode, so I'd love to use it with that.

sabaimran commented 11 months ago

Do you imagine you would want something that dynamically infers which (presumably text) columns to index? Or, would you want to be able to configure the column names that should be indexed?

You've also reminded me that I've been wanting to apply Khoj to my Signal sqlite database. Might be a fun place to experiment with feature development.

Victor239 commented 11 months ago

Dynamically infers ideally, but I can imagine a later feature to add for advanced users would allow choosing which columns to utilise.