Add unified indexing configuration -- detect file type based on mime type/extension

khoj-ai / khoj

Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

https://khoj.dev

GNU Affero General Public License v3.0

12.64k stars 640 forks source link

Add unified indexing configuration -- detect file type based on mime type/extension #451

Closed sabaimran closed 11 months ago

sabaimran commented 1 year ago

We have several "types" of data that we index, but it's not necessary to force the user to specify which directories to look in for which files. Rather, we may just want to ask the user which directories they're interested in indexing, and in the back-end take care of indexing the relevant data.

sabaimran commented 11 months ago

With the new desktop client + Khoj server changes, it's now possible to simply select a folder and let the backend handle the process of determine how to parse it. Hence, I'm marking this as closed as another option exists.

Here are the instructions for installing the Desktop app: https://docs.khoj.dev/#/setup?id=_13-download-the-desktop-client-optional