Indexing lots of markdown files

danswer-ai / danswer

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

https://danswer.ai

Other

10.83k stars 1.36k forks source link

Indexing lots of markdown files #1220

Open sagarjauhari opened 8 months ago

sagarjauhari commented 8 months ago

I have a bunch (thousands) of markdown files for my personal notes. How do I index a folder containing all of them? Couldn't find a relevant connector

zarlor commented 7 months ago

Indexing of a local directory would be nice, but I believe that's essentially a Feature Request for now. The only way I've seen otherwise is putting them someplace as either a web page or Google Drive (and then you have to set up that connector but I have issues with the Google Drive connector as it seems to just stop working intermittently and then the only fix is to recreate the connector).

z3ugma commented 5 months ago

@sagarjauhari or @zarlor is this formally submitted as a Feature Request somewhere, and if so, do we need to link this issue to that request? I have the same use case

zarlor commented 5 months ago

It seems to me this probably is the official Feature Request, especially if the OP changes the title to have "Feature Request:" before it, or something