kurusugawa-computer / markdown-copilot-vscode

OpenAI ChatGPT API client for VSCode
https://marketplace.visualstudio.com/items?itemName=kurusugawa-computer.markdown-copilot
MIT License
9 stars 2 forks source link

Retrieval Augmented Generation (RAG) for Workspaces #4

Open squld opened 5 months ago

squld commented 5 months ago

Proposal

Vectorize Markdown files (or snippets) in the current workspace in some way and make them accessible from Markdown Copilot. Relying on a nice vector database to store index files under a directory (e.g. .markdown_copilot) would be advisable.

There are two main uses, with the first being the priority:

  1. Retrieve: Implement a feature to vectorize and index Markdown files within the workspace. When a user requests related content, the feature searches the index and inserts relevant text snippets into the current buffer.
  2. RAG: Allow the user to ask questions and receive answers generated based on the indexed content of the workspace.

RAG can be split into another issue.