Use copilot RAG and other infrastructure

[AriMKatz]

Validations

• [X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
• [X] I'm not able to find an open issue that requests the same enhancement

Problem

Copilot is putting a lot of money into RAG, and they have the advantage of some big github knowledge graph. There are likely other functionalities that continue is duplicating

Solution

There are API's for this and all kinds of other useful features in copilot (https://github.com/microsoft/vscode/issues/199908#issuecomment-2090806642 , higher level and lower level). If not already, I think it's useful to integrate with these and not maintain parallel functionality, so continue can become a complement and improve with copilot.

I'm typing this out and then realizing that this may require paying for copilot, which would be a dealbreaker. I'm not sure. Feel free to close if so

[sestinj]

That's interesting. From what was stated here, it does seem that they plan to make this a part of VS Code directly. Almost certainly it will be a preview feature that we can't use in production extensions for quite a while, but I'll keep this open to keep an eye on it

I do feel there will be great value in building out our own RAG infra—this allows us to use it in VS Code, JetBrains, and eventually all other IDEs