Christopher-Hayes / vscode-chatgpt-reborn

Refactor, improve, and debug your code in VSCode with GPT-3 and GPT-4.
https://marketplace.visualstudio.com/items?itemName=chris-hayes.chatgpt-reborn
ISC License
207 stars 38 forks source link

Configure prompt templates or message prefix and suffix #45

Open wojtekcz opened 12 months ago

wojtekcz commented 12 months ago

Describe the feature

Allow the user to configure prompt templates or at minimum set prefix and suffix to user entered message.

VSCode with this extension comprises great UI for various models, not necessarily coming from OpenAI. Some of them require special formatted prompts, specific User, Assistant names, etc.

This extensions works with Claude 2 through the claude-to-chatgpt (https://github.com/jtsang4/claude-to-chatgpt) API adapter.

Also there is host of models that can be locally hosted, eg. with GPT4all, LM Studio or oobabooga/text-generation-webui. All of them come with OpenAI API-like servers built in.

Checked this extension with for example Lazarus 30B, WizardCoder 15B ;-)

Christopher-Hayes commented 11 months ago

Interesting, good to know. I see us switching to using Vercel's ai package, which seems to support more models out-of-the-box. I'm hoping that will help with some of these problems, if not, we can add that prefix/suffix functionality.