Open wojtekcz opened 12 months ago
Interesting, good to know. I see us switching to using Vercel's ai
package, which seems to support more models out-of-the-box. I'm hoping that will help with some of these problems, if not, we can add that prefix/suffix functionality.
Describe the feature
Allow the user to configure prompt templates or at minimum set prefix and suffix to user entered message.
VSCode with this extension comprises great UI for various models, not necessarily coming from OpenAI. Some of them require special formatted prompts, specific User, Assistant names, etc.
This extensions works with Claude 2 through the claude-to-chatgpt (https://github.com/jtsang4/claude-to-chatgpt) API adapter.
Also there is host of models that can be locally hosted, eg. with GPT4all, LM Studio or oobabooga/text-generation-webui. All of them come with OpenAI API-like servers built in.
Checked this extension with for example Lazarus 30B, WizardCoder 15B ;-)