search

continuedev / contribution-ideas

A Repo to which to Attach Contribution Ideas
2 stars 0 forks source link

Support a new LLM Provider #12

Open sestinj opened 10 months ago

sestinj commented 10 months ago

Continue supports many different LLM providers by subclassing the BaseLLM class. If you know of an LLM provider that we don't support, adding it can be almost as simple as writing a single method. See CONTRIBUTING.md for a full walkthrough on adding a provider.

Some providers we don't yet support:

KingMob commented 8 months ago

Would be great to support gpt4all, since they seem to have the best local model set up these days.

bjornjorgensen commented 4 months ago

what about adding https://github.com/BerriAI/litellm ?