search

carlrobertoh / CodeGPT

The leading open-source AI copilot for JetBrains. Connect to any model in any environment, and customize your coding experience in any way you like.
https://codegpt.ee
Apache License 2.0
1.01k stars 212 forks source link

LibreChat support #426

Open moritzfl opened 6 months ago

moritzfl commented 6 months ago

Describe the need of your request

LibreChat ties multiple LLM-Services together, does User Authentication and provides means to rate-limit users. Through its web interface it can also provide access to non-developers.

For use within a company this is an easy and cheap way to provide access to the greatest and newest models (which can also self-hosted if desired).

It can include custom plugins for Azure and OpenAI models or company knowledge through meilisearch for answering requests.

In order for developers to make the most out of the provided access, it would be desirable to use it in their IDE - and that's where CodeGPT comes in ;)

Proposed solution

Integrate LibreChat as a supported LLM-Endpoint.

Additional context

~~The discord bot shows that it is technically possible to talk to the LibreChat-Models through an external client: https://github.com/Berry-13/LibreChat-DiscordBot~~ Update: The discord bot only manages the LibreChat-server and does not control chat interactions

I would be willing to work on this if this is a wanted feature and you are open towards PRs.

carlrobertoh commented 6 months ago

Sure, it looks good, and contributions are also highly welcome 👍

I couldn't find documentation related to their API tho. I'm not sure if they even provide one.