search

LostRuins / lite.koboldai.net

A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde
GNU Affero General Public License v3.0
87 stars 44 forks source link

Chat Completions UI for Anthropic API (like OpenAI API) #95

Open IS2511 opened 1 day ago

IS2511 commented 1 day ago

The API endpoints for OpenAI Chat Completions and Anthropic Messages are pretty similar iirc. Can you please add a similar interface to the Anthropic API menu as in the OpenAI API menu? Thanks!

I was previously using a service that offers all models in the OpenAI API format, but now want to switch to a different one that offers APIs in the original format. This breaks my current flow because I frequently used Anthropic models via the same OpenAI API format. Now that I am forced to use the Anthropic API format, I can no longer specify Chat Completions, which should be possible with Anthropic too (even if under a different name).

Suggested issue tags: enhancement

LostRuins commented 1 day ago

What do you mean by "can no longer specify Chat Completions"? Anthropic models require the use of their API and has a fixed format for each model. Can you elaborate more on how it breaks your current flow?