epic: Refactoring of Remote API Extensions (Mistral, Cohere, etc)

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

https://jan.ai/

GNU Affero General Public License v3.0

21.11k stars 1.22k forks source link

epic: Refactoring of Remote API Extensions (Mistral, Cohere, etc) #2721

Closed imtuyethan closed 1 month ago

imtuyethan commented 3 months ago

Motivation

Model from API providers should be more clarifier

Specs

https://www.notion.so/jan-ai/Refactoring-of-Remote-API-Extensions-Mistral-Cohere-etc-8638a1fa26ca48f3b57822157c11152a?pvs=4

In-scope

Cohere extension https://github.com/janhq/jan/issues/2686
Anthropic extensions https://github.com/janhq/jan/issues/2777
Deepinfra extensions https://github.com/janhq/jan/issues/2717
Openrouter https://github.com/janhq/jan/issues/2685

bogorad commented 3 months ago

looks like it broke OpenRouter api. where are the new setup instructions? This has no visible effect

Step 1: Configure OpenRouter API key Find your API keys in the OpenRouter API Key. Set the OpenRouter API key in ~jan\settings\@janhq\inference-openai-extension\settings.json file.

https://jan.ai/docs/remote-inference/router

dandv commented 2 months ago

I get "Page not found" on that Notion page.

Van-QA commented 1 month ago

please use https://jan.ai/docs/remote-models/anthropic for the ava‌‌ilable remote mode‌ls list