search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
20.95k stars 1.21k forks source link

feat: please add cloud-api support for Mistral's 3 models #2518

Closed lineality closed 3 months ago

lineality commented 3 months ago

I tried using the openai and groq api code as a template for creating a Mistral api pathway in Jan...but nothing worked. Whoever set these up could probably add mistral in a few seconds. As the misral api is modeled closely after openai

"https://api.mistral.ai/v1/chat/completions" \

mistral.json model.json extensions.json Problem A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Success Criteria A clear and concise description of what you want to happen.

Additional context Add any other context or screenshots about the feature request here. mistral_tiny_cloud_api.zip

Van-QA commented 3 months ago

Closing this and please follow up using the related feature ticket: #2072. 🙏 Side note: the extension is now ready in the nightly build. Jan v0.4.10-367