search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
20.75k stars 1.19k forks source link

feat: Refactor Jan to use Cortex client sdk #2968

Open Van-QA opened 1 month ago

Van-QA commented 1 month ago

Problem: Jan, a developer, is struggling to use the outdated Cortex API, which is slowing down development and causing errors.

Success Criteria: Jan should be able to use the Cortex Client SDK, which will improve development speed and reduce errors.

Additional context: image

Van-QA commented 4 days ago

https://github.com/janhq/jan/pull/3001#issuecomment-2185619707 https://github.com/janhq/jan/pull/3001#issuecomment-2187891625

Continue from the previous comment: @namchuai

  1. Cortex models with onnx, but Jan does not display :x: image image
Van-QA commented 3 days ago

Anthropic: :x: image image