janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.82k stars 1.39k forks source link

fix: bump cortex.cpp to latest version - recursively scanning models folder should also include remote models #4052

Closed louis-jan closed 1 week ago

louis-jan commented 1 week ago

Describe Your Changes

This PR aims to update cortex.cpp to the latest version, which includes configuration stabilization. This fix resolves an issue where cortex.cpp server occasionally returns an empty models list because it incorrectly locates the data folder.

This PR also include a bug fix where self added remote model.json not available in the models list.

Screenshot 2024-11-20 at 12 35 57

Changes made

The git diff shows changes made to three files in different extensions:

  1. version.txt in inference-cortex-extension/bin:

    • The version string was updated from 1.0.3-rc4 to 1.0.3-rc5.
  2. index.ts in inference-openrouter-extension/src:

    • The transformPayload function was modified:
      • It now checks if payload.model is 'open-router-auto'. If not, it uses payload.model; otherwise, it uses this.model.
  3. index.ts in model-extension/src:

    • Adjusted the logic in filtering legacyModels:
      • Instead of filtering models based on settings?.vision_model, it now filters out models that are already present in fetchedModels based on matching id.

These changes involve version updates, payload adjustments, and logic refinements in model filtering.

github-actions[bot] commented 1 week ago

Barecheck - Code coverage report

Total: 69.28% Your code coverage diff: 0.00% ▴ ✅ All code changes are covered