janhq / cortex.cpp

Run and customize Local LLMs.
https://cortex.so
Apache License 2.0
1.91k stars 105 forks source link

idea: `cortex models list` remote & downloaded models #1176

Closed 0xSage closed 3 days ago

0xSage commented 1 week ago

Problem A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

  1. Users want to see what models are preconfigured and available via HF/cortexso
  2. Users want to see what models are available to be used locally, they've already downloaded

Success Criteria A clear and concise description of what you want to happen.

Not sure about this:

# List all available models , including remote models on cortexso available for download
cortex models list 

# List models on device only (-l or some other flag)
cortex models --local

Additional context Add any other context or screenshots about the feature request here.

dan-homebrew commented 3 days ago

I am deprecating this issue, as Cortex.cpp should not be handling remote model (this is a Jan Extension concern)