janhq / cortex.cpp

Run and customize Local LLMs.
https://cortex.so
Apache License 2.0
1.92k stars 107 forks source link

bug: Fail to get list model information: Unable to create model.list file #1285

Open 0xSage opened 3 hours ago

0xSage commented 3 hours ago

A bit of a regression because models.list is still in progress. I know this is WiP, but I wanted to create this issue anyway, so we remember to check it works later on.

Cortex version

v75

Describe the Bug

❯ ls
llama3.1                          llama3.1.yaml                     stable-code-instruct-3b-GGUF      stable-code-instruct-3b-GGUF.yaml

❯ cortex-nightly models list
Fail to get list model information: Unable to create model.list file: /Users/nicolezhu/cortexcpp-nightly/models/model.list
+---------+----+-------------+--------+---------+
| (Index) | ID | model alias | engine | version |
+---------+----+-------------+--------+---------+
❯ ls
Applications            Movies                  Postman Agent           cortexcpp-nightly       homebrewltd             package-lock.json
Desktop                 Music                   Public                  deleteme.js             jan                     settings.json
Documents               Pictures                Screen Studio Projects  docs                    janhq                   uploads
Downloads               Portia                  Sites                   experiments             llama.log               zk
Library                 Postman                 cortex-web              go                      mambaforge              zsh-syntax-highlighting

Steps to Reproduce

  1. Download a few models
  2. run models list
  3. Doesn't work

Screenshots / Logs

see above

What is your OS?

What engine are you running?

0xSage commented 3 hours ago

Questions: