janhq / cortex.cpp

Local AI API Platform
https://cortex.so
Apache License 2.0
2.09k stars 119 forks source link

bug: Could not able to run models since 172 #1505

Closed louis-jan closed 3 weeks ago

louis-jan commented 4 weeks ago

Cortex version

172-176

Describe the Bug

Model run is broken at 172; I was unable to start HF model models. It worked fine before.

https://huggingface.co/bartowski/Llama-3.2-1B-Instruct-GGUF/resolve/main/Llama-3.2-1B-Instruct-Q8_0.gguf

Steps to Reproduce

  1. Update to version 172 or the latest version 176.
  2. Clean.
  3. Pull a HF model
  4. Run
  5. See errors.

Screenshots / Logs

image image

What is your OS?

What engine are you running?

nguyenhoangthuan99 commented 4 weeks ago

This issue has been resolved by this pr #1507

gabrielle-ong commented 3 weeks ago

@nguyenhoangthuan99 / @vansangpfiev for v183,

Imagecortex-cli.log cortex.log

vansangpfiev commented 3 weeks ago

Hi @gabrielle-ong, we will deprecate model_alias soon https://github.com/janhq/cortex.cpp/issues/1410#issuecomment-2418721440. So can we mark this bug as won't fix?

gabrielle-ong commented 3 weeks ago

True agree, thanks @vansangpfiev This will be handled as part of #1512 next week