bug: [cortex-nightly] cortex.cpp unable to run in Mac arm - Githubissues

janhq / cortex.cpp

Run and customize Local LLMs.

https://cortex.so

Apache License 2.0

1.91k stars 105 forks source link

bug: [cortex-nightly] cortex.cpp unable to run in Mac arm #1201

Closed nguyenhoangthuan99 closed 5 days ago

nguyenhoangthuan99 commented 6 days ago

Cortex version

cortex-nightly

Describe the Bug

When start server, the log file output weird log, and it also cannot load model in mac arm.

Screenshot 2024-09-12 at 14 56 41

If I disable log to file feature (edit code and build again), the server cannot be started. This bug maybe not caused by file logger.

Steps to Reproduce

No response

Screenshots / Logs

No response

What is your OS?

[X] MacOS
[ ] Windows
[ ] Linux

What engine are you running?

[x] cortex.llamacpp (default)
[ ] cortex.tensorrt-llm (Nvidia GPUs)
[ ] cortex.onnx (NPUs, DirectML)

nguyenhoangthuan99 commented 5 days ago

Problem

when start server with cortex command, it will create a subprocess to start server, macOS accidentally kill subprocess so that it is unable to run server
when start server with cortex --start-server command, can run load model and chat successfully.