janhq / cortex

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan
https://cortex.so
Apache License 2.0
1.78k stars 97 forks source link

epic: remove cortex.llamacpp out of cortex-cpp release #789

Open vansangpfiev opened 1 week ago

vansangpfiev commented 1 week ago

Problem We are supporting multiple engines. It is weird if we only want to use cortex.onnx but still have cortex.llamacpp engine.

Success Criteria Only release cortex-cpp binary

Sub Issues

Additional context

louis-jan commented 5 days ago

The CI update PR is ready, now is the time to pull the JS layer for the engine.