search

janhq / cortex

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan
https://cortex.so
Apache License 2.0
1.85k stars 97 forks source link

feat: support alpine image #365

Open tikikun opened 7 months ago

tikikun commented 7 months ago

Problem Alpine can build llama cpp, probably will be helpful to build, alpine is very secure in nature and can be used in security tight environment

https://github.com/3x3cut0r/docker/blob/main/llama-cpp-python/Dockerfile

Success Criteria Good alpine image for nitro

ikraduya commented 5 months ago

Hi, I am interested in the project and would like to work on this one :)

tikikun commented 5 months ago

awesome plz go ahead with PR

ikraduya commented 1 month ago

Hi, I noticed that the title has been changed. Is there any other task that needs to be done?