Open avnigashi opened 2 months ago
node-llama-cpp released v3 including some new docs. this might be useful here https://node-llama-cpp.withcat.ai/guide/docker
i think we primarily need a dockerfile, but i see how a docker-compose config might be useful for development. could also publish that image to the hub, i'll create a repo for that sometime.
on the dockerfile: