Docker enhancments - Githubissues

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

4.35k stars 312 forks source link

Open raldone01 opened 4 weeks ago

raldone01 commented 4 weeks ago

Support arm
Add a Dockerfile to the repo
Build images in github ci and push them to dockerhub and ghcr
Provide an example docker-compose file. This would show which volumes/mounts are available.

If you let me know which of these points you want to have I could contribute some of them.