Docker enhancments - Githubissues

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

5.56k stars 371 forks source link

Docker enhancments #893

Open raldone01 opened 6 months ago

raldone01 commented 6 months ago

Support arm
Add a Dockerfile to the repo
Build images in github ci and push them to dockerhub and ghcr
Provide an example docker-compose file. This would show which volumes/mounts are available.

If you let me know which of these points you want to have I could contribute some of them.

LostRuins commented 3 months ago

@henk717 is the maintainer of the KoboldCpp docker, we have official images for it at https://hub.docker.com/r/koboldai/koboldcpp and you can check in with him if you have changes to propose.