search

onecx-apps / onecx-chat

OneCx chat Management
Apache License 2.0
0 stars 0 forks source link

ollama as docker #11

Closed michaelgloeckner closed 10 months ago

michaelgloeckner commented 10 months ago

create docker image with ollama to host different llama2 models

michaelgloeckner commented 10 months ago

docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

michaelgloeckner commented 10 months ago

ollama available under http://ollama.one-cx.org:80

michaelgloeckner commented 10 months ago

currently its not running in gpu mode and also the model needs to be installed after the service is up