shivaraj-bh / ollama-flake

Run ollama natively - powered by Nix
MIT License
13 stars 0 forks source link
cuda flakes nix ollama open-webui rocm services

ollama-flake

[!NOTE] 🚜 This repository is archived as the services here have been upstreamed to services-flake. See an example of its usage: https://github.com/juspay/services-flake/tree/main/example/llm

Run Ollama stack (the server and interactive webui) natively.

Getting started

mkdir my-ollama-flake && cd ./my-ollama-flake
nix flake init -t github:shivaraj-bh/ollama-flake
nix run

See examples for more details.

Discussions

Join our zulip