feat(ollama): init - Githubissues

juspay / services-flake

NixOS-like services for Nix flakes

https://community.flake.parts/services-flake

MIT License

299 stars 28 forks source link

feat(ollama): init #218

Closed shivaraj-bh closed 1 month ago

shivaraj-bh commented 1 month ago

ported from https://github.com/shivaraj-bh/ollama-flake/blob/main/services/ollama.nix

TODO

[x] Add documentation that includes examples for using accelerators like cuda and rocm

srid commented 1 month ago

@shivaraj-bh

https://x.com/nixos_asia/status/1800855562072322052

Is there a nix run one-liner I can use to try out the demo in the tweet without having to hand-roll a flake? Perhaps an ./example/llm is useful. I wanted to retweet that to my profile giving the nix run ... invocation for readers.

shivaraj-bh commented 1 month ago

@srid here you go: https://github.com/juspay/services-flake/commit/82ff0e98761facd66de04672adb731e3f2d2d627

srid commented 1 month ago

This is what I see when trying to run it (cf. #222):

❯ nix run "github:juspay/services-flake?dir=example/llm"
error:
       … while updating the lock file of flake 'github:juspay/services-flake/76f6081f51d8884b7d3196dbb45e8f8a11417a53?dir=example/llm'

       error: cannot write modified lock file of flake 'github:juspay/services-flake?dir=example/llm' (use '--no-write-lock-file' to ignore)

Also, we should build all examples in CI. See #221