shivaraj-bh / ollama-flake

Run ollama natively - powered by Nix
MIT License
13 stars 0 forks source link

Add support for AMD GPUs via ROCm #1

Open icodeforyou-dot-net opened 4 months ago

icodeforyou-dot-net commented 4 months ago

I was wondering if we could add support for AMD GPUs running ROCm in the near future? I could help and could test it on two different AMD cards.

I think in order to get there, we might have to do the following:

icodeforyou-dot-net commented 4 months ago

I think we're getting there...!