search

irthomasthomas / llm

Access large language models from the command-line
https://llm.datasette.io
Apache License 2.0
0 stars 0 forks source link

Use multiple GPU's or GPU and CPU #1

Open irthomasthomas opened 1 year ago

irthomasthomas commented 1 year ago

I would like to be able to use two GPU's and the CPU together.

https://github.com/ggerganov/llama.cpp/pull/1375

/ ``