search

rhohndorf / Auto-Llama-cpp

Uses Auto-GPT with Llama.cpp
MIT License
384 stars 68 forks source link

ToDO : Add GPU Support via GPTQ not required anymore #23

Closed Free-Radical closed 1 year ago

Free-Radical commented 1 year ago

I don't think that is necessary anymore, llama.cpp can be compiled for BLAS support per https://github.com/ggerganov/llama.cpp/tree/master#blas-build