search

twitchax / augre

An LLM-powered (CodeLlama or OpenAI) local diff code review tool.
MIT License
27 stars 2 forks source link

Failed to run on macOS #3

Open tomisacat opened 3 months ago

tomisacat commented 3 months ago

I'm trying to run augre on my M1 Mac but failed, here's the error message:

Error response from daemon: could not select device driver "nvidia" with capabilities: [[gpu]]
ERROR: Unable to run `docker-compose`.

Environment:

M1 Pro macOS Sonoma 14.2.1

tomisacat commented 3 months ago

Changed mode from LocalGpu to LocalCpu it succeeded to run but failed to start the Cria server:

ERROR: Unable to start the Cria server (timed out).
twitchax commented 3 months ago

I may need to add a flag to configure that timeout. Basically, the cria server loads the model into the VRAM, and it can take some time.

tomisacat commented 3 months ago

@twitchax does that mean the VRAM resource allocated to cria docker is insufficient which results in the timeout error?

twitchax commented 3 months ago

That, or it's just taking too long to load it. You can actually inspect the docker logs to see what happened. How much VRAM does your machine have?