Often local LLMs will offload a query to CPU if there is not enough VRAM or in
the case of an unsupported GPU. When a query is offloaded to the CPU responses
can be significantly slower. If curl times out early the user will not get the
response from the LLM back in Emacs.
This change increases the timeout for curl from 60s to 300s to make gptel usable
in slower environments.
karthink
commented
8 months ago
Often local LLMs will offload a query to CPU if there is not enough VRAM or in the case of an unsupported GPU. When a query is offloaded to the CPU responses can be significantly slower. If curl times out early the user will not get the response from the LLM back in Emacs.
This change increases the timeout for curl from 60s to 300s to make gptel usable in slower environments.
Closes #125