search

acon96 / home-llm

A Home Assistant integration & Model to control your smart home using a Local LLM
483 stars 56 forks source link

Failed to connect error for text-generation-webui API #169

Closed handyman5 closed 2 weeks ago

handyman5 commented 3 weeks ago

Describe the bug

With the most recent custom_component (0.3.2) and the most recent Home Assistant (2024.6.2), attempting to use the text-generation-webui API yields the following error:

Failed to connect to the remote API: 'coroutine' object is not subscriptable

The text-generation-webui endpoint is listening at the hostname I provide:

$ curl -s https://<hostname>:443/v1/internal/model/list | jq '.' | head
{
  "model_names": [
    "bert-MiniLM-L6-v2q4_0.bin",
    "c4ai-command-r-v01-imat-IQ3_M.gguf",
[...]

Expected behavior

In 0.2.17, this worked fine. I expect the custom_component to be able to connect to a text-generation-webui endpoint.

Logs

I could not find any relevant logs anywhere.

acon96 commented 2 weeks ago

this should be fixed in v0.3.3