search

jekalmin / extended_openai_conversation

Home Assistant custom component of conversation agent. It uses OpenAI to control your devices.
916 stars 129 forks source link

Local LLM Server #132

Closed wont-stream closed 7 months ago

wont-stream commented 8 months ago

If text-generation-webui doesn't support function calling, and LocalAI is problematic for whatever reason, what is recommended to use for this plugin?

jekalmin commented 7 months ago

Thanks for reporting an issue.

Currently, Local LLM is not ready to use. I also experienced a weird behavior when using LocalAI.

You might want to try home-llm for Local LLM instead.

wont-stream commented 7 months ago

home-llm is perfect for my use case