search

NVIDIA / ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM
Other
2.77k stars 343 forks source link

feature request - home assistant, replace siri #66

Closed warlordattack closed 5 months ago

warlordattack commented 5 months ago

Hello, would be nice to have :

1/ home assistant Would be nice to integrate ChatRTX easily into my Home Assistant, to power all my home automation.

2/ replace Siri We use Siri to command and control home automation from both home assistant and apple devices. Also we use Siri to ask questions. But Siri is quiet dumb, so would be good to replace it with something more smart AND something that can do basic tasks without internet at all.

ChatRTX is a local AI, so it would also work without internet witch is good. It would be nice to be able to connect gaming PC RTX card with Home Assistant installation that is on an other PC/server/linux box.

In my case, we often have internet downtimes, so be able to operate without internet is important. Also if the world is destroyed there will be no internet at all, so everything local is a survival matter, LAN AI is a very good thing :) We have Proxmox, with Windows VM witch has RTX 3070 and Plex running, i could be able to run ChatRTX on this VM. We have second VM with home assistant, so it would be great to connect ChatRTX from the Windows VM with he Home Assistant VM running in the same Proxmox. I suppose to do this we need to develop some sort of home assistant integration, linked by API to the ChatRTX server in the same LAN, also we need local voice assistant and mobile apps integration.

A understand Apple integration is perhaps not easy, if so starting with Android devices would be nice (mobile and tv boxes for voice control).

Best regards :)

maurobotta commented 5 months ago

home assistant

anujj commented 5 months ago

Thanks for the suggestions. Its a developer reference project and we want the developer the build on top if it :)

craig0r commented 2 months ago

Hi @warlordattack. You can do what you're looking to do, but not exactly as you're expecting to do it. As far as I know, there's no way to integrate ChatRTX into Home Assistant right now. Instead, you'll want to look into Ollama. This is an open AI platform that will let you use many different LLM models, and integrates into Home Assistant, allowing you to talk to Home Assistant using AI running on your local PC/server, rather than the Gemini or ChatGPT alternatives.

In terms of replacing Siri, that's semi-doable. You of course can't replace Siri on your Apple devices, so that's the drawback. I don't know if you can choose alternate assistants on iPhone, but Android does let you choose the Home Assistant voice assist as your default voice assistant. However it doesn't support wake words on Android at the moment (fingers crossed this comes at some point.)

Outside your phone, if you want smart speakers that interact with Home Assistant, you of course need to get some non-Apple hardware. Particularly, you'd want to look into some ESP32 devices (like this one https://www.home-assistant.io/voice_control/thirteen-usd-voice-remote/... note that it's cheap and thus is not a great whole-home solution), or a Raspberry Pi with speaker/mic addons. You could technically also hard wire some microphones to your Home Assistant server if you feel like that's a viable solution for you.