semperai / amica

Amica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.
https://heyamica.com
MIT License
625 stars 96 forks source link

Design websocket protocol for 2 way interaction servers #8

Open kasumi-1 opened 8 months ago

kasumi-1 commented 8 months ago

Let's say we want to support home automation, currently it is possible to support by forking and adding some home automation specific code. However, with the wide variety of different home automation systems, it may make more sense to instead have a script which connects to amica, can say things as a user, and can read what she is saying (or other events).

The amica websocket server could use JSON RPC.

Supports receiving these:

Support broadcasting these sorts of events:

This may make it possible to do really cool things like: