Open mor10 opened 1 month ago
I'm working on a C++ cross-platform implementation that may be similar to what you describe. The idea being that the C++ handles the realtime audio and websocketry while exposing a generic interface to allow e.g. tool-calling and other such stuff. I might end up with a bidirectional websocket relay that just doesn't contain any of the audio interactions.
when i run the mainfile: i get just lines of code scrolling over my screen
Try running the legacy file. That's the only one that works cleanly. Does that work?
Like you said in your readme, Python is not ideal for doing the actual streaming of content through WebSockets, but is ideal as pass-through / proxy / middleware managing the security layer of a front-end app.
Have you considered building this into a straightforward plug-and-play implementation of a Python back-end that handles keys and exchanges that any front-end app can pull from easily? So rather than the Python app doing all the WebSockets work, the python apps works as an intermediary and leaves the front-end app to do whatever it wants to do.
It's an unfinished thought. Do with it as you please.