-
We propose implementing a feature that allows the LLM model to stream its response in smaller chunks (or using a similar strategy), enabling voice playback to begin as soon as the user starts speaking…
-
## Describe the bug
If you deploy with WS streaming disabled, requests to regenerate LLM responses will use WS regardless. This is a hazard for customers that need to deploy without WSS due to APIG…
-
### Feature Description
How can users stream while accounting for tool calls in a workflow? Currently, the way I would implement this is not very friendly or example-ready
### Reason
Streaming is a…
-
### Describe the issue
How should I implement streaming output to the frontend like OpenAI and do you have any specific examples
### Steps to reproduce
_No response_
### Screenshots and logs
_No …
-
### Have you searched for similar requests?
No
### Is your feature request related to a problem? If so, please describe.
-current smooth streaming for responses is kinda ugly and outdated i t…
-
## Feature Request
Love the project! Just one request on response streaming.
Most (because I haven't used all of them) gRPC implementation passes a `sink/writer` handle into the handler stub. In…
-
**Description of the bug**
I'm using https://github.com/activeadmin/activeadmin/tree/v2.9.0 to allow for downloading CSVs. Digging into their source code, I noticed the response is [streamed back…
-
### Description
When trying to set or Append to a long string (5500chars for example) that is bound to a span, the UI freezes, ~5sec in my example with 5500 chars.
Why is this an issue?
When stre…
-
### Describe the bug
I am successfully streaming a 1440P game computer on my Android TV with 1080P resolution, but the display is too blurry, but once in a while the connection is successful the pict…
-
endpoint `https://stt.openvoiceos.com/stt`
```
Exception in thread Thread-6:
Apr 21 21:54:48 ovos ovos-systemd-voice[832]: Traceback (most recent call last):
Apr 21 21:54:48 ovos ovos-systemd-v…