-
### Description of the feature request:
I'm wondering if it's possible to add support to cancel streaming requests
### What problem are you trying to solve with this feature?
While streaming long…
-
The response contains multiple JSON objects, but they are not wrapped in an array
-
This project looks like it could be very useful in building a GRPC server bridge for PHP, which would be amazing.
GRPC has the concept of streaming request & responses, is that something you'd cons…
-
For consume responses, where the returned response size is too high, instead of ingesting the whole response into the buffer, we can instead parse bundles as they arrive using a simple state machine.
…
-
### Feature Description
Streaming assistant api is now available.
https://community.openai.com/t/streaming-is-now-available-in-the-assistants-api/682011
https://platform.openai.com/docs/assistants/…
-
### Describe the bug
![image](https://github.com/langfuse/langfuse/assets/160006942/1f086214-e76d-4650-82c6-ff4c41be4672)
### To reproduce
from langchain_openai import AzureChatOpenAI
from langf…
-
### What happened?
Content Filter Exceptions on Streaming Requests don't get logged to Langfuse
streaming request, Azure raised a content filter error on chunk N
our failure handler did not…
-
### Description
```shell
branch: main
fastertransformer docker: 22.12
```
### Reproduced Steps
```shell
docker run -it --rm --gpus=all --shm-size=1g --ulimit memlock=-1 -v ${WORKSPACE}:…
-
In some condition, we should not buffer the data in our proxy, but instead just stream the data to the client.
It is related to Issue #49.
For more reference, checkout http://docs.mitmproxy.org/en/l…
-
**Is your feature request related to a problem? Please describe.**
I have `google-resumable-media==2.7.1` and want to use it with `httpx`. `httpx` breaks compatibility with `requests` in several w…