-
### Splitting this out of issue #1576...
...which was originally about binary streaming but later drifted into a discussion of JSON streaming. Several real-world uses for JSON streaming were cited…
-
### What Happened?
## Issue Description
The gateway fails to properly parse error messages when accessing Claude models on GCP Vertex AI via the streaming endpoint. The issue occurs when the model…
-
## Describe the bug
I have an intermittent error when streaming the Pile, where I get a JSON parse error which causes my program to crash.
This is intermittent - when I rerun the program with the …
-
```
I'd like to propose three enhancements:
1. Support the Streaming API. I believe this can be done via libcurl, but I
haven't tried it yet.
2. Return objects in JSON format in addition to or inste…
-
The current recommended encodings do not lend themselves to streaming -- we should seek out a streamable encoding for timeseries. Could flesh this out much more, just leaving as a note for the future.
-
# JSON streaming and error handling with Spring WebFlux
Podcast for developers, testers, SREs… and their managers. I explain complex and convoluted technologies in a clear way, avoiding buzzwords and…
-
### Your current environment
```text
A800*8 ，vllm==0.4.3
```
### 🐛 Describe the bug
```
results_generator = engine.generate(prompt_format, sampling_params, request_id)
pre_index=0
asyn…
-
```
What steps will reproduce the problem?
1. jsonPath/*compiled from say:
"$.store.book[0].title"*/.read(referenceToLargeJSONFile)
What is the expected output? What do you see instead?
It should gi…
-
The sample is not working.
https://github.com/oracle-samples/oracle-functions-samples)/[samples](https://github.com/oracle-samples/oracle-functions-samples/tree/master/samples)/oci-serviceconnecto…
-
Currently tool call patterns are defined in go templates. this is fine for cases [e.g. in this comment](https://github.com/ollama/ollama/issues/6061#issuecomment-2257137350). However, it is not ideal.…