-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I have an LLM model (specifically from Anthropic) and I want to use the native tools fro…
-
### What happened?
Chromecast currently doesn't work for me.
There are 2 different scenarios:
1. In the Browser (Microsoft Edge, Chromium with Chromecast enabled in the settings): The browser jus…
-
### Description
```shell
branch: main
fastertransformer docker: 22.12
```
### Reproduced Steps
```shell
docker run -it --rm --gpus=all --shm-size=1g --ulimit memlock=-1 -v ${WORKSPACE}:…
-
Jet and http-kit support this already, so it should be straightforward to handle when :body is a channel.
-
-
### Bug Description
While using `SQLAutoVectorQueryEngine`, if I set `verbose=True` and provide it a `vector_query_tool` with `streaming = True`, the `StreamingResponse` returned doesn't stream.
…
-
Hi,
Thank you for your contribution to the voice-based conversational engine. I'm encountering an issue while reimplementing your code. Specifically, the bot is designed to operate in a streaming mod…
-
i get the following error when trying sgpt with ollama
```shell
ResponseNotRead: Attempted to access streaming response content, without having called `read()`.
```
relates to https://github.c…
-
I've been serving `codellama/CodeLlama-7b-hf` using openshift AI `Caikit TGIS ServingRuntime for KServe` and trying to interact with it using langchain via `caikit-nlp-client` and [caikit_tgis_langcha…
-
I try to mock unary-stream response, but I get answer like unary. I mean that in BloomPRC my mock answered to me one time, it is not streaming. Can someone help me to know what I'm doing wrong and exp…