-
Requirements:
```
langchain==0.3.1
langchain-aws==0.2.7
langchain-chroma==0.1.4
langchain-community==0.3.1
langchain-core==0.3.15
langchain-openai==0.2.1
langchain-text-splitters==0.3.0
langg…
-
Hi there,
as Streamerbot does not support instagram and facebook chat messages but social stream does I thought it might be possible to connect both to be able to trigger actions in streamerbot wit…
-
[X] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am unable to create test data set, using Ollama models , it…
-
Hi,
I'm trying to get the model.generate function 's output to be returned within a gradio-called function.
I wanted to make a minimal gradio app with a single input textbox and single response …
-
有什么办法能统计function call调用过程中输入和输出的token数吗，试了一下修改oai.py代码，打印出的chunk里也没有相关信息
root@vllm:~/benchmark# python3 fcall.py
请输入查询内容（输入 'quit' 退出）：你好
ChatCompletionChunk(id='chat-a55bee23999c4e37ae2bc50b1bf4…
-
Hello There,
This may not be specifically a bug, but there seems to be some issue.
For a single chat request sent from bot UI, metrics report that 3 or 3x Open AI requests were made. Also the toke…
-
Wrote the according to the following example at https://distilabel.argilla.io/latest/sections/how_to_guides/advanced/serving_an_llm_for_reuse/#serving-llms-using-vllm:
```
from distilabel.llms im…
-
**Describe the bug:**
the data_stream.namspace field cannot be filtered on .internal.alerts-security.alerts-default indices
**Kibana/Elasticsearch Stack version:**
8.7.0
**Server OS version:**
…
ccdta updated
1 month ago
-
I use the docker image chat-ui-db as the frontend, text-generation-inference as the inference backend, and meta-llamaLlama-2-70b-chat-hf as the model.
In the model field of the .env.local file, I hav…
-
Can somebody describe, why streaming is not working? The model provides the answer at once instead of streaming, …