-
Based on the Semantic Conventions 1.27.0. See [docs](https://opentelemetry.io/docs/specs/semconv/gen-ai/).
This issue is to keep track of the work I've been doing for the Spring AI initial adoption o…
-
### Your current environment
The output of `python collect_env.py`
```text
(myenv) aiscuser@node-0:~/vllm$ python collect_env.py
Collecting environment information...
PyTorch version: 2.4.0+c…
-
I found that in the benchmark/suite has the output time to first token. However, when I run `python benchmark.py --model meta-llama/Llama-2-7b-hf static --isl 128 --osl 128 --batch 1` an error occurs:…
-
I have followed the steps of the "How-To-Guide" about Automatic Language Adaptation (https://docs.ragas.io/en/v0.1.9/howtos/applications/use_prompt_adaptation.html) and tried to modify the already im…
-
**What would you like to be added/modified**:
Research benchmarks for evaluating LLM and LLM Agent
Develop a personalized LLM Agent using lifelong learning on the KubeEdge-lanvs edge-cloud colla…
-
Langserve is used in:
```
$ git grep -i langserve
comps/llms/summarization/tgi/llm.py:from langserve.serialization import WellKnownLCSerializer
comps/llms/summarization/tgi/requirements.txt:langse…
-
# Background
Based on the current workflow of Kusion and the mechanism of [Kusion Module](https://www.kusionstack.io/docs/concepts/kusion-module/overview), build an operation workflow for LLM that …
-
Hello,
I am using ScaleLLM to inference Mistral-Large-Instruct-2407-GPTQ model, and got all commas as the output. like this:
You are a helpful assistant. You can help me by answering my question…
-
New SDK Review meeting has been requested.
**Service Name**: Azure AI Studio
**Review Created By**: Neehar Duvvuri
**Review Date**: 08/22/2024 02:05 PM PT
**Release Plan**:[1285](https://web.powerap…
-
### 1. Who do you think this talk is for?
developers, AI enthusiasts
### 2. What do you think you'll learn from this talk?
people will learn how to use autogen to solve complex problems using a mul…