-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
A clear and concise description of what the bug is.
Ragas …
-
G-Eval includes "Auto Chain-of-Thoughts for NLG Evaluation" as a component where the CoT steps to carry out evaluation are produced by an LLM. The paper nor this repo, however, include the prompt defi…
-
Even though I think LLMs generally do not work like this, I still wonder whether we could guard against some - otherwise super dumb - LLM to just learn our repo by heart and then achieve great results…
-
Hi TransLLM owner, Do you have like benchmark data where expected output is provided?
Cheers!
-
### Your current environment
vllm == 0.6.2
### Model Input Dumps
_No response_
### 🐛 Describe the bug
/home/linli/anaconda3/envs/LLM/lib/python3.11/site-packages/vllm/core/scheduler.py line 1247 …
-
I just run below code and find that the examples need to be evaluated by LLM are not equivalent to your papers.
`rule_based_source = ["E2E", "WIKIEVENTS", "CONLL2003",
"tex…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
When I try to use generator.adapt(language='chinese'), I stil…
-
**Describe the feature**
Typically OpenAI API's are protected with some API_KEY, so to run requests to such API's it is necessary to specify API_KEY in a call.
Is it planned to add such functionalit…
vlsav updated
2 months ago
-
Current attempt:
```python
def test_unsloth_vllm(
max_length: int = 8192,
use_4bit: bool = False,
):
print('----> test_unsloth_vllm')
import os
from tra…