-
Hi,
I noticed that the repository currently lacks support for the InternLM2.5-7B (1.8B, 20B) model, which may cause compatibility issues or missing steps for users trying to implement it. It would …
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0
Is debug build: False
CUDA used to build PyTorch: 12…
-
**问题描述 / Problem Description**
目前用的是0.3.1版本
llm: qwen-max
platform: one-api
qwen的agent prompt用的是structured-chat-agent，用qwen这个prompt更奇怪，工具甚至都没调用就直接给出答案了。测试可以试试天气查询的这个工具，工具都没有调用能直接返回查询结果，最后换了struc…
-
# 尝试评测InternVL2-1B时报错
## 这是评测运行的命令
`python run.py --data MathVision_MINI --model InternVL2-1B`
换成 2B的its work，可能是因为1B的基座是qwen2导致的问题
`python run.py --data MathVision_MINI --model InternVL2-2B`
…
-
Setting up `gptel` with ollama local models is not working
**Additional context**
Emacs version: 29
Operating system: OSX Sonoma
Ollama:
```bash
➜ ~ ollama list
NAME …
-
### Proposal to improve performance
_No response_
### Report of performance regression
INFO 09-11 12:41:50 spec_decode_worker.py:790] SpecDecodeWorker stage times: average_time_per_proposal_t…
-
### Your current environment
```text
The output of `python collect_env.py`
```
### 🐛 Describe the bug
python -m vllm.entrypoints.openai.api_server --model /root/autodl-tmp/models/Qwen1.5-14B-Ch…
-
After I LLM Setup ollama source by Custom LLM Provider, both Danswer and Paraphrase assistant can work, but gpt assistant can not work like this:
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue]…