-
### Your current environment
```text
The output of `python collect_env.py`
```
Collecting environment information...
WARNING 07-09 19:46:51 _custom_ops.py:14] Failed to import from vllm._C with M…
-
Writing to see if there is something we can do about startup time for Deno CLI applications. We have a moderately sized CLI application (25k lines of TypeScript code) that nevertheless takes 1.2s to s…
-
### 先决条件
- [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。
- [X] 错误在 [最新版本](https://github.com/open-com…
-
### Your current environment
```text
PyTorch version: 2.2.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Red Hat Enterprise Linux Server rel…
-
### System Info / 系統信息
ubuntu22
conda
python3.11
nvidia-cudnn-cu12
torch 2.3.0
vllm 0.5.0.post1
vllm-flash-attn 2.5.9…
-
### Your current environment
Previous fix from https://github.com/vllm-project/vllm/pull/3913 did not seem to work. Same issue still encountered.
```text
Collecting environment information...
I…
-
With many claiming that phi3 mini is uncannily good for it's size, and with larger, actually-useful phi3 models on the way, adding support for this arch is almost certainly worthwhile.
-
### Your current environment
我是 MiniCPM-Llama3-V 2.5 都不能用
运行minicpmv_example.py 报错:AttributeError: 'list' object has no attribute 'to'
环境:
```text
Collecting environment information...
PyTorc…
-
### System Info / 系統信息
版本信息
```
pip list
Package Version
--------------------------------- ------------
accelerate 0.30.0
addict …
-
The semantics of partially OOB writes was clarified in #1025. This has proved problematic for runtimes running on Arm, where there is no such guarantee in the architecture. I _think_ all now browsers …