-
**Is your feature request related to a problem? Please describe.**
Currently, if a step in a pipeline fails, an exception is raised and any information from the previous steps is lost. This is proble…
-
### 先决条件
- [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。
- [X] 错误在 [最新版本](https://github.com/open-com…
-
### Your current environment
```text
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 20.04.6 LTS (x86_64)
GCC …
-
Example of command:
```python benchmark_throughput.py --model gpt2 --input-len 256 --output-len 256```
Output:
```Namespace(backend='vllm', dataset=None, input_len=256, output_len=256, model='gpt…
rlrs updated
2 months ago
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
…
-
Dear Flapi developers,
First and foremost, I want to express my sincere gratitude for developing Flapi. This library has the potential to greatly enhance workflow automation in FL Studio, and I'm…
LL1yt updated
1 month ago
-
### System Info
- CPU: i9 9900k
- GPU: RTX 4090
- TensorRT-LLM Version: 0.9.0.dev2024022000
- Cuda Version: Cuda 12.3
- Driver Version: 545.29.06
- OS: Arch Linux, kernel version 6.7.5
### …
-
### System Info / 系統信息
ubuntu 20.04
python 3.10
```bash
➜ ~ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Mon_Apr__3_17:16:06_PDT_2…
-
### Your current environment
环境:
torch 2.3.0
vllm 0.5.0.post1
transformers 4.41.2
主要报错情况:
moe小一点的模型 '/data/models/qwen/qwen1.5-2.7Bmoe' 不会出问题
对于大一点的就报错如最下面。
代码:
from vllm.engine.arg_ut…
-
I encountered the following error while training with 'vicuna-13b-v1.1':
File "/root/MiniGPT-4/minigpt4/models/minigpt_base.py", line 41, in __init__
self.llama_model, self.llama_tokenizer = …