-
### System Info
accelerate 0.31.0
peft 0.11.1
transformers 4.42.4
bitsandbytes 0.41.1
##### The following packages…
-
已经通过源码构建transformers和vllm
完整报错信息如下:
```
Traceback (most recent call last):
File "/home/yu/anaconda3/envs/pt22cu121/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_co…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
Zmeo updated
2 months ago
-
**对vicuna-1.5-7b-16k 进行微调时的GPU情况是怎么样?模型并行 or 数据并行?**
**我们正在尝试使用8张3090(每张24G)复现微调模型的过程,但是发生了以下错误:**
File "/usr/local/miniconda3/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1…
-
### System Info
- `transformers` version: 4.41.0
- Platform: Linux-5.15.0-67-generic-x86_64-with-glibc2.31
- Python version: 3.10.13
- Huggingface_hub version: 0.23.0
- Safetensors version: 0.4…
-
### Your current environment
```text
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.3 LTS (x86_64)
GCC ve…
-
when I exctute code
`llm = LLM("/chinese-alpaca-2-13b", tensor_parallel_size=1)`
just worked fine
but when I change args like
`llm = LLM("/chinese-alpaca-2-13b", tensor_parallel_size=2)`
an erro…
-
### 🚀 The feature, motivation and pitch
Models are getting harder to fit on a limited number of GPUs and ADAM doesn't help since its memory overhead is 2N where N is the number of parameters in a m…
-
### Describe the bug
I'm recently trying to use a fine-tuned version of llama2 that supports Traditional Chinese.
https://huggingface.co/yentinglin/Taiwan-LLM-7B-v2.1-chat
The output text from Co…
-
### training qwe1.5-4b with tp=2 failed with embedding-table load error.
I start train job as follow.
### convert model
I convert the qwen1.5-4B model to tp=2 and pp=1,with command
```
/work…