-
### Required prerequisites
- [X] I have read the documentation .
- [X] I have searched the [Issue Tracker](https://github.com/baichuan-inc/baichuan-7B/issues) and [Discussions](https://github.com/bai…
-
在deepspeed启动训练的.py文件中使用AutoModelForCausalLM.from_pretrained加载baichuan-inc/Baichuan2-7B-Intermediate-Checkpoints中的checkpoint太慢，加载7B的模型都需要几十分钟。
但是在jupyter notebook中加载就很快，几十秒能完成。
或者用deepspeed加载7B-bas…
-
在自己的数据集上做SFT报错矩阵维度不匹配，然后用示例数据也是报同样的错误，如下图所示：
配置文件：
```
{
"output_dir": "output/firefly-baichuan-7b-qlora-sft",
"model_name_or_path": "baichuan-inc/baichuan-7B",
"train_file": "./…
-
### 先决条件
- [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。
- [X] 错误在 [最新版本](https://github.com/open-com…
-
- [✅] I checked to make sure that this is not a duplicate issue
- [ ] I'm submitting the request to the correct repository (for model requests, see [here](https://github.com/shibing624/text-generatio…
AILWQ updated
10 months ago
-
tokenizer: `moka-ai/m3e-base`
错误：
```shell
Traceback (most recent call last):
File "webui_xbl_stable.py", line 449, in
model_status = init_model()
File "webui_xbl_stable.py", line 166…
-
when I start recover training Baichuan-7B, I meet the bug.
Exception has occurred: RuntimeError
Caught RuntimeError in replica 1 on device 1.
Original Traceback (most recent call last):
File "…
-
错误信息如下
╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ /Users/corlin/code/Efficient-Tuning-LLMs/qlora_finetune.py:396 in …
-
### Required prerequisites
- [X] I have read the documentation .
- [X] I have searched the [Issue Tracker](https://github.com/baichuan-inc/baichuan-7B/issues) and [Discussions](https://github.com/bai…
-
一张A100 40g显卡，服务器内存30g，本地下载了最新的baichuan2-7b-base模型文件，安装环境也是按照requirement的要求安装的，使用github提供的脚本在运行：
model = AutoModelForCausalLM.from_pretrained("/home/baichuan/baichuan_funtuning/Baichuan2/baichuan2_7b_…