ymcui / Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
Apache License 2.0
7k stars 570 forks source link

binascii.Error: Incorrect padding:How to solve it? #569

Closed Bleado closed 1 week ago

Bleado commented 1 month ago

提交前必须检查以下项目

问题类型

模型训练与精调

基础模型

Chinese-Alpaca-2 (7B/13B)

操作系统

Linux

详细描述问题

!bash /content/drive/MyDrive/Chinese-LLaMA-Alpaca-2-main/scripts/training/run_sft.sh

依赖情况(代码类问题务必提供)

!pip install -q accelerate==0.21.0 peft==0.4.0 bitsandbytes==0.40.2 transformers==4.31.0 trl==0.4.7 deepspeed==0.9.4

运行日志或截图

[rank0]: Traceback (most recent call last):
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/accelerate/utils/deepspeed.py", line 52, in __init__
[rank0]:     config_decoded = base64.urlsafe_b64decode(config_file_or_dict).decode("utf-8")
[rank0]:   File "/usr/lib/python3.10/base64.py", line 133, in urlsafe_b64decode
[rank0]:     return b64decode(s)
[rank0]:   File "/usr/lib/python3.10/base64.py", line 87, in b64decode
[rank0]:     return binascii.a2b_base64(s)
[rank0]: binascii.Error: Incorrect padding
github-actions[bot] commented 2 weeks ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

github-actions[bot] commented 1 week ago

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.