多卡运行 OMP_NUM_THREADS=1 torchrun --standalone --nnodes=1 --nproc_per_node=8 finetune_hf.py data/AdvertiseGen/ THUDM/chatglm3-6b configs/lora.yaml configs/ds_zero_2.json

[cqray1990]

System Info / 系統信息

ubantu 20.04 cuda 12.1 cudnn 8.9

configs/ds_zero_2.json The specified checkpoint sn(configs/ds_zero_2.json) has not been saved. Please search for the correct chkeckpoint in the model output directory

Who can help? / 谁可以帮助到您？

configs/ds_zero_2.json The specified checkpoint sn(configs/ds_zero_2.json) has not been saved. Please search for the correct chkeckpoint in the model output directory

Information / 问题信息

• [ ] The official example scripts / 官方的示例脚本
• [ ] My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

configs/ds_zero_2.json The specified checkpoint sn(configs/ds_zero_2.json) has not been saved. Please search for the correct chkeckpoint in the model output directory

Expected behavior / 期待表现

configs/ds_zero_2.json The specified checkpoint sn(configs/ds_zero_2.json) has not been saved. Please search for the correct chkeckpoint in the model output directory