search

THUDM / VisualGLM-6B

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型
Apache License 2.0
4.1k stars 418 forks source link

微调报Unable to load optimizer from checkpoint #92

Closed pokerG closed 1 year ago

pokerG commented 1 year ago

[2023-06-01 08:10:25,288] [INFO] [RANK 0] > number of parameters on model parallel rank 0: 7811237376 [2023-06-01 08:10:25,761] [INFO] [RANK 0] global rank 0 is loading checkpoint /root/.sat_models/visualglm-6b/1/mp_rank_00_model_states.pt [2023-06-01 08:10:33,854] [INFO] [RANK 0] Unable to load optimizer from checkpoint /root/.sat_models/visualglm-6b/1/mp_rank_00_model_states.pt, exiting. Specify --no-load-rng or --finetune to prevent attempting to load the random state.

pokerG commented 1 year ago

找到原因了， 加了个命令行参数 py_parser.add_argument('--model_name_or_path', type=str)

cFireworks commented 1 year ago

找到原因了， 加了个命令行参数 py_parser.add_argument('--model_name_or_path', type=str)

这个新加的参数是自定义的，怎么会影响微调呢？我也遇上了这个报错，想知道是资源问题还是依赖包问题。