Lỗi ko save final model khi dùng deepspeed

[tiendung]

Google: "deepspeed/runtime/engine.py" _load_checkpoint untimeError('Error(s) in loading state_dict for

  File "lora.py", line 176, in train
    trainer.train(resume_from_checkpoint=resume_from_checkpoint)

  File "/home/dungalex/.local/lib/python3.8/site-packages/deepspeed/runtime/engine.py", line 2634, in load_module_state_dict     
    self.module.load_state_dict(state_dict, # TODO
  File "/home/dungalex/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 2041, in load_state_dict
    raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for PeftModelForCausalLM:
        Missing key(s) in state_dict:

[tiendung]

dùng deepspeed stage2 (thi thoảng) vẫn xảy ra lỗi ?!?

[tiendung]

Tạm thời không dùng deepspeed