Open huangjch526 opened 2 months ago
Hello, may I ask what's your deepspeed and accelerate version? When I set --deepspeed_plugin ${PROJ_PATH}/configs/accelerate/deepspeed_stage_3.yaml, I met Bug that all the parameters in the llm network become empty like [].
Hi, deepspeed=0.11.2 works.
geyuying
commented
1 month ago
Hello, may I ask what's your deepspeed and accelerate version? When I set --deepspeed_plugin ${PROJ_PATH}/configs/accelerate/deepspeed_stage_3.yaml, I met Bug that all the parameters in the llm network become empty like [].