Closed pqhgit closed 2 weeks ago
In my experiments, I change it to master_param = optimizer.working_to_master_param[param_id]
.
@narrowsnap this worked, thx
modify /xxx/OpenSora1.0/opensora/utils/train_utils.py", line 31 -> master_param = optimizer.working_to_master_param[param_id] solved.
pip install colossalai==0.4.0
This issue is stale because it has been open for 7 days with no activity.
This issue was closed because it has been inactive for 7 days since being marked as stale.
After changing it to master_param = optimizer.working_to_master_param[param_id]
, I still have the AttributeError: : 'LowLevelZeroOptimizer' object has no attribute 'working_to_master_param'
. Can anyone help?
After changing it to
master_param = optimizer.working_to_master_param[param_id]
, I still have theAttributeError: : 'LowLevelZeroOptimizer' object has no attribute 'working_to_master_param'
. Can anyone help?
What's your version of colossalai?
Traceback (most recent call last): File "/xxx/OpenSora1.0/scripts/train.py", line 328, in
main()
File "/xxx/OpenSora1.0/scripts/train.py", line 270, in main
update_ema(ema, model.module, optimizer=optimizer)
File "/usr/local/python-3.10.13/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/xxx/OpenSora1.0/opensora/utils/train_utils.py", line 31, in update_ema
master_param = optimizer._param_store.working_to_master_param[param_id]
AttributeError: 'LowLevelZeroOptimizer' object has no attribute '_param_store'
I can't find any class with 'LowLevelZeroOptimizer' or '_param_store' in this project, how to fix it?