search

OpenBMB / CPM-Live

Live Training for Open-source Big Models
511 stars 40 forks source link

TypeError: __init__() got an unexpected keyword argument 'scale' #380

Closed qinqinqaq closed 1 year ago

qinqinqaq commented 1 year ago

AdamOffloadOptimizer is no such parameter: scale

self.optimizer = bmt.optim.AdamOffloadOptimizer( model.parameters(), weight_decay=0.01, scale=1048576 )

Traceback (most recent call last): File "tune_cpm_ant.py", line 33, in tune = config_dict["tune"]( File "/home/shanhoo3/fkb/remote_project/cpm/cpm-live/examples/tune.py", line 291, in init super().init(**kwargs) File "/home/shanhoo3/fkb/remote_project/cpm/cpm-live/examples/tune.py", line 57, in init self.optimizer = bmt.optim.AdamOffloadOptimizer( TypeError: init() got an unexpected keyword argument 'scale'

zh-zheng commented 1 year ago

use pip install bmtrain==0.1.8.post1 for this project.