Closed he010103 closed 6 years ago
I donnot understand the code param_groups = [{'params': finetuned_params, 'lr': cfg.finetuned_params_lr}, {'params': new_params, 'lr': cfg.new_params_lr}]. Do you train two types of the parameters so as to compare the map of them? Thanks
param_groups = [{'params': finetuned_params, 'lr': cfg.finetuned_params_lr}, {'params': new_params, 'lr': cfg.new_params_lr}]
I know the answer now. Thanks!
he010103
commented
6 years ago
I donnot understand the code
param_groups = [{'params': finetuned_params, 'lr': cfg.finetuned_params_lr}, {'params': new_params, 'lr': cfg.new_params_lr}]. Do you train two types of the parameters so as to compare the map of them? Thanks