TypeError: unsupported operand type(s) for *: 'Parameter' and 'NoneType'

[tf2bb]

Hi, thanks for this awesome work! When I ported to my own model, the following error occurred： Traceback (most recent call last): File "/opt/data/private/Pancreas/bd_dice_sam-med2d_6_0.9236_code/train.py", line 509, in main(args) File "/opt/data/private/Pancreas/bd_dice_sam-med2d_6_0.9236_code/train.py", line 435, in main train_losses, train_iter_metrics = train_one_epoch(args, model, optimizer, train_loader, epoch, criterion, trainset, criterion_CE, rankallocator, compute_orth_regu ) File "/opt/data/private/Pancreas/bd_dice_sam-med2d_6_0.9236_code/train.py", line 189, in train_one_epoch rankallocator.update_and_mask(model, epoch) File "/opt/data/private/Pancreas/AdaLoRA-main/loralib/loralib/adalora.py", line 313, in update_and_mask self.update_ipt(model) File "/opt/data/private/Pancreas/AdaLoRA-main/loralib/loralib/adalora.py", line 221, in update_ipt self.ipt[n] = (p p.grad).abs().detach() TypeError: unsupported operand type(s) for : 'Parameter' and 'NoneType'

[konioy]

Hello, I also encountered the same issue. how you solved it?

[konioy]

I solved the problem：

 for n,p in model.named_parameters():
        if "lora_" in n: 
            p.retain_grad()

But arguments ipt,exp_avg_ipt, and exp_avg_unc are all 0

[QingruZhang]

Thanks for your update! We will fix this error.

[shaozheliu]

I also encountered this problem but I can't solve it. It seems that when update_ipt, p.grand is None.

[clg0803]

I also encounter it 😭