No grad accumulator for a saved leaf

hustvl / Vim

[ICML 2024] Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

Apache License 2.0

2.55k stars 160 forks source link

No grad accumulator for a saved leaf #12

Open hzm-January opened 5 months ago

hzm-January commented 5 months ago

I get an error. ../torch/csrc/autograd/saved_variable.cpp":216, please report a bug to PyTorch. No grad accumulator for a saved leaf.

It's thrown at mamba_ssm\ops\selective_scan_interface.py backward(ctx, dout)

(xz, conv1d_weight, conv1d_bias, x_dbl, x_proj_weight, delta_proj_weight, 
         conv1d_out, delta, A, B, C, D, delta_bias, scan_intermediates, out) = ctx.saved_tensors

Could you please give me some hints? Thank you.

hzm-January commented 5 months ago

RuntimeError: !gradaccumulator.expired() INTERNAL ASSERT FAILED at "../torch/csrc/autograd/saved_variable.cpp":216, please report a bug to PyTorch. No grad accumulator for a saved leaf