OpenGVLab / VideoMamba

VideoMamba: State Space Model for Efficient Video Understanding
https://arxiv.org/abs/2403.06977
Apache License 2.0
660 stars 47 forks source link

TypeError: causal_conv1d_fwd(): incompatible function arguments. The following argument types are supported: #37

Closed Sine7812 closed 2 months ago

Sine7812 commented 2 months ago

Traceback (most recent call last): File "/mnt/e/code/VideoMamba-main/videomamba/video_sm/run_class_finetuning.py", line 718, in main(opts, ds_init) File "/mnt/e/code/VideoMamba-main/videomamba/video_sm/run_class_finetuning.py", line 635, in main train_stats = train_one_epoch( File "/mnt/e/code/VideoMamba-main/videomamba/video_sm/engines/engine_for_finetuning.py", line 77, in train_one_epoch loss, output = train_class_batch( File "/mnt/e/code/VideoMamba-main/videomamba/video_sm/engines/engine_for_finetuning.py", line 16, in train_class_batch outputs = model(samples) File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl return self._call_impl(*args, kwargs) File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl return forward_call(*args, *kwargs) File "/mnt/e/code/VideoMamba-main/videomamba/video_sm/models/videomamba.py", line 366, in forward x = self.forward_features(x, inference_params) File "/mnt/e/code/VideoMamba-main/videomamba/video_sm/models/videomamba.py", line 339, in forward_features hidden_states, residual = layer( File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl return self._call_impl(args, kwargs) File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl return forward_call(*args, kwargs) File "/mnt/e/code/VideoMamba-main/videomamba/video_sm/models/videomamba.py", line 94, in forward hidden_states = self.mixer(hidden_states, inference_params=inference_params) File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl return self._call_impl(*args, *kwargs) File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl return forward_call(args, kwargs) File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/mamba_ssm-1.0.1-py3.10-linux-x86_64.egg/mamba_ssm/modules/mamba_simple.py", line 185, in forward out = mamba_inner_fn_no_out_proj( File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/mamba_ssm-1.0.1-py3.10-linux-x86_64.egg/mamba_ssm/ops/selective_scan_interface.py", line 632, in mamba_inner_fn_no_out_proj return MambaInnerFnNoOutProj.apply(xz, conv1d_weight, conv1d_bias, x_proj_weight, delta_proj_weight, File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/torch/autograd/function.py", line 553, in apply return super().apply(*args, *kwargs) # type: ignore[misc] File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/torch/cuda/amp/autocast_mode.py", line 115, in decorate_fwd return fwd(args, **kwargs) File "/home/jcz/anaconda3/envs/mamba/lib/python3.10/site-packages/mamba_ssm-1.0.1-py3.10-linux-x86_64.egg/mamba_ssm/ops/selective_scan_interface.py", line 177, in forward conv1d_out = causal_conv1d_cuda.causal_conv1d_fwd(x, conv1d_weight, conv1d_bias, True) TypeError: causal_conv1d_fwd(): incompatible function arguments. The following argument types are supported:

  1. (arg0: torch.Tensor, arg1: torch.Tensor, arg2: Optional[torch.Tensor], arg3: Optional[torch.Tensor], arg4: Optional[torch.Tensor], arg5: Optional[torch.Tensor], arg6: bool) -> torch.Tensor 类型不匹配是为什么啊?源代码没有改动过
whelentyn commented 2 months ago

What was your solution for this?

kkkkkkkb commented 2 months ago

请问最后是怎么解决的~!