Regarding the issue with the CrossMamba block

alexhe101 / Pan-Mamba

Pan-Mamba: Effective Pan-Sharpening with State Space Model

https://arxiv.org/abs/2402.12192

71 stars 7 forks source link

Regarding the issue with the CrossMamba block #17

Open ZHUXIUJINChris opened 3 months ago

ZHUXIUJINChris commented 3 months ago

Thank you for the excellent work! 1719685514095

In this block, how does a single gated Z control both paths? I couldn't find it in the code. How exactly is it connected? Could you tell me the specific location in the code?

wVelpro commented 2 months ago

I have the same question.

alexhe101 commented 2 months ago

In function: mamba_inner_fn_no_out_proj https://github.com/alexhe101/Pan-Mamba/blob/main/Mamba-block/mamba_simple.py#L19

ZHUXIUJINChris commented 2 months ago

Thank you for your response. Is this gating operation originally present in VisionMamba and Mamba? Will using this function twice separately in "V3" form this connection?

I only saw this place using Z in the underlying code.

1719980704819