Open RedekopEP opened 2 months ago
Hi! Is there an established way to get mamba interpretability, smth similar to self-attention analysis in transformers. Thank you!
You can probably construct sth similar to the attention matrix https://arxiv.org/abs/2403.01590
Hi! Is there an established way to get mamba interpretability, smth similar to self-attention analysis in transformers. Thank you!