Closed ut21 closed 2 months ago
Basically a mamba model with zigzag scan but can be plugged into other models by taking in a tensor of shape B, L, D and returning output tensor of the same shape? Something like: https://github.com/alxndrTL/mamba.py#usage
good proposal, I have put it in our plan. We will notify you when we have those impl. Cheers~
Basically a mamba model with zigzag scan but can be plugged into other models by taking in a tensor of shape B, L, D and returning output tensor of the same shape? Something like: https://github.com/alxndrTL/mamba.py#usage