MzeroMiko mamba-mini issues

MzeroMiko / mamba-mini

An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivation. It is probably the code which is the most close to selective_scan_cuda in mamba.

71 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

SelectiveScanEasy forward result have Nan

#6 regainOWO opened 5 months ago
1
Is it possible for initialized the hidden space with given state (hprefix in your example)?

#5 pUmpKin-Co closed 7 months ago
1
Question about the usage of Hippo matrix in S6.

#4 Hiccupwzy opened 7 months ago
0
maybe there is someting wrong in the equation in the readme figure 1

#3 Hiccupwzy closed 7 months ago
2
How to implement parallel selective_scan in pytorch?

#2 lqniunjunlper opened 8 months ago
0
how to return last hidden state

#1 theAdamColton opened 8 months ago
2

MzeroMiko / mamba-mini

issues

SelectiveScanEasy forward result have Nan

Is it possible for initialized the hidden space with given state (hprefix in your example)?

Question about the usage of Hippo matrix in S6.

maybe there is someting wrong in the equation in the readme figure 1

How to implement parallel selective_scan in pytorch?

how to return last hidden state