search

alxndrTL / mamba.py

A simple and efficient Mamba implementation in pure PyTorch and MLX.
MIT License
960 stars 86 forks source link

Mamba profiling_mamba.py script #13

Closed llmexperiment closed 7 months ago

llmexperiment commented 7 months ago

Hi,

Thanks for the repo! This is really useful!

1) I can not run the profiling_mamba.py It is missing these args "unfolded=True, rev=True, version='3'" in MambaConfig class.

alxndrTL commented 7 months ago

Thank you! Yes, this script was written with a dev version of the repo, it has been update now ;) (just had to remove the unfolded, rev, version arguments)

llmexperiment commented 7 months ago

Thanks Alex!

One more thing, I noticed that

https://github.com/alxndrTL/mamba.py/blob/main/tests/profiling_pscan.py is missing following two files?

from pscan_unfolded import pscan as pscan_unfolded from pscan_unfolded_rev import pscan as pscan_unfolded_rev

alxndrTL commented 7 months ago

Yes, it was the same problem, it is corrected now ;) (just have to remove the two lines and modify the pscan function which is being profiled)