search

alxndrTL / mamba.py

A simple and efficient Mamba implementation in pure PyTorch and MLX.
MIT License
960 stars 86 forks source link

MLX: workaround for torch.BFloat16Tensor + get rid of Python generator in mamba_lm_mlx.MambaLM.generate for UTF-8 multibyte characters like CJK, Thai and etc. #7

Closed beebopkim closed 8 months ago

beebopkim commented 8 months ago

MLX: workaround for torch.BFloat16Tensor MLX: get rid of Python generator in mamba_lm_mlx.MambaLM.generate for UTF-8 multibyte characters like CJK, Thai and etc.

beebopkim commented 8 months ago

This PR has code changes for issue #6.

alxndrTL commented 8 months ago

Thank you !