[Feature] Matmul for CPU

ml-explore / mlx

MLX: An array framework for Apple silicon

https://ml-explore.github.io/mlx/

MIT License

17.31k stars 1k forks source link

[Feature] Matmul for CPU #1511

Open zcbenz opened 3 weeks ago

zcbenz commented 3 weeks ago

Some of the most popular models provide weights in bfloat16, which unfortunately can not load on CPU because Matmul::eval_cpu only supports float32.

I know CPU support is not on priority, but it would be great if my code can run on other platforms than mac arm64 even being very slow.

thegodone commented 3 weeks ago

maybe this can be also interesting to look at https://github.com/microsoft/BitNet