ml-explore / mlx

MLX: An array framework for Apple silicon
https://ml-explore.github.io/mlx/
MIT License
15.01k stars 855 forks source link

Fix quantization of all 0s #1028

Closed angeloskath closed 1 month ago

angeloskath commented 1 month ago

Set the minimum scale to 1e-7 so that the bias doesn't become nan if the scale is 0.