search

scalanlp / breeze

Breeze is/was a numerical processing library for Scala.
https://www.scalanlp.org
Apache License 2.0
3.45k stars 693 forks source link

Column-wise sum results in ArrayIndexOutOfBounds #735

Closed changhiskhan closed 5 years ago

changhiskhan commented 5 years ago

I'm on Spark 2.3.0 which should be Breeze 0.13.2? Let me know if you need other info please. Integer overflow issue?

image

dlwh commented 5 years ago

breeze uses java arrays to back its dense matrices, so there's a hard limit of roughly 2^31 elements per matrix.