Kotlin / multik

Multidimensional array library for Kotlin
https://kotlin.github.io/multik/
Apache License 2.0
633 stars 38 forks source link

Resolve numerical error in packing of single-precision complex numbers in JS #169

Closed devcrocod closed 5 months ago

devcrocod commented 1 year ago

In our current approach to manipulating complex numbers in JS, we have identified a significant issue affecting the accuracy of computations. When we pack a single-precision complex number into a single data structure, and then unpack it, we have observed a numerical error in the calculations. Over large computations, this error accumulates, leading to a substantial overall numerical discrepancy.

Need: To implement a more reliable method for packing and unpacking complex numbers in javascript that preserves precision.