Open adavies42 opened 1 year ago
Apparently q switches to exponential notation if the exponent is less than -4 or greater than 16. Do we want to mirror this behavior in studio? Or should it be configurable, like there is already a "decimal digits" setting? Using that setting it's possible to view this number as non-zero, although it still uses the full decimal notation, e.g. setting it to 20 gives 0.000000000007275958f
.
studio rounds very small floats to zero, which q never does
e.g. enter
7.275958e-12
in studio and run it, and it returns0f
, while the q console would say7.275958e-12
for the same input