search

stylewarning / hypergeometrica

Livin' like it's 1813 (or 1988).
BSD 3-Clause "New" or "Revised" License
30 stars 6 forks source link

Confusion over rounding, truncation, significant figures, and precision. #48

Open stylewarning opened 1 year ago

stylewarning commented 1 year ago

Lots of bugs have popped up due to sloppy conflation of these terms.

Moreover, we've been inconsistent in asking for "bits of precision", "digits of precision", etc.

We need to comb through the code and be very precise on what we mean.