search

ucsb-cs56-projects / cs56-utilities-calculator

-
1 stars 10 forks source link

Weird floating point math bugs #33

Closed nediamond closed 6 years ago

nediamond commented 7 years ago

For example: .2*3 = .600000000000000001

One possibility would be to fix this with a regex in displayResult()

MadRubicant commented 7 years ago

This is a display bug; fix it when converting to a string to display.

MadRubicant commented 7 years ago

F16 OK (50 pts)