Error making a simple division

sharkdp / insect

High precision scientific calculator with support for physical units

https://numbat.dev/

MIT License

3.18k stars 126 forks source link

Closed adrianlzt closed 1 year ago

adrianlzt commented 1 year ago

  1694173011 / 60 = 28236200

But the real result is 28236216.85

Looks like ans have the real result:

>>> 1694173011/60

  1694173011 / 60

   = 28236200

>>> ans * 60

  ans × 60

   = 1694173011

>>> 28236200 * 60

  28236200 × 60

   = 1694172000

Qyriad commented 1 year ago

Think this is the same as #154?

adrianlzt commented 1 year ago

Looks like