search

arikdan / as3xls

Automatically exported from code.google.com/p/as3xls
0 stars 0 forks source link

[PATCH] Correct FormulaCase.testSingleArg to work on greater precision systems (Players?) #2

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
Not sure just what causes this but evaluating 
"=PI()*SIN(-375)+COS(99)-TAN(-1+2)+ATAN(SIN(5))" 
on my system produces a number that's 16 significant digits, but the test case 
only uses 15.  The 
attached patch sets the precision for both sides of the assertEquals to 15 
significant digits.

Original issue reported on code.google.com by scha...@gmail.com on 22 Feb 2008 at 3:42

Attachments: