rutgers-apl / rlibm-generator

A tool to generate approximations of elementary functions that produce the correctly rounded result for all inputs. This tool can be used for different representations that approximate real numbers.
Other
11 stars 3 forks source link

Fix incorrect interval in CalculateInterval and 2's complement issue in convertPositToDouble for posit16 #1

Closed jpl169 closed 4 years ago

jpl169 commented 4 years ago

Fix the issue in CalculateInterval and convertPositToDouble for posit16.

1 -maxpos for posit16 is 0x8001.

2 Use ~x + 1 to compute 2's complement