search

EightAndAHalfTails / eee3-imgtec-fpu

0 stars 0 forks source link

[add_lza] cancellation bug #87

Closed reginalio closed 10 years ago

reginalio commented 10 years ago

Incorrect mantissa shift?

Warning: 0:00001001:11111111111110000111110+1:00001010:00000000010100011100000is 1:00000000:01010110000010000000000. Correct answer should be 1:00000000:10101011000001000000000

use testcases/ibm/add-cancellation_bin.txt for testing (1 error for add, 0 for sub)

0:00000110:00111011000111000000000+1:00000110:01000001010110110010000is 1:00000000:10001111110010000000000. Correct answer should be 1:00000000:11000111111001000000000

use testcases/ibm/add-cancellation-and-subnormal-result.txt (15 errors for add, 13 errors for sub)

gzf1992 commented 10 years ago

should be fixed by commit d69973eaf4fa80c90cfc36e820da79537dbaf5c4