[dot3] -inf bug - Githubissues

EightAndAHalfTails / eee3-imgtec-fpu

0 stars 0 forks source link

[dot3] -inf bug #149

Closed reginalio closed 10 years ago

reginalio commented 10 years ago

Warning: 3D dot product of 0:00111100:10000011000101001001110, 1:11110101:10100001001000011111011, 1:10001110:01000010100000100010000, 0:00001001:11011100011011101011100, 1:11111111:00000000000000000000000 and 0:00000000:01000101111000111110110 gives 1:10110011:00111011010110111111011 which is incorrect. Correct answer is 1:11111111:00000000000000000000000

probably error in multacc

gzf1992 commented 10 years ago

should be fixed in e81c3dedd21c7dcf6fb8aede2691867daae29394. Multacc needs to be tested for zero NaN infinity handling

gzf1992 commented 10 years ago

closed #149