loceyi / vlbiOrbitSimulation

MIT License
0 stars 4 forks source link

数据溢出问题 #8

Open loceyi opened 5 years ago

loceyi commented 5 years ago

302460601000;这是按照int数相乘,结果超出了int表示的范围,发生了上溢出,所以结果变成了负数,然后再将结果存放到long型变量中 改正的方式:

long b=302460601000L;

loceyi commented 5 years ago
  1. numpy currently does not do any integer over/underflow (or wraparound) checks at all for array operations. Only the scalar operators warn. 2.在用dot时,如果输入的是一个很大的int型数据,十分容易溢出