gr812b / CVT-Simulator

Other
2 stars 0 forks source link

Peer Review - Cancellation errors under numerical stability #54

Open KyleJMcMaster opened 4 weeks ago

KyleJMcMaster commented 4 weeks ago

Artifact Under Review Hazard Analysis Team Number for Team Doing the Review Group 11 Description of Issue Would also be worth considering cancellation errors in the simulation of the CVT. If two numbers that are very similar to a high number of decimals are subtracted from each other, it can lead to very high error (catastrophic cancellation)