On Mac "Explorer single" regression test fails with 4e-7 inaccuracies.

alan-turing-institute / ThermodynamicAnalyticsToolkit

Sampling-based approach to analyse neural networks using TensorFlow

https://alan-turing-institute.github.io/ThermodynamicAnalyticsToolkit/

GNU General Public License v3.0

22 stars 3 forks source link

On Mac "Explorer single" regression test fails with 4e-7 inaccuracies. #25

Closed FrederikHeber closed 5 years ago

FrederikHeber commented 6 years ago

Run file differs from step 20 onwards in columns 5,6,7 by about 4e-7.

This was on the following system: uname -m = x86_64 uname -r = 17.5.0 uname -s = Darwin uname -v = Darwin Kernel Version 17.5.0: Mon Mar 5 22:24:32 PST 2018; root:xnu-4570.51.1~1/RELEASE_X86_64

FrederikHeber commented 6 years ago

Postponing until I get hold of full testsuite.log from the respective test folder, @ZofiaTr.

FrederikHeber commented 5 years ago

I have added the configure parameter TATI_TEST_THRESHOLD which might need setting to 4e-7 or similar to allow tests run flawlessly.

Tensorflow does not emphasize determinism but speed, see https://github.com/tensorflow/tensorflow/issues/18096 for a recent issue request.