Open SFrijters opened 9 years ago
Warnings are now issued for tests that take too long.
Can now shorten tests by adding the "coverage" parameter to the test json, with appropriate parameter overrides (usually something like 'lb.timesteps = 1'). Can now also shorten tests by adding the "fast" parameter to the test json, with appropriate parameter overrides and comparison overrides.
Array tokens such as %lb.force.gcc[0][1]% can now be expanded in comparisons.
Tests now take a lot less time. Warnings will be shown if runtime is exceeded.
Can now restore from checkpoint.
Allow to specify differentiate between coverage tests, Travis CI runnable tests (as short as possible) and physics tests (to be manually checked). Normally these would be the same simulations, with the physics tests running as long as necessary to obtain physically correct results, the automated tests running only long enough such that diffing makes sense, and the coverage tests running ideally for only one timestep.Allow array token replacement in testing scripts (e.g. properly expand %lb.force.gcc[0][1]%).Add option to restore from checkpoint in tests.For Travis testing:
Tests should not last longer than a few seconds.Add warning if a test takes longer than ~30s.