This pull request adds an initial set of fast to run, small output, .conf files for use as a check of consistent numerical behaviour following code modifications.
It also renames nf_configs to nf_numerical and updates it to make it use these new .conf files.
Up to this point we had been using existing example .conf files from the ./configs directly to test constancy of numerical results following code changes. However, these had longer than ideal run time and much larger than ideal output size. As a result, they were not being run as often as they should be and had fallen out of sync with the code.
As these new .conf files greatly improve on this situation, it is hoped that they will be more useful for their intended purpose.
Over time additional numerical test files should be added, making sure to adhere to the run-time of less than a few seconds and output less than 500 kB.
This pull request adds an initial set of fast to run, small output,
.conf
files for use as a check of consistent numerical behaviour following code modifications.It also renames
nf_configs
tonf_numerical
and updates it to make it use these new.conf
files.Up to this point we had been using existing example
.conf
files from the./configs
directly to test constancy of numerical results following code changes. However, these had longer than ideal run time and much larger than ideal output size. As a result, they were not being run as often as they should be and had fallen out of sync with the code.As these new
.conf
files greatly improve on this situation, it is hoped that they will be more useful for their intended purpose.Over time additional numerical test files should be added, making sure to adhere to the run-time of less than a few seconds and output less than 500 kB.