This is derived from #43. Thanks to @venzen for designing and implementing the test framework. Comments are welcome.
I was able to create and run custom tests locally using the instructions in tests/README.md. The instructions are clear and easy to follow.
I added a short deterministic test named "det0" in tests/configs/testapp.ini with a record of the results I get on my computer. But I'm concerned that not all C++ libraries implement their floating point libraries in exactly the same way, such that the precise expected results might not compare equal in all environments.
With testapp.py, I don't see a need to retain that old hardcoded shell script test (simtest.sh). I think I'll remove it from the tests directory and remove its reference from the README unless someone suggests a reason to keep it.
This is derived from #43. Thanks to @venzen for designing and implementing the test framework. Comments are welcome.
I was able to create and run custom tests locally using the instructions in tests/README.md. The instructions are clear and easy to follow.
I added a short deterministic test named "det0" in tests/configs/testapp.ini with a record of the results I get on my computer. But I'm concerned that not all C++ libraries implement their floating point libraries in exactly the same way, such that the precise expected results might not compare equal in all environments.
With testapp.py, I don't see a need to retain that old hardcoded shell script test (simtest.sh). I think I'll remove it from the tests directory and remove its reference from the README unless someone suggests a reason to keep it.