Open norbertwenzel opened 5 years ago
Take a look at the difference with the reference file https://github.com/devernay/cminpack/blob/master/examples/ref/tlmdifc.ref . In this case, the second and third column of the cov matrix are slightly different. I've seen floating point computation, especially when optimized, behave slightly differently on different OSs/architectures. If the difference is non-significative, then you should consider that the tests pass. I agree that the tests should be rewritten to handle that, but "diff" was all I had when the tests were written.
For other architectures (aarch64, ppc64le, ...) every second test fails due to numeric differences.
Yes, this is a known issue, feel free to contribute a better est validation that using diff
on the text output
I've been experimenting with numdiff, it's not ideal either. Let's say that the tests are supposed to pass on CI platforms, but on your own machine YMMV, especially if you use BLAS.
There is a better MINPACK test suite in https://github.com/cbouilla/minpack-1.1 (see https://github.com/cbouilla/minpack-1.1/issues/1)
I've simply cloned the repo (master & v1.3.6) and used CMake to build and run the tests. But one test fails on consistently on all platforms (Linux, Mac, Windows). I could not find any open issues about a failing test therefore I thought I'd ask whether this is known and/or to be expected.
Steps to reproduce:
Clone repository and change to project's root folder. In this folder run:
Result:
The test output written to
build/examples/tlmdifc.out
is:These results are from a run on Ubuntu Bionic amd64 but the very same test also failed for me on Mac and Windows.