fortran-lang / stdlib

Fortran Standard Library
https://stdlib.fortran-lang.org
MIT License
1.02k stars 161 forks source link

least squares: relax test tolerance #809

Closed perazz closed 1 month ago

perazz commented 1 month ago

Problem: 1.0e-6 is too tight a tolerance for least squares on some systems (1.0e-6 << sqrt(epsilon(0.0)))

Example: failed CI job https://github.com/fortran-lang/stdlib/actions/runs/9015259889/job/24769521465

Solution: relax tolerance to 1.0e-4

cc: @jvdp1 @jalvesz