LSSTDESC / firecrown

DESC Cosmology Likelihood Framework
BSD 3-Clause "New" or "Revised" License
30 stars 7 forks source link

Relax relative tolerance from 1e-8 to 1e-6 #472

Closed marcpaterno closed 6 days ago

marcpaterno commented 6 days ago

Description

The CI testing is currently failing because of 3 tests which require a numerical answer to match with a tolerance of 1e-8. This PR will "fix" the problem by relaxing the tolerance to 1e-6.

Type of change

Please delete the bullet items below that do not apply to this pull request.

The following checklist will make sure that you are following the code style and guidelines of the project as described in the contributing page.

codecov[bot] commented 6 days ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 99.9%. Comparing base (e229d35) to head (4ff37c9).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #472 +/- ## ====================================== Coverage 99.9% 99.9% ====================================== Files 54 54 Lines 4142 4142 ====================================== Hits 4139 4139 Misses 3 3 ```
marcpaterno commented 6 days ago

It was a change in CCL that caused the change in calculated results.

The purpose of these tests is to ensure no regressions in the theory calculations. Thus this is the wrong fix; we should update the expected values, and keep the tight tolerances.