search

E3SM-Project / polaris

Testing and analysis for OMEGA, MPAS-Ocean, MALI and MPAS-Seaice
BSD 3-Clause "New" or "Revised" License
6 stars 13 forks source link

Known issue in `ocean_manufactured_solution_convergence` causing PR suite to fail #89

Closed altheaden closed 1 year ago

altheaden commented 1 year ago

Hello! I was trying to run the PR suite with the current main branch on Chrysalis, and I ran into an issue:

      Failed
Exception raised while running the steps of the test case
Traceback (most recent call last):
  File "/gpfs/fs1/home/ac.althea/code/polaris/main/polaris/run/serial.py", line 310, in _log_and_run_test
    _run_test(test_case, available_resources)
  File "/gpfs/fs1/home/ac.althea/code/polaris/main/polaris/run/serial.py", line 409, in _run_test
    _run_step(test_case, step, test_case.new_step_log_file,
  File "/gpfs/fs1/home/ac.althea/code/polaris/main/polaris/run/serial.py", line 484, in _run_step
    step.run()
  File "/gpfs/fs1/home/ac.althea/code/polaris/main/polaris/ocean/tests/manufactured_solution/analysis.py", line 76, in run
    raise ValueError(f'order of convergence '
ValueError: order of convergence  0.8311990500398592 < min tolerence 1.8

This is a known issue in the ocean_manufactured_solution_convergence test, causing the analysis step to fail (as mentioned in https://github.com/E3SM-Project/polaris/pull/72#issue-1728151874).

Ideally, I think the test should be removed from the PR suite until it's not failing anymore so it doesn't impede testing for incoming changes in the meantime (e.g., baseline testing against the main branch).