search

simopt-admin / simopt

A testbed of simulation-optimization problems and solvers
MIT License
57 stars 24 forks source link

Tests Failing on dev_wagrocho_fix_view_edit_ps #77

Open Grochocinski opened 18 hours ago

Grochocinski commented 18 hours ago

Describe the Bug

test_run is failing for CNTNEWS1_SPSA, IRONORECONT1_ASTRODF, and IRONORECONT1_SPSA on dev_wagrocho_fix_view_edit_ps

Steps To Reproduce

Run test_CNTNEWS1_SPSA, test_IRONORECONT1_ASTRODF, and test_IRONORECONT1_SPSA

Expected Behavior

These tests should not error out.

Environment

Please provide some details about your environment to help us replicate the bug:

Grochocinski commented 17 hours ago

These 3 tests also fail on development.

test_CNTNEWS1_SPSA:

  File "c:\Users\will_\Documents\Repos\simopt\test\test_CNTNEWS1_SPSA.py", line 59, in test_run
    self.assertAlmostEqual(self.myexperiment.all_intermediate_budgets[mrep][list], self.expected_all_intermediate_budgets[mrep][list], 5, "Intermediate budgets for problem " + self.expected_problem_name + " and solver " + self.expected_solver_name + " do not match at mrep " + str(mrep) + " and index " + str(list) + ".")
AssertionError: 690 != 930 within 5 places (240 difference) : Intermediate budgets for problem CNTNEWS-1 and solver SPSA do not match at mrep 0 and index 9.

test_IRONORECONT1_ASTRODF:

  File "c:\Users\will_\Documents\Repos\simopt\test\test_IRONORECONT1_ASTRODF.py", line 46, in test_run
    self.assertEqual(len(self.myexperiment.all_recommended_xs[mrep]), len(self.expected_all_recommended_xs[mrep]), "Length of recommended solutions for problem " + self.expected_problem_name + " and solver " + self.expected_solver_name + " do not match.")
AssertionError: 7 != 5 : Length of recommended solutions for problem IRONORECONT-1 and solver ASTRODF do not match.

test_IRONORECONT1_SPSA:

  File "c:\Users\will_\Documents\Repos\simopt\test\test_IRONORECONT1_SPSA.py", line 46, in test_run
    self.assertEqual(len(self.myexperiment.all_recommended_xs[mrep]), len(self.expected_all_recommended_xs[mrep]), "Length of recommended solutions for problem " + self.expected_problem_name + " and solver " + self.expected_solver_name + " do not match.")
AssertionError: 5 != 4 : Length of recommended solutions for problem IRONORECONT-1 and solver SPSA do not match.