search

OpenMDAO / Aviary

NASA's aircraft analysis, design, and optimization tool
https://openmdao.github.io/Aviary/
Other
106 stars 51 forks source link

Add regression testing capability #359

Open jkirk5 opened 3 days ago

jkirk5 commented 3 days ago

Desired capability or behavior.

via @robfalck As we're reworking phases, we can check performance against the nominal GASP results but that data isn't very detailed. We should also save more detailed results from each run (the test_phase scripts (currently run_phase scripts) should nominally test against this regression data using the assert_timeseries_near_equal function in dymos.

To do this, we should save all timeseries data off using the numpy.savetxt function in order to keep it as ascii (which is better for git than the binary database files). The regression testing scripts should optionally overwrite current regression data when the team decides it is appropriate to do so.

Is your feature request related to a problem? Please describe.

No response

Associated Bug Report

No response

jkirk5 commented 3 days ago

This suggestion needs to be re-visited for the current Aviary version - do we still desire this capability?