search

roboptim / roboptim-shared-tests

RobOptim Shared Tests (to be used as a Git submodule)
1 stars 8 forks source link

Regroup tests by optimization problem "properties" #8

Open bchretien opened 10 years ago

bchretien commented 10 years ago

Different solvers can handle different kinds of problems: constrained or unconstrained, support for equality constraints etc. I guess we could find a way to help filter relevant problems for a given solver, rather than trying to launch the whole Schittkowski test suite or expect the developer to go through each problem to find the ones that could work.

I guess that information could be processed by tests.cmake or Schittkowski's CMakeLists.txt to only use relevant problems.

bchretien commented 10 years ago

We could also imagine something related: exporting the result of tests sorted by types to the RobOptim website. This may help users choose an adequate solver when considering a specific problem. We could add some JQuery magic with tick boxes (e.g. bounded arguments, nonlinear constraints, global solution) and display the results in an array for the problems that correspond to this query.

thomas-moulard commented 10 years ago

Did you have the Schittkowski original PDF, actually they do have tests types. For instance, PQR-T1-1 but I didn't have enough time yet to see what it means in detail. This may be a good way to put tests in different categories.

For the web/JQuery part, I am considering using the Google Charts API and making a bench generating JSON so that I can load it on the website directly. I just hope I will have enough time to do that ;)

bchretien commented 10 years ago

:+1: for the PDF (http://www.ai7.uni-bayreuth.de/test_problem_coll.pdf on page 18)