cavalab / srbench

A living benchmark framework for symbolic regression
https://cavalab.org/srbench/
GNU General Public License v3.0
203 stars 74 forks source link

Request for Instructions on How To run *just one* of the Experiments - to validate/debug the installation #88

Closed doliveira4 closed 1 year ago

doliveira4 commented 2 years ago

Hi there,

Would it be possible to add to your instructions how to exactly run just one of the several Experiments? Perhaps the simplest, fastest, non-empty, experiment - just for validation?

I can't get docker to finish executing, so I need to debug / validate my installation of 'srbench'. I'm completely new to this toolchain, so a bit lost.

Many thanks.

folivetti commented 2 years ago

in my experiments I executed the following steps for each dataset and seed:

source activate srbench
cd srbench/experiment
python evaluate_model.py ~/pmlb/datasets/192_vineyard/192_vineyard.tsv.gz -ml OperonRegressor -seed 11284

assuming that the datasets are at your home directory. You should replace OperonRegressor with your own regressor.

lacava commented 2 years ago

Also check the CI, which runs one experiment (very similar to above). this is in test_evaluate_model.py: https://github.com/cavalab/srbench/blob/master/experiment/test_evaluate_model.py

On Mon, Mar 28, 2022, 11:49 AM Fabricio Olivetti de Franca < @.***> wrote:

in my experiments I executed the following steps for each dataset and seed:

source activate srbenchcd srbench/experiment python evaluate_model.py ~/pmlb/datasets/192_vineyard/192_vineyard.tsv.gz -ml OperonRegressor -seed 11284

assuming that the datasets are at your home directory. You should replace OperonRegressor with your own regressor.

— Reply to this email directly, view it on GitHub https://github.com/cavalab/srbench/issues/88#issuecomment-1080820095, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABSGCGXDLI7I4YU6A6QY2BDVCHIJFANCNFSM5R3REC3A . You are receiving this because you are subscribed to this thread.Message ID: @.***>

Leoningel commented 2 years ago

Where can I find the used datasets?

Leoningel commented 2 years ago

Nevermind, found it (https://github.com/EpistasisLab/pmlb/tree/master)

lacava commented 1 year ago

appears resolved