Add integration with W&B

EducationalTestingService / skll

SciKit-Learn Laboratory (SKLL) makes it easy to run machine learning experiments.

http://skll.readthedocs.org

Other

550 stars 69 forks source link

Closed tamarl08 closed 6 months ago

tamarl08 commented 1 year ago

Add the option to log artifacts and metrics to W&B.

Basic wandb configuration will be added to the run_configuration config file.

If wandb logging is enabled, the following items will be logged:

Results from json/txt results files to W&B tables, one table for each learner/objective.
cross validation predictions for each fold.
Learning curve image as an artifact
config and log files
(Optional) model file(s) as artifacts

desilinguist commented 1 year ago

Another nicer integration would be to use W&B sweeps for hyper-parameter tuning rather than GridSearchCV locally.