automl / HPOlib1.5

GNU General Public License v3.0
69 stars 27 forks source link

Unittests #37

Closed KEggensperger closed 7 years ago

KEggensperger commented 7 years ago

This PR adds two new unittests

1) check whether RNGs are used correctly 2) Evaluate random configurations (using pynisher to terminate long running cfgs)

NOTE PR #17 must be merged before this PR can be merged

codecov-io commented 7 years ago

Codecov Report

Merging #37 into development will increase coverage by 14.17%. The diff coverage is 83.73%.

Impacted file tree graph

@@               Coverage Diff                @@
##           development      #37       +/-   ##
================================================
+ Coverage        41.75%   55.93%   +14.17%     
================================================
  Files               23       26        +3     
  Lines             1104     1314      +210     
================================================
+ Hits               461      735      +274     
+ Misses             643      579       -64
Impacted Files Coverage Δ
hpolib/util/openml_data_manager.py 95.12% <100%> (+25.24%) :arrow_up:
hpolib/abstract_benchmark.py 86.66% <100%> (+5.71%) :arrow_up:
hpolib/util/data_manager.py 72.78% <100%> (+13.02%) :arrow_up:
hpolib/benchmarks/ml/logistic_regression.py 50% <63.41%> (+50%) :arrow_up:
hpolib/util/rng_helper.py 86.66% <86.66%> (ø)
hpolib/util/dependencies.py 92.15% <92.15%> (ø)
hpolib/benchmarks/ml/autosklearn_benchmark.py 95.12% <95.12%> (ø)
... and 4 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 763008e...92b7370. Read the comment docs.