EducationalTestingService / skll

SciKit-Learn Laboratory (SKLL) makes it easy to run machine learning experiments.
http://skll.readthedocs.org
Other
552 stars 67 forks source link

Add `neg_root_mean_squared_error` metric and objective for regressors #741

Closed desilinguist closed 1 year ago

desilinguist commented 1 year ago

To test this, run one of the California example config files with this new metric as either the objective or one of the output metrics.

Closes #555.

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage has no change and project coverage change: +0.08 :tada:

Comparison is base (c0ebc36) 95.10% compared to head (fb1ce25) 95.19%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #741 +/- ## ========================================== + Coverage 95.10% 95.19% +0.08% ========================================== Files 29 29 Lines 3535 3535 ========================================== + Hits 3362 3365 +3 + Misses 173 170 -3 ``` | [Impacted Files](https://app.codecov.io/gh/EducationalTestingService/skll/pull/741?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=EducationalTestingService) | Coverage Δ | | |---|---|---| | [...utils/commandline/compute\_eval\_from\_predictions.py](https://app.codecov.io/gh/EducationalTestingService/skll/pull/741?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=EducationalTestingService#diff-c2tsbC91dGlscy9jb21tYW5kbGluZS9jb21wdXRlX2V2YWxfZnJvbV9wcmVkaWN0aW9ucy5weQ==) | `97.50% <ø> (ø)` | | | [skll/utils/constants.py](https://app.codecov.io/gh/EducationalTestingService/skll/pull/741?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=EducationalTestingService#diff-c2tsbC91dGlscy9jb25zdGFudHMucHk=) | `100.00% <ø> (ø)` | | ... and [2 files with indirect coverage changes](https://app.codecov.io/gh/EducationalTestingService/skll/pull/741/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=EducationalTestingService)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.