Open mpolson64 opened 16 hours ago
This pull request was exported from Phabricator. Differential Revision: D66305614
Attention: Patch coverage is 94.96021%
with 19 lines
in your changes missing coverage. Please review.
Project coverage is 95.77%. Comparing base (
4aa1d65
) to head (c7b8aeb
).
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
🚨 Try these New Features:
Summary: configure_runner and configure_metric allow users to attach custom Runners and Metrics to their experiment.
configure_runner is fairly straightforward and just sets experiment.runner
configure_metric is more complicated: given a list of IMetrics it iterates through and tries to find a metric with the same name somewhere on the experiment. In order it checks the Objective (single, MOO, or secularized), outcome constraints, then tracking metrics. If no metric with a matching name is found then the provided metric is added as a tracking metric.
Differential Revision: D66305614