Closed lorenzoh closed 2 years ago
This would allow running expensive metrics only during validation phases.
Currently, you can pass functions or a Metric to the Metrics callback:
Metric
Metrics
cb = Metrics( accuracy, Metric(Flux.mse), Metric(expensivemetricfn) )
This feature would add a phase argument to Metric:
cb = Metrics( accuracy, Metric(Flux.mse), Metric(expensivemetricfn, phase = AbstractValidationPhase) )
In case expensivemetricfn takes a long time to evaluate, this saves time during training while giving important information during the (usually much shorter) validation phases.
expensivemetricfn
This would allow running expensive metrics only during validation phases.
Currently, you can pass functions or a
Metric
to theMetrics
callback:This feature would add a phase argument to
Metric
:In case
expensivemetricfn
takes a long time to evaluate, this saves time during training while giving important information during the (usually much shorter) validation phases.