Improve the budget tracker. With a bit code reorg and tightening.
The BudgetTracker used to contain the (iterations, inputs) pair for each cost type. This PR adds to it the cpu, mem costs.
Why
get_tracker can return granular costs which can be filtered/aggregated downstream for better metrics.
What
Improve the budget tracker. With a bit code reorg and tightening. The
BudgetTracker
used to contain the(iterations, inputs)
pair for each cost type. This PR adds to it thecpu
,mem
costs.Why
get_tracker
can return granular costs which can be filtered/aggregated downstream for better metrics.Known limitations
[TODO or N/A]