modeswitch / mozbench

0 stars 0 forks source link

Support for confidence-based jobs #8

Open modeswitch opened 10 years ago

modeswitch commented 10 years ago

Allow jobs to run until target confidence interval is reached rather than after a set number of replicates. For some benchmarks, we can use a smaller number of replicates this way.

jmaher commented 10 years ago

we run a benchmark for x times (tasks), so we can view and analyze the results from the first tasks to see if they are stable enough.