Currently, NVBench relies on a fixed criteria to understand when enough samples are collected. We can consider an API that would allow users to modify this criterion, accepting the set of collected samples and returning true if enough were collected.
This API would make it:
1) easier to experiment with new criteria
2) possible to offload decision to third party statistical packages
Currently, NVBench relies on a fixed criteria to understand when enough samples are collected. We can consider an API that would allow users to modify this criterion, accepting the set of collected samples and returning
true
if enough were collected.This API would make it: 1) easier to experiment with new criteria 2) possible to offload decision to third party statistical packages