NVIDIA / nvbench

CUDA Kernel Benchmarking Library
Apache License 2.0
474 stars 63 forks source link

Consider `is_finished` customization #147

Open gevtushenko opened 10 months ago

gevtushenko commented 10 months ago

Currently, NVBench relies on a fixed criteria to understand when enough samples are collected. We can consider an API that would allow users to modify this criterion, accepting the set of collected samples and returning true if enough were collected.

This API would make it: 1) easier to experiment with new criteria 2) possible to offload decision to third party statistical packages