Open rlratzel opened 4 years ago
This issue has been marked rotten due to no recent activity in the past 90d. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed.
This issue has been marked stale due to no recent activity in the past 30d. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be marked rotten if there is no activity in the next 60d.
The benchmarks in
cuml/python/cuml/benchmark
should consider updating to the upcoming RAPIDS-wide python benchmarking standard, as already adopted by cugraph (see examples here) and documented here.These are based on
pytest
and therapids-pytest-benchmark
plugin.(I think @cjnolet has started similar work, so maybe he's the best person?)Ops will be supporting this plugin and migrating the nightly benchmarking job to callpytest
where benchmarks using this framework are available. Other benchmarking scripts should continue to work, but it would be best if all of RAPIDS eventually was using the same framework. @rlratzel can also help answer questions.