rapidsai / cuml

cuML - RAPIDS Machine Learning Library
https://docs.rapids.ai/api/cuml/stable/
Apache License 2.0
4.23k stars 532 forks source link

[FEA] cuml benchmarks in `cuml/python/cuml/benchmark` need updating #2457

Open rlratzel opened 4 years ago

rlratzel commented 4 years ago

The benchmarks in cuml/python/cuml/benchmark should consider updating to the upcoming RAPIDS-wide python benchmarking standard, as already adopted by cugraph (see examples here) and documented here.

These are based on pytest and the rapids-pytest-benchmark plugin. (I think @cjnolet has started similar work, so maybe he's the best person?) Ops will be supporting this plugin and migrating the nightly benchmarking job to call pytest where benchmarks using this framework are available. Other benchmarking scripts should continue to work, but it would be best if all of RAPIDS eventually was using the same framework. @rlratzel can also help answer questions.

github-actions[bot] commented 3 years ago

This issue has been marked rotten due to no recent activity in the past 90d. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed.

github-actions[bot] commented 3 years ago

This issue has been marked stale due to no recent activity in the past 30d. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be marked rotten if there is no activity in the next 60d.