cloud-bulldozer / benchmark-wrapper

Python Library to run benchmarks
https://benchmark-wrapper.readthedocs.io
Apache License 2.0
19 stars 56 forks source link

Fix benchmark names #398

Open chentex opened 2 years ago

chentex commented 2 years ago

Description

Inconsistencies on naming have been having negative effects on our automation on image building.

Fixes

347

sjug commented 2 years ago

Don't you need to change ycsb-server as well?

chentex commented 2 years ago

Don't you need to change ycsb-server as well?

Good catch!

codecov-commenter commented 2 years ago

Codecov Report

Merging #398 (b411745) into master (b9ddc34) will not change coverage. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #398   +/-   ##
=======================================
  Coverage   39.35%   39.35%           
=======================================
  Files          15       15           
  Lines         869      869           
=======================================
  Hits          342      342           
  Misses        527      527           
Flag Coverage Δ
gha 39.35% <ø> (ø)
python-3.6 39.35% <ø> (ø)
unit 39.35% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
snafu/utils/wrapper_factory.py 62.16% <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update b9ddc34...b411745. Read the comment docs.

comet-perf-ci commented 2 years ago

Results for SNAFU CI Test

Test Result Runtime
snafu/hammerdb PASS 00:06:04
snafu/smallfile_wrapper PASS 00:05:26
snafu/flent_wrapper PASS 00:07:29
snafu/scale_openshift_wrapper FAIL 00:03:10
snafu/sysbench PASS 00:02:52
snafu/benchmarks/uperf PASS 00:21:53
snafu/image_pull_wrapper PASS 00:03:28
snafu/ycsb_wrapper FAIL 00:13:02
snafu/stressng_wrapper PASS 00:03:36
snafu/fio_wrapper FAIL 00:31:47
snafu/log_generator_wrapper FAIL 00:01:54
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/iperf FAIL 00:00:27
snafu/vegeta_wrapper FAIL 00:01:43
snafu/fs_drift_wrapper FAIL 00:01:47
snafu/pgbench_wrapper FAIL 00:02:24