search

cloud-bulldozer / benchmark-wrapper

Python Library to run benchmarks
https://benchmark-wrapper.readthedocs.io
Apache License 2.0
19 stars 56 forks source link

Standardize all images to use latest tag #396

Closed chentex closed 2 years ago

chentex commented 2 years ago

Depends-On: https://github.com/cloud-bulldozer/benchmark-operator/pull/713

Signed-off-by: Vicente Zepeda Mas vzepedam@redhat.com

Description

To follow the guidelines in here: https://github.com/cloud-bulldozer/benchmark-operator/pull/713 we need to update it here as well for tests to run

Fixes

chentex commented 2 years ago

Adding discussion from old PR: https://github.com/cloud-bulldozer/benchmark-wrapper/pull/394

https://github.com/cloud-bulldozer/benchmark-wrapper/pull/394#pullrequestreview-809994957

https://github.com/cloud-bulldozer/benchmark-wrapper/pull/394#issuecomment-972942220

chentex commented 2 years ago

/rerun all

comet-perf-ci commented 2 years ago

Results for SNAFU CI Test

Test Result Runtime
snafu/hammerdb PASS 00:05:58
snafu/smallfile_wrapper FAIL 00:02:24
snafu/flent_wrapper PASS 00:08:27
snafu/scale_openshift_wrapper PASS 00:10:37
snafu/sysbench PASS 00:02:53
snafu/benchmarks/uperf PASS 00:23:08
snafu/image_pull_wrapper PASS 00:03:56
snafu/ycsb_wrapper FAIL 00:12:12
snafu/stressng_wrapper PASS 00:03:38
snafu/fio_wrapper PASS 00:15:22
snafu/log_generator_wrapper PASS 00:03:45
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/iperf PASS 00:04:51
snafu/vegeta_wrapper PASS 00:03:55
snafu/fs_drift_wrapper PASS 00:04:03
snafu/pgbench_wrapper PASS 00:03:43
dry923 commented 2 years ago

Added Depends-On line to description

chentex commented 2 years ago

/rerun all

chentex commented 2 years ago

smallfile is failing because the tag is pointing to master on benchmark-operator we need to merge this and https://github.com/cloud-bulldozer/benchmark-operator/pull/713 for it to pass.

Normal Pulling 8s kubelet Pulling image "quay.io/cloud-bulldozer/smallfile:master"

comet-perf-ci commented 2 years ago

Results for SNAFU CI Test

Test Result Runtime
snafu/hammerdb PASS 00:05:47
snafu/smallfile_wrapper FAIL 00:02:36
snafu/flent_wrapper PASS 00:08:13
snafu/scale_openshift_wrapper PASS 00:11:23
snafu/sysbench PASS 00:02:52
snafu/benchmarks/uperf PASS 00:22:31
snafu/image_pull_wrapper PASS 00:03:44
snafu/ycsb_wrapper FAIL 00:13:59
snafu/stressng_wrapper PASS 00:03:26
snafu/fio_wrapper PASS 00:15:42
snafu/log_generator_wrapper PASS 00:03:44
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/iperf PASS 00:05:02
snafu/vegeta_wrapper PASS 00:04:07
snafu/fs_drift_wrapper PASS 00:03:58
snafu/pgbench_wrapper PASS 00:03:38
chentex commented 2 years ago

/rerun all

comet-perf-ci commented 2 years ago

Results for SNAFU CI Test

Test Result Runtime
snafu/hammerdb PASS 00:06:11
snafu/smallfile_wrapper PASS 00:06:11
snafu/flent_wrapper PASS 00:07:35
snafu/scale_openshift_wrapper FAIL 00:10:54
snafu/sysbench FAIL 00:01:50
snafu/benchmarks/uperf FAIL 00:02:12
snafu/image_pull_wrapper FAIL 00:01:29
chentex commented 2 years ago

/rerun all

comet-perf-ci commented 2 years ago

Results for SNAFU CI Test

Test Result Runtime
snafu/hammerdb PASS 00:06:00
snafu/smallfile_wrapper PASS 00:05:21
snafu/flent_wrapper PASS 00:07:12
snafu/scale_openshift_wrapper PASS 00:10:35
snafu/sysbench PASS 00:02:52
snafu/benchmarks/uperf PASS 00:21:21
snafu/image_pull_wrapper PASS 00:03:41
snafu/ycsb_wrapper PASS 00:06:39
snafu/stressng_wrapper PASS 00:03:22
snafu/fio_wrapper PASS 00:15:42
snafu/log_generator_wrapper PASS 00:03:36
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/iperf PASS 00:06:50
snafu/vegeta_wrapper PASS 00:03:59
snafu/fs_drift_wrapper PASS 00:04:03
snafu/pgbench_wrapper PASS 00:03:36