search

cloud-bulldozer / benchmark-wrapper

Python Library to run benchmarks
https://benchmark-wrapper.readthedocs.io
Apache License 2.0
19 stars 56 forks source link

Add timestamp field to dataclass #425

Closed rsevilla87 closed 2 years ago

rsevilla87 commented 2 years ago

Signed-off-by: Raul Sevilla rsevilla@redhat.com

Description

Fixes

2022-04-07T21:36:16Z - WARNING  - MainProcess - uperf: The following params will be overwritten due to values found in workload profile name: test_type, protocol, num_threads
Traceback (most recent call last):
  File "/usr/local/bin/run_snafu", line 33, in <module>
    sys.exit(load_entry_point('snafu', 'console_scripts', 'run_snafu')())
  File "/opt/snafu/snafu/run_snafu.py", line 142, in main
    es, process_generator(index_args, parser), parallel_setting
  File "/opt/snafu/snafu/utils/py_es_bulk.py", line 172, in streaming_bulk
    for ok, resp_payload in streaming_bulk_generator:
  File "/usr/local/lib/python3.6/site-packages/elasticsearch/helpers/actions.py", line 320, in streaming_bulk
    actions, chunk_size, max_chunk_bytes, client.transport.serializer
  File "/usr/local/lib/python3.6/site-packages/elasticsearch/helpers/actions.py", line 155, in _chunk_actions
    for action, data in actions:
  File "/opt/snafu/snafu/utils/py_es_bulk.py", line 118, in actions_tracking_closure
    for cl_action in cl_actions:
  File "/opt/snafu/snafu/run_snafu.py", line 189, in process_generator
    for result in wrapper_object.run():
  File "/opt/snafu/snafu/benchmarks/_benchmark.py", line 162, in run
    yield from self.collect()
  File "/opt/snafu/snafu/benchmarks/uperf/uperf.py", line 359, in collect
    result_data: List[UperfStat] = self.get_results_from_stdout(stdout)
  File "/opt/snafu/snafu/benchmarks/uperf/uperf.py", line 300, in get_results_from_stdout
    norm_ltcy=norm_ltcy,
TypeError: __init__() got an unexpected keyword argument 'timestamp'
rsevilla87 commented 2 years ago

/rerun all

comet-perf-ci commented 2 years ago

Results for SNAFU CI Test

Test Result Runtime
snafu/benchmarks/uperf PASS 00:25:21
Harshith-umesh commented 2 years ago

LGTM!

comet-perf-ci commented 2 years ago

Results for SNAFU CI Test

Test Result Runtime
snafu/hammerdb PASS 00:10:10
snafu/smallfile_wrapper PASS 00:05:42
snafu/flent_wrapper FAIL 00:01:29
snafu/scale_openshift_wrapper PASS 00:10:05
snafu/sysbench PASS 00:03:00
snafu/benchmarks/uperf FAIL 00:13:48
snafu/image_pull_wrapper FAIL 00:00:28
snafu/ycsb_wrapper PASS 00:06:33
snafu/stressng_wrapper PASS 00:03:34
snafu/fio_wrapper FAIL 00:33:57
snafu/log_generator_wrapper PASS 00:03:48
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/iperf PASS 00:05:31
snafu/vegeta_wrapper PASS 00:04:13
snafu/fs_drift_wrapper PASS 00:12:26
snafu/pgbench_wrapper PASS 00:03:41