search

iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

scripts: fix CI test listing script #442

Closed pmrowla closed 1 year ago

github-actions[bot] commented 1 year ago 

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial-add[2.11.0] 9.0448 (1.94) 9.0448 (1.94) 9.0448 (1.94) 0.0000 (1.0) 9.0448 (1.94) 0.0000 (1.0) 0;0 0.1106 (0.52) 1 1
test_partial_add-add-partial-add[2.18.1] 6.3378 (1.36) 6.3378 (1.36) 6.3378 (1.36) 0.0000 (1.0) 6.3378 (1.36) 0.0000 (1.0) 0;0 0.1578 (0.74) 1 1
test_partial_add-add-partial-add[2.39.0] 6.5666 (1.41) 6.5666 (1.41) 6.5666 (1.41) 0.0000 (1.0) 6.5666 (1.41) 0.0000 (1.0) 0;0 0.1523 (0.71) 1 1
test_partial_add-add-partial-add[2.40.0] 6.6329 (1.42) 6.6329 (1.42) 6.6329 (1.42) 0.0000 (1.0) 6.6329 (1.42) 0.0000 (1.0) 0;0 0.1508 (0.70) 1 1
test_partial_add-add-partial-add[2.41.1] 6.7984 (1.45) 6.7984 (1.45) 6.7984 (1.45) 0.0000 (1.0) 6.7984 (1.45) 0.0000 (1.0) 0;0 0.1471 (0.69) 1 1
test_partial_add-add-partial-add[2.45.0] 4.6728 (1.0) 4.6728 (1.0) 4.6728 (1.0) 0.0000 (1.0) 4.6728 (1.0) 0.0000 (1.0) 0;0 0.2140 (1.0) 1 1
test_partial_add-add-partial-add[2.6.3] 9.6882 (2.07) 9.6882 (2.07) 9.6882 (2.07) 0.0000 (1.0) 9.6882 (2.07) 0.0000 (1.0) 0;0 0.1032 (0.48) 1 1
test_partial_add-add-partial-add[main] 5.8889 (1.26) 5.8889 (1.26) 5.8889 (1.26) 0.0000 (1.0) 5.8889 (1.26) 0.0000 (1.0) 0;0 0.1698 (0.79) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 636.2683 (1.08) 636.2683 (1.08) 636.2683 (1.08) 0.0000 (1.0) 636.2683 (1.08) 0.0000 (1.0) 0;0 1.5717 (0.92) 1 1
test_partial_add-gc-cloud-noop[2.18.1] 639.9161 (1.09) 639.9161 (1.09) 639.9161 (1.09) 0.0000 (1.0) 639.9161 (1.09) 0.0000 (1.0) 0;0 1.5627 (0.92) 1 1
test_partial_add-gc-cloud-noop[2.39.0] 710.6851 (1.21) 710.6851 (1.21) 710.6851 (1.21) 0.0000 (1.0) 710.6851 (1.21) 0.0000 (1.0) 0;0 1.4071 (0.83) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 741.0360 (1.26) 741.0360 (1.26) 741.0360 (1.26) 0.0000 (1.0) 741.0360 (1.26) 0.0000 (1.0) 0;0 1.3495 (0.79) 1 1
test_partial_add-gc-cloud-noop[2.41.1] 730.2619 (1.24) 730.2619 (1.24) 730.2619 (1.24) 0.0000 (1.0) 730.2619 (1.24) 0.0000 (1.0) 0;0 1.3694 (0.81) 1 1
test_partial_add-gc-cloud-noop[2.45.0] 687.4977 (1.17) 687.4977 (1.17) 687.4977 (1.17) 0.0000 (1.0) 687.4977 (1.17) 0.0000 (1.0) 0;0 1.4546 (0.86) 1 1
test_partial_add-gc-cloud-noop[2.6.3] 587.8633 (1.0) 587.8633 (1.0) 587.8633 (1.0) 0.0000 (1.0) 587.8633 (1.0) 0.0000 (1.0) 0;0 1.7011 (1.0) 1 1
test_partial_add-gc-cloud-noop[main] 834.5925 (1.42) 834.5925 (1.42) 834.5925 (1.42) 0.0000 (1.0) 834.5925 (1.42) 0.0000 (1.0) 0;0 1.1982 (0.70) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 550.1224 (1.10) 550.1224 (1.10) 550.1224 (1.10) 0.0000 (1.0) 550.1224 (1.10) 0.0000 (1.0) 0;0 1.8178 (0.91) 1 1
test_partial_add-gc-noop[2.18.1] 596.5449 (1.19) 596.5449 (1.19) 596.5449 (1.19) 0.0000 (1.0) 596.5449 (1.19) 0.0000 (1.0) 0;0 1.6763 (0.84) 1 1
test_partial_add-gc-noop[2.39.0] 638.2443 (1.27) 638.2443 (1.27) 638.2443 (1.27) 0.0000 (1.0) 638.2443 (1.27) 0.0000 (1.0) 0;0 1.5668 (0.78) 1 1
test_partial_add-gc-noop[2.40.0] 630.4367 (1.26) 630.4367 (1.26) 630.4367 (1.26) 0.0000 (1.0) 630.4367 (1.26) 0.0000 (1.0) 0;0 1.5862 (0.79) 1 1
test_partial_add-gc-noop[2.41.1] 681.0270 (1.36) 681.0270 (1.36) 681.0270 (1.36) 0.0000 (1.0) 681.0270 (1.36) 0.0000 (1.0) 0;0 1.4684 (0.74) 1 1
test_partial_add-gc-noop[2.45.0] 641.6485 (1.28) 641.6485 (1.28) 641.6485 (1.28) 0.0000 (1.0) 641.6485 (1.28) 0.0000 (1.0) 0;0 1.5585 (0.78) 1 1
test_partial_add-gc-noop[2.6.3] 500.7971 (1.0) 500.7971 (1.0) 500.7971 (1.0) 0.0000 (1.0) 500.7971 (1.0) 0.0000 (1.0) 0;0 1.9968 (1.0) 1 1
test_partial_add-gc-noop[main] 750.2704 (1.50) 750.2704 (1.50) 750.2704 (1.50) 0.0000 (1.0) 750.2704 (1.50) 0.0000 (1.0) 0;0 1.3329 (0.67) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial-add[2.11.0] 3.1260 (4.80) 3.1260 (4.80) 3.1260 (4.80) 0.0000 (1.0) 3.1260 (4.80) 0.0000 (1.0) 0;0 0.3199 (0.21) 1 1
test_partial_add-push-partial-add[2.18.1] 0.6507 (1.0) 0.6507 (1.0) 0.6507 (1.0) 0.0000 (1.0) 0.6507 (1.0) 0.0000 (1.0) 0;0 1.5368 (1.0) 1 1
test_partial_add-push-partial-add[2.39.0] 3.8346 (5.89) 3.8346 (5.89) 3.8346 (5.89) 0.0000 (1.0) 3.8346 (5.89) 0.0000 (1.0) 0;0 0.2608 (0.17) 1 1
test_partial_add-push-partial-add[2.40.0] 3.8774 (5.96) 3.8774 (5.96) 3.8774 (5.96) 0.0000 (1.0) 3.8774 (5.96) 0.0000 (1.0) 0;0 0.2579 (0.17) 1 1
test_partial_add-push-partial-add[2.41.1] 3.9293 (6.04) 3.9293 (6.04) 3.9293 (6.04) 0.0000 (1.0) 3.9293 (6.04) 0.0000 (1.0) 0;0 0.2545 (0.17) 1 1
test_partial_add-push-partial-add[2.45.0] 0.6980 (1.07) 0.6980 (1.07) 0.6980 (1.07) 0.0000 (1.0) 0.6980 (1.07) 0.0000 (1.0) 0;0 1.4326 (0.93) 1 1
test_partial_add-push-partial-add[2.6.3] 2.6444 (4.06) 2.6444 (4.06) 2.6444 (4.06) 0.0000 (1.0) 2.6444 (4.06) 0.0000 (1.0) 0;0 0.3782 (0.25) 1 1
test_partial_add-push-partial-add[main] 4.8411 (7.44) 4.8411 (7.44) 4.8411 (7.44) 0.0000 (1.0) 4.8411 (7.44) 0.0000 (1.0) 0;0 0.2066 (0.13) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```