search

iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

status: modify the dataset #341

Closed efiop closed 2 years ago

efiop commented 2 years ago

Update for #340

Related to https://github.com/iterative/dvc/issues/7390

github-actions[bot] commented 2 years ago 


-------------------------------------------------------------------------------------------------------------------------- benchmark 'test_add-add': 6 tests --------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add (benchmarks-tests-benchmarks-cli-commands-test_add.py-test_add/Linux-CPython-3.7-64bit/0001_main) 102.6325 (1.08) 102.6325 (1.08) 102.6325 (1.08) 0.0000 (1.0) 102.6325 (1.08) 0.0000 (1.0) 0;0 0.0097 (0.92) 1 1
test_add-add (benchmarks-tests-benchmarks-cli-commands-test_add.py-test_add/Linux-CPython-3.7-64bit/0002_2.10.0) 104.1078 (1.10) 104.1078 (1.10) 104.1078 (1.10) 0.0000 (1.0) 104.1078 (1.10) 0.0000 (1.0) 0;0 0.0096 (0.91) 1 1
test_add-add (benchmarks-tests-benchmarks-cli-commands-test_add.py-test_add/Linux-CPython-3.7-64bit/0003_2.9.5) 101.9578 (1.08) 101.9578 (1.08) 101.9578 (1.08) 0.0000 (1.0) 101.9578 (1.08) 0.0000 (1.0) 0;0 0.0098 (0.93) 1 1
test_add-add (benchmarks-tests-benchmarks-cli-commands-test_add.py-test_add/Linux-CPython-3.7-64bit/0004_2.8.3) 101.1382 (1.07) 101.1382 (1.07) 101.1382 (1.07) 0.0000 (1.0) 101.1382 (1.07) 0.0000 (1.0) 0;0 0.0099 (0.94) 1 1
test_add-add (benchmarks-tests-benchmarks-cli-commands-test_add.py-test_add/Linux-CPython-3.7-64bit/0005_2.7.3) 96.7687 (1.02) 96.7687 (1.02) 96.7687 (1.02) 0.0000 (1.0) 96.7687 (1.02) 0.0000 (1.0) 0;0 0.0103 (0.98) 1 1
test_add-add (benchmarks-tests-benchmarks-cli-commands-test_add.py-test_add/Linux-CPython-3.7-64bit/0006_2.6.3) 94.7569 (1.0) 94.7569 (1.0) 94.7569 (1.0) 0.0000 (1.0) 94.7569 (1.0) 0.0000 (1.0) 0;0 0.0106 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------------------------------------------- benchmark 'test_checkout-checkout': 6 tests -----------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0001_main) 39.0364 (1.58) 39.0364 (1.58) 39.0364 (1.58) 0.0000 (1.0) 39.0364 (1.58) 0.0000 (1.0) 0;0 0.0256 (0.63) 1 1
test_checkout-checkout (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0002_2.10.0) 38.3546 (1.55) 38.3546 (1.55) 38.3546 (1.55) 0.0000 (1.0) 38.3546 (1.55) 0.0000 (1.0) 0;0 0.0261 (0.64) 1 1
test_checkout-checkout (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0003_2.9.5) 39.6455 (1.61) 39.6455 (1.61) 39.6455 (1.61) 0.0000 (1.0) 39.6455 (1.61) 0.0000 (1.0) 0;0 0.0252 (0.62) 1 1
test_checkout-checkout (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0004_2.8.3) 34.3851 (1.39) 34.3851 (1.39) 34.3851 (1.39) 0.0000 (1.0) 34.3851 (1.39) 0.0000 (1.0) 0;0 0.0291 (0.72) 1 1
test_checkout-checkout (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0005_2.7.3) 24.9804 (1.01) 24.9804 (1.01) 24.9804 (1.01) 0.0000 (1.0) 24.9804 (1.01) 0.0000 (1.0) 0;0 0.0400 (0.99) 1 1
test_checkout-checkout (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0006_2.6.3) 24.6807 (1.0) 24.6807 (1.0) 24.6807 (1.0) 0.0000 (1.0) 24.6807 (1.0) 0.0000 (1.0) 0;0 0.0405 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------------------------------------- benchmark 'test_checkout-checkout-noop': 6 tests ---------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout-noop (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0001_main) 2.1848 (1.87) 2.1848 (1.87) 2.1848 (1.87) 0.0000 (1.0) 2.1848 (1.87) 0.0000 (1.0) 0;0 0.4577 (0.54) 1 1
test_checkout-checkout-noop (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0002_2.10.0) 2.2428 (1.92) 2.2428 (1.92) 2.2428 (1.92) 0.0000 (1.0) 2.2428 (1.92) 0.0000 (1.0) 0;0 0.4459 (0.52) 1 1
test_checkout-checkout-noop (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0003_2.9.5) 2.2859 (1.95) 2.2859 (1.95) 2.2859 (1.95) 0.0000 (1.0) 2.2859 (1.95) 0.0000 (1.0) 0;0 0.4375 (0.51) 1 1
test_checkout-checkout-noop (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0004_2.8.3) 2.4770 (2.12) 2.4770 (2.12) 2.4770 (2.12) 0.0000 (1.0) 2.4770 (2.12) 0.0000 (1.0) 0;0 0.4037 (0.47) 1 1
test_checkout-checkout-noop (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0005_2.7.3) 1.8496 (1.58) 1.8496 (1.58) 1.8496 (1.58) 0.0000 (1.0) 1.8496 (1.58) 0.0000 (1.0) 0;0 0.5407 (0.63) 1 1
test_checkout-checkout-noop (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0006_2.6.3) 1.1701 (1.0) 1.1701 (1.0) 1.1701 (1.0) 0.0000 (1.0) 1.1701 (1.0) 0.0000 (1.0) 0;0 0.8546 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------------------------------------------- benchmark 'test_checkout-checkout-update': 6 tests -----------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout-update (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0001_main) 13.5848 (1.0) 13.5848 (1.0) 13.5848 (1.0) 0.0000 (1.0) 13.5848 (1.0) 0.0000 (1.0) 0;0 0.0736 (1.0) 1 1
test_checkout-checkout-update (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0002_2.10.0) 13.6540 (1.01) 13.6540 (1.01) 13.6540 (1.01) 0.0000 (1.0) 13.6540 (1.01) 0.0000 (1.0) 0;0 0.0732 (0.99) 1 1
test_checkout-checkout-update (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0003_2.9.5) 13.7106 (1.01) 13.7106 (1.01) 13.7106 (1.01) 0.0000 (1.0) 13.7106 (1.01) 0.0000 (1.0) 0;0 0.0729 (0.99) 1 1
test_checkout-checkout-update (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0004_2.8.3) 14.6500 (1.08) 14.6500 (1.08) 14.6500 (1.08) 0.0000 (1.0) 14.6500 (1.08) 0.0000 (1.0) 0;0 0.0683 (0.93) 1 1
test_checkout-checkout-update (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0005_2.7.3) 39.3274 (2.89) 39.3274 (2.89) 39.3274 (2.89) 0.0000 (1.0) 39.3274 (2.89) 0.0000 (1.0) 0;0 0.0254 (0.35) 1 1
test_checkout-checkout-update (benchmarks-tests-benchmarks-cli-commands-test_checkout.py-test_checkout/Linux-CPython-3.7-64bit/0006_2.6.3) 37.2716 (2.74) 37.2716 (2.74) 37.2716 (2.74) 0.0000 (1.0) 37.2716 (2.74) 0.0000 (1.0) 0;0 0.0268 (0.36) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------------------------------------- benchmark 'test_diff-diff': 6 tests -------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0001_main) 22.5090 (1.03) 22.5090 (1.03) 22.5090 (1.03) 0.0000 (1.0) 22.5090 (1.03) 0.0000 (1.0) 0;0 0.0444 (0.97) 1 1
test_diff-diff (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0002_2.10.0) 21.9356 (1.0) 21.9356 (1.0) 21.9356 (1.0) 0.0000 (1.0) 21.9356 (1.0) 0.0000 (1.0) 0;0 0.0456 (1.0) 1 1
test_diff-diff (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0003_2.9.5) 23.0035 (1.05) 23.0035 (1.05) 23.0035 (1.05) 0.0000 (1.0) 23.0035 (1.05) 0.0000 (1.0) 0;0 0.0435 (0.95) 1 1
test_diff-diff (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0004_2.8.3) 25.3130 (1.15) 25.3130 (1.15) 25.3130 (1.15) 0.0000 (1.0) 25.3130 (1.15) 0.0000 (1.0) 0;0 0.0395 (0.87) 1 1
test_diff-diff (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0005_2.7.3) 27.0501 (1.23) 27.0501 (1.23) 27.0501 (1.23) 0.0000 (1.0) 27.0501 (1.23) 0.0000 (1.0) 0;0 0.0370 (0.81) 1 1
test_diff-diff (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0006_2.6.3) 39.8442 (1.82) 39.8442 (1.82) 39.8442 (1.82) 0.0000 (1.0) 39.8442 (1.82) 0.0000 (1.0) 0;0 0.0251 (0.55) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 6 tests -------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0001_main) 1.3957 (1.0) 1.3957 (1.0) 1.3957 (1.0) 0.0000 (1.0) 1.3957 (1.0) 0.0000 (1.0) 0;0 0.7165 (1.0) 1 1
test_diff-diff-noop (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0002_2.10.0) 1.4075 (1.01) 1.4075 (1.01) 1.4075 (1.01) 0.0000 (1.0) 1.4075 (1.01) 0.0000 (1.0) 0;0 0.7105 (0.99) 1 1
test_diff-diff-noop (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0003_2.9.5) 1.4737 (1.06) 1.4737 (1.06) 1.4737 (1.06) 0.0000 (1.0) 1.4737 (1.06) 0.0000 (1.0) 0;0 0.6786 (0.95) 1 1
test_diff-diff-noop (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0004_2.8.3) 3.0061 (2.15) 3.0061 (2.15) 3.0061 (2.15) 0.0000 (1.0) 3.0061 (2.15) 0.0000 (1.0) 0;0 0.3327 (0.46) 1 1
test_diff-diff-noop (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0005_2.7.3) 3.7892 (2.72) 3.7892 (2.72) 3.7892 (2.72) 0.0000 (1.0) 3.7892 (2.72) 0.0000 (1.0) 0;0 0.2639 (0.37) 1 1
test_diff-diff-noop (benchmarks-tests-benchmarks-cli-commands-test_diff.py-test_diff/Linux-CPython-3.7-64bit/0006_2.6.3) 18.4737 (13.24) 18.4737 (13.24) 18.4737 (13.24) 0.0000 (1.0) 18.4737 (13.24) 0.0000 (1.0) 0;0 0.0541 (0.08) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------------------------------- benchmark 'test_gc-gc': 6 tests ---------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc (benchmarks-tests-benchmarks-cli-commands-test_gc.py-test_gc/Linux-CPython-3.7-64bit/0001_main) 1.7537 (1.05) 1.7537 (1.05) 1.7537 (1.05) 0.0000 (1.0) 1.7537 (1.05) 0.0000 (1.0) 0;0 0.5702 (0.95) 1 1
test_gc-gc (benchmarks-tests-benchmarks-cli-commands-test_gc.py-test_gc/Linux-CPython-3.7-64bit/0002_2.10.0) 1.6730 (1.00) 1.6730 (1.00) 1.6730 (1.00) 0.0000 (1.0) 1.6730 (1.00) 0.0000 (1.0) 0;0 0.5977 (1.00) 1 1
test_gc-gc (benchmarks-tests-benchmarks-cli-commands-test_gc.py-test_gc/Linux-CPython-3.7-64bit/0003_2.9.5) 2.2725 (1.36) 2.2725 (1.36) 2.2725 (1.36) 0.0000 (1.0) 2.2725 (1.36) 0.0000 (1.0) 0;0 0.4400 (0.73) 1 1
test_gc-gc (benchmarks-tests-benchmarks-cli-commands-test_gc.py-test_gc/Linux-CPython-3.7-64bit/0004_2.8.3) 2.0016 (1.20) 2.0016 (1.20) 2.0016 (1.20) 0.0000 (1.0) 2.0016 (1.20) 0.0000 (1.0) 0;0 0.4996 (0.83) 1 1
test_gc-gc (benchmarks-tests-benchmarks-cli-commands-test_gc.py-test_gc/Linux-CPython-3.7-64bit/0005_2.7.3) 2.3476 (1.41) 2.3476 (1.41) 2.3476 (1.41) 0.0000 (1.0) 2.3476 (1.41) 0.0000 (1.0) 0;0 0.4260 (0.71) 1 1
test_gc-gc (benchmarks-tests-benchmarks-cli-commands-test_gc.py-test_gc/Linux-CPython-3.7-64bit/0006_2.6.3) 1.6650 (1.0) 1.6650 (1.0) 1.6650 (1.0) 0.0000 (1.0) 1.6650 (1.0) 0.0000 (1.0) 0;0 0.6006 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------------------------------------ benchmark 'test_get-get': 6 tests ------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get (benchmarks-tests-benchmarks-cli-commands-test_get.py-test_get/Linux-CPython-3.7-64bit/0001_main) 49.6885 (1.05) 49.6885 (1.05) 49.6885 (1.05) 0.0000 (1.0) 49.6885 (1.05) 0.0000 (1.0) 0;0 0.0201 (0.95) 1 1
test_get-get (benchmarks-tests-benchmarks-cli-commands-test_get.py-test_get/Linux-CPython-3.7-64bit/0002_2.10.0) 47.4290 (1.0) 47.4290 (1.0) 47.4290 (1.0) 0.0000 (1.0) 47.4290 (1.0) 0.0000 (1.0) 0;0 0.0211 (1.0) 1 1
test_get-get (benchmarks-tests-benchmarks-cli-commands-test_get.py-test_get/Linux-CPython-3.7-64bit/0003_2.9.5) 47.7420 (1.01) 47.7420 (1.01) 47.7420 (1.01) 0.0000 (1.0) 47.7420 (1.01) 0.0000 (1.0) 0;0 0.0209 (0.99) 1 1
test_get-get (benchmarks-tests-benchmarks-cli-commands-test_get.py-test_get/Linux-CPython-3.7-64bit/0004_2.8.3) 48.9453 (1.03) 48.9453 (1.03) 48.9453 (1.03) 0.0000 (1.0) 48.9453 (1.03) 0.0000 (1.0) 0;0 0.0204 (0.97) 1 1
test_get-get (benchmarks-tests-benchmarks-cli-commands-test_get.py-test_get/Linux-CPython-3.7-64bit/0005_2.7.3) 60.5406 (1.28) 60.5406 (1.28) 60.5406 (1.28) 0.0000 (1.0) 60.5406 (1.28) 0.0000 (1.0) 0;0 0.0165 (0.78) 1 1
test_get-get (benchmarks-tests-benchmarks-cli-commands-test_get.py-test_get/Linux-CPython-3.7-64bit/0006_2.6.3) 58.7314 (1.24) 58.7314 (1.24) 58.7314 (1.24) 0.0000 (1.0) 58.7314 (1.24) 0.0000 (1.0) 0;0 0.0170 (0.81) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------------------------------------------------- benchmark 'test_help---help': 6 tests ----------------------------------------------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help (benchmarks-tests-benchmarks-cli-commands-test_help.py-test_help/Linux-CPython-3.7-64bit/0001_main) 200.0821 (1.0) 337.1136 (1.14) 227.9651 (1.0) 26.1663 (1.04) 219.2738 (1.0) 46.4490 (1.07) 27;1 4.3866 (1.0) 100 1
test_help---help (benchmarks-tests-benchmarks-cli-commands-test_help.py-test_help/Linux-CPython-3.7-64bit/0002_2.10.0) 202.0758 (1.01) 296.7105 (1.0) 237.5759 (1.04) 25.2676 (1.0) 245.7541 (1.12) 46.2752 (1.06) 40;0 4.2092 (0.96) 100 1
test_help---help (benchmarks-tests-benchmarks-cli-commands-test_help.py-test_help/Linux-CPython-3.7-64bit/0003_2.9.5) 202.8314 (1.01) 319.6527 (1.08) 235.6029 (1.03) 28.3246 (1.12) 231.2661 (1.05) 43.5665 (1.0) 36;1 4.2444 (0.97) 100 1
test_help---help (benchmarks-tests-benchmarks-cli-commands-test_help.py-test_help/Linux-CPython-3.7-64bit/0004_2.8.3) 235.3416 (1.18) 353.2075 (1.19) 274.2726 (1.20) 31.4691 (1.25) 269.6780 (1.23) 56.0233 (1.29) 41;0 3.6460 (0.83) 100 1
test_help---help (benchmarks-tests-benchmarks-cli-commands-test_help.py-test_help/Linux-CPython-3.7-64bit/0005_2.7.3) 258.6868 (1.29) 358.0519 (1.21) 295.8006 (1.30) 27.7013 (1.10) 296.1407 (1.35) 47.2191 (1.08) 38;0 3.3807 (0.77) 100 1
test_help---help (benchmarks-tests-benchmarks-cli-commands-test_help.py-test_help/Linux-CPython-3.7-64bit/0006_2.6.3) 249.1830 (1.25) 385.7256 (1.30) 292.0980 (1.28) 34.0881 (1.35) 283.4089 (1.29) 61.6325 (1.41) 39;0 3.4235 (0.78) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------------------------------------------- benchmark 'test_import-import': 6 tests -----------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import (benchmarks-tests-benchmarks-cli-commands-test_import.py-test_import/Linux-CPython-3.7-64bit/0001_main) 311.7880 (1.73) 311.7880 (1.73) 311.7880 (1.73) 0.0000 (1.0) 311.7880 (1.73) 0.0000 (1.0) 0;0 0.0032 (0.58) 1 1
test_import-import (benchmarks-tests-benchmarks-cli-commands-test_import.py-test_import/Linux-CPython-3.7-64bit/0002_2.10.0) 322.7583 (1.79) 322.7583 (1.79) 322.7583 (1.79) 0.0000 (1.0) 322.7583 (1.79) 0.0000 (1.0) 0;0 0.0031 (0.56) 1 1
test_import-import (benchmarks-tests-benchmarks-cli-commands-test_import.py-test_import/Linux-CPython-3.7-64bit/0003_2.9.5) 327.5181 (1.82) 327.5181 (1.82) 327.5181 (1.82) 0.0000 (1.0) 327.5181 (1.82) 0.0000 (1.0) 0;0 0.0031 (0.55) 1 1
test_import-import (benchmarks-tests-benchmarks-cli-commands-test_import.py-test_import/Linux-CPython-3.7-64bit/0004_2.8.3) 215.4250 (1.20) 215.4250 (1.20) 215.4250 (1.20) 0.0000 (1.0) 215.4250 (1.20) 0.0000 (1.0) 0;0 0.0046 (0.84) 1 1
test_import-import (benchmarks-tests-benchmarks-cli-commands-test_import.py-test_import/Linux-CPython-3.7-64bit/0005_2.7.3) 189.2047 (1.05) 189.2047 (1.05) 189.2047 (1.05) 0.0000 (1.0) 189.2047 (1.05) 0.0000 (1.0) 0;0 0.0053 (0.95) 1 1
test_import-import (benchmarks-tests-benchmarks-cli-commands-test_import.py-test_import/Linux-CPython-3.7-64bit/0006_2.6.3) 180.2174 (1.0) 180.2174 (1.0) 180.2174 (1.0) 0.0000 (1.0) 180.2174 (1.0) 0.0000 (1.0) 0;0 0.0055 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------------------------------------------- benchmark 'test_init-init': 6 tests -------------------------------------------------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init (benchmarks-tests-benchmarks-cli-commands-test_init.py-test_init/Linux-CPython-3.7-64bit/0001_main) 381.5030 (1.03) 495.2181 (1.21) 396.8098 (1.04) 12.2799 (1.88) 395.7840 (1.04) 8.7894 (1.19) 9;4 2.5201 (0.96) 100 1
test_init-init (benchmarks-tests-benchmarks-cli-commands-test_init.py-test_init/Linux-CPython-3.7-64bit/0002_2.10.0) 386.4936 (1.05) 427.3148 (1.05) 398.9766 (1.05) 7.0440 (1.08) 397.8345 (1.05) 8.3028 (1.12) 25;3 2.5064 (0.96) 100 1
test_init-init (benchmarks-tests-benchmarks-cli-commands-test_init.py-test_init/Linux-CPython-3.7-64bit/0003_2.9.5) 369.3526 (1.0) 459.7150 (1.13) 381.0509 (1.0) 10.6118 (1.62) 379.4506 (1.0) 10.7455 (1.46) 14;2 2.6243 (1.0) 100 1
test_init-init (benchmarks-tests-benchmarks-cli-commands-test_init.py-test_init/Linux-CPython-3.7-64bit/0004_2.8.3) 377.8977 (1.02) 437.1957 (1.07) 391.0499 (1.03) 9.2291 (1.41) 388.7059 (1.02) 7.3850 (1.0) 21;8 2.5572 (0.97) 100 1
test_init-init (benchmarks-tests-benchmarks-cli-commands-test_init.py-test_init/Linux-CPython-3.7-64bit/0005_2.7.3) 969.6920 (2.63) 1,045.2167 (2.56) 1,006.2489 (2.64) 13.2586 (2.02) 1,007.2615 (2.65) 18.6694 (2.53) 35;1 0.9938 (0.38) 100 1
test_init-init (benchmarks-tests-benchmarks-cli-commands-test_init.py-test_init/Linux-CPython-3.7-64bit/0006_2.6.3) 376.8314 (1.02) 408.6207 (1.0) 389.0965 (1.02) 6.5482 (1.0) 388.3890 (1.02) 7.5747 (1.03) 34;2 2.5701 (0.98) 100 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------------------------------------- benchmark 'test_pull-pull': 6 tests ---------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull (benchmarks-tests-benchmarks-cli-commands-test_pull.py-test_pull/Linux-CPython-3.7-64bit/0001_main) 143.3457 (1.42) 143.3457 (1.42) 143.3457 (1.42) 0.0000 (1.0) 143.3457 (1.42) 0.0000 (1.0) 0;0 0.0070 (0.71) 1 1
test_pull-pull (benchmarks-tests-benchmarks-cli-commands-test_pull.py-test_pull/Linux-CPython-3.7-64bit/0002_2.10.0) 140.9668 (1.39) 140.9668 (1.39) 140.9668 (1.39) 0.0000 (1.0) 140.9668 (1.39) 0.0000 (1.0) 0;0 0.0071 (0.72) 1 1
test_pull-pull (benchmarks-tests-benchmarks-cli-commands-test_pull.py-test_pull/Linux-CPython-3.7-64bit/0003_2.9.5) 141.2853 (1.40) 141.2853 (1.40) 141.2853 (1.40) 0.0000 (1.0) 141.2853 (1.40) 0.0000 (1.0) 0;0 0.0071 (0.72) 1 1
test_pull-pull (benchmarks-tests-benchmarks-cli-commands-test_pull.py-test_pull/Linux-CPython-3.7-64bit/0004_2.8.3) 125.5096 (1.24) 125.5096 (1.24) 125.5096 (1.24) 0.0000 (1.0) 125.5096 (1.24) 0.0000 (1.0) 0;0 0.0080 (0.81) 1 1
test_pull-pull (benchmarks-tests-benchmarks-cli-commands-test_pull.py-test_pull/Linux-CPython-3.7-64bit/0005_2.7.3) 101.1804 (1.0) 101.1804 (1.0) 101.1804 (1.0) 0.0000 (1.0) 101.1804 (1.0) 0.0000 (1.0) 0;0 0.0099 (1.0) 1 1
test_pull-pull (benchmarks-tests-benchmarks-cli-commands-test_pull.py-test_pull/Linux-CPython-3.7-64bit/0006_2.6.3) 102.0452 (1.01) 102.0452 (1.01) 102.0452 (1.01) 0.0000 (1.0) 102.0452 (1.01) 0.0000 (1.0) 0;0 0.0098 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------------------------------------- benchmark 'test_push-push': 6 tests -------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push (benchmarks-tests-benchmarks-cli-commands-test_push.py-test_push/Linux-CPython-3.7-64bit/0001_main) 52.0009 (1.36) 52.0009 (1.36) 52.0009 (1.36) 0.0000 (1.0) 52.0009 (1.36) 0.0000 (1.0) 0;0 0.0192 (0.74) 1 1
test_push-push (benchmarks-tests-benchmarks-cli-commands-test_push.py-test_push/Linux-CPython-3.7-64bit/0002_2.10.0) 53.9161 (1.41) 53.9161 (1.41) 53.9161 (1.41) 0.0000 (1.0) 53.9161 (1.41) 0.0000 (1.0) 0;0 0.0185 (0.71) 1 1
test_push-push (benchmarks-tests-benchmarks-cli-commands-test_push.py-test_push/Linux-CPython-3.7-64bit/0003_2.9.5) 52.0830 (1.36) 52.0830 (1.36) 52.0830 (1.36) 0.0000 (1.0) 52.0830 (1.36) 0.0000 (1.0) 0;0 0.0192 (0.73) 1 1
test_push-push (benchmarks-tests-benchmarks-cli-commands-test_push.py-test_push/Linux-CPython-3.7-64bit/0004_2.8.3) 48.3690 (1.26) 48.3690 (1.26) 48.3690 (1.26) 0.0000 (1.0) 48.3690 (1.26) 0.0000 (1.0) 0;0 0.0207 (0.79) 1 1
test_push-push (benchmarks-tests-benchmarks-cli-commands-test_push.py-test_push/Linux-CPython-3.7-64bit/0005_2.7.3) 38.8893 (1.02) 38.8893 (1.02) 38.8893 (1.02) 0.0000 (1.0) 38.8893 (1.02) 0.0000 (1.0) 0;0 0.0257 (0.98) 1 1
test_push-push (benchmarks-tests-benchmarks-cli-commands-test_push.py-test_push/Linux-CPython-3.7-64bit/0006_2.6.3) 38.2451 (1.0) 38.2451 (1.0) 38.2451 (1.0) 0.0000 (1.0) 38.2451 (1.0) 0.0000 (1.0) 0;0 0.0261 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------------------------------------------------------- benchmark 'test_sharing-add': 6 tests ---------------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0001_main) 95.7664 (1.16) 95.7664 (1.16) 95.7664 (1.16) 0.0000 (1.0) 95.7664 (1.16) 0.0000 (1.0) 0;0 0.0104 (0.86) 1 1
test_sharing-add (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0002_2.10.0) 93.4241 (1.13) 93.4241 (1.13) 93.4241 (1.13) 0.0000 (1.0) 93.4241 (1.13) 0.0000 (1.0) 0;0 0.0107 (0.88) 1 1
test_sharing-add (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0003_2.9.5) 93.1129 (1.13) 93.1129 (1.13) 93.1129 (1.13) 0.0000 (1.0) 93.1129 (1.13) 0.0000 (1.0) 0;0 0.0107 (0.88) 1 1
test_sharing-add (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0004_2.8.3) 92.0495 (1.12) 92.0495 (1.12) 92.0495 (1.12) 0.0000 (1.0) 92.0495 (1.12) 0.0000 (1.0) 0;0 0.0109 (0.89) 1 1
test_sharing-add (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0005_2.7.3) 84.3263 (1.02) 84.3263 (1.02) 84.3263 (1.02) 0.0000 (1.0) 84.3263 (1.02) 0.0000 (1.0) 0;0 0.0119 (0.98) 1 1
test_sharing-add (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0006_2.6.3) 82.3353 (1.0) 82.3353 (1.0) 82.3353 (1.0) 0.0000 (1.0) 82.3353 (1.0) 0.0000 (1.0) 0;0 0.0121 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 6 tests --------------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0001_main) 39.2883 (6.68) 39.2883 (6.68) 39.2883 (6.68) 0.0000 (1.0) 39.2883 (6.68) 0.0000 (1.0) 0;0 0.0255 (0.15) 1 1
test_sharing-add-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0002_2.10.0) 39.5822 (6.73) 39.5822 (6.73) 39.5822 (6.73) 0.0000 (1.0) 39.5822 (6.73) 0.0000 (1.0) 0;0 0.0253 (0.15) 1 1
test_sharing-add-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0003_2.9.5) 39.2694 (6.68) 39.2694 (6.68) 39.2694 (6.68) 0.0000 (1.0) 39.2694 (6.68) 0.0000 (1.0) 0;0 0.0255 (0.15) 1 1
test_sharing-add-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0004_2.8.3) 11.3274 (1.93) 11.3274 (1.93) 11.3274 (1.93) 0.0000 (1.0) 11.3274 (1.93) 0.0000 (1.0) 0;0 0.0883 (0.52) 1 1
test_sharing-add-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0005_2.7.3) 6.6929 (1.14) 6.6929 (1.14) 6.6929 (1.14) 0.0000 (1.0) 6.6929 (1.14) 0.0000 (1.0) 0;0 0.1494 (0.88) 1 1
test_sharing-add-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0006_2.6.3) 5.8778 (1.0) 5.8778 (1.0) 5.8778 (1.0) 0.0000 (1.0) 5.8778 (1.0) 0.0000 (1.0) 0;0 0.1701 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 6 tests -------------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0001_main) 1.9652 (1.93) 1.9652 (1.93) 1.9652 (1.93) 0.0000 (1.0) 1.9652 (1.93) 0.0000 (1.0) 0;0 0.5089 (0.52) 1 1
test_sharing-checkout-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0002_2.10.0) 1.9513 (1.91) 1.9513 (1.91) 1.9513 (1.91) 0.0000 (1.0) 1.9513 (1.91) 0.0000 (1.0) 0;0 0.5125 (0.52) 1 1
test_sharing-checkout-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0003_2.9.5) 1.9403 (1.90) 1.9403 (1.90) 1.9403 (1.90) 0.0000 (1.0) 1.9403 (1.90) 0.0000 (1.0) 0;0 0.5154 (0.53) 1 1
test_sharing-checkout-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0004_2.8.3) 2.1960 (2.15) 2.1960 (2.15) 2.1960 (2.15) 0.0000 (1.0) 2.1960 (2.15) 0.0000 (1.0) 0;0 0.4554 (0.46) 1 1
test_sharing-checkout-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0005_2.7.3) 1.6644 (1.63) 1.6644 (1.63) 1.6644 (1.63) 0.0000 (1.0) 1.6644 (1.63) 0.0000 (1.0) 0;0 0.6008 (0.61) 1 1
test_sharing-checkout-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0006_2.6.3) 1.0192 (1.0) 1.0192 (1.0) 1.0192 (1.0) 0.0000 (1.0) 1.0192 (1.0) 0.0000 (1.0) 0;0 0.9812 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------------------------------------------- benchmark 'test_sharing-pull': 6 tests --------------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0001_main) 88.2867 (1.41) 88.2867 (1.41) 88.2867 (1.41) 0.0000 (1.0) 88.2867 (1.41) 0.0000 (1.0) 0;0 0.0113 (0.71) 1 1
test_sharing-pull (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0002_2.10.0) 88.2486 (1.41) 88.2486 (1.41) 88.2486 (1.41) 0.0000 (1.0) 88.2486 (1.41) 0.0000 (1.0) 0;0 0.0113 (0.71) 1 1
test_sharing-pull (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0003_2.9.5) 87.8037 (1.40) 87.8037 (1.40) 87.8037 (1.40) 0.0000 (1.0) 87.8037 (1.40) 0.0000 (1.0) 0;0 0.0114 (0.71) 1 1
test_sharing-pull (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0004_2.8.3) 79.0074 (1.26) 79.0074 (1.26) 79.0074 (1.26) 0.0000 (1.0) 79.0074 (1.26) 0.0000 (1.0) 0;0 0.0127 (0.79) 1 1
test_sharing-pull (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0005_2.7.3) 63.9013 (1.02) 63.9013 (1.02) 63.9013 (1.02) 0.0000 (1.0) 63.9013 (1.02) 0.0000 (1.0) 0;0 0.0156 (0.98) 1 1
test_sharing-pull (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0006_2.6.3) 62.6756 (1.0) 62.6756 (1.0) 62.6756 (1.0) 0.0000 (1.0) 62.6756 (1.0) 0.0000 (1.0) 0;0 0.0160 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------------------------------------------ benchmark 'test_sharing-pull-noop': 6 tests -------------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0001_main) 2.1956 (1.68) 2.1956 (1.68) 2.1956 (1.68) 0.0000 (1.0) 2.1956 (1.68) 0.0000 (1.0) 0;0 0.4554 (0.59) 1 1
test_sharing-pull-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0002_2.10.0) 2.2085 (1.69) 2.2085 (1.69) 2.2085 (1.69) 0.0000 (1.0) 2.2085 (1.69) 0.0000 (1.0) 0;0 0.4528 (0.59) 1 1
test_sharing-pull-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0003_2.9.5) 2.1711 (1.66) 2.1711 (1.66) 2.1711 (1.66) 0.0000 (1.0) 2.1711 (1.66) 0.0000 (1.0) 0;0 0.4606 (0.60) 1 1
test_sharing-pull-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0004_2.8.3) 2.4421 (1.87) 2.4421 (1.87) 2.4421 (1.87) 0.0000 (1.0) 2.4421 (1.87) 0.0000 (1.0) 0;0 0.4095 (0.53) 1 1
test_sharing-pull-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0005_2.7.3) 1.9222 (1.47) 1.9222 (1.47) 1.9222 (1.47) 0.0000 (1.0) 1.9222 (1.47) 0.0000 (1.0) 0;0 0.5202 (0.68) 1 1
test_sharing-pull-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0006_2.6.3) 1.3054 (1.0) 1.3054 (1.0) 1.3054 (1.0) 0.0000 (1.0) 1.3054 (1.0) 0.0000 (1.0) 0;0 0.7660 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------------------------------------------- benchmark 'test_sharing-push': 6 tests --------------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0001_main) 48.5858 (1.38) 48.5858 (1.38) 48.5858 (1.38) 0.0000 (1.0) 48.5858 (1.38) 0.0000 (1.0) 0;0 0.0206 (0.73) 1 1
test_sharing-push (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0002_2.10.0) 48.6296 (1.38) 48.6296 (1.38) 48.6296 (1.38) 0.0000 (1.0) 48.6296 (1.38) 0.0000 (1.0) 0;0 0.0206 (0.73) 1 1
test_sharing-push (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0003_2.9.5) 48.4666 (1.37) 48.4666 (1.37) 48.4666 (1.37) 0.0000 (1.0) 48.4666 (1.37) 0.0000 (1.0) 0;0 0.0206 (0.73) 1 1
test_sharing-push (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0004_2.8.3) 43.6144 (1.24) 43.6144 (1.24) 43.6144 (1.24) 0.0000 (1.0) 43.6144 (1.24) 0.0000 (1.0) 0;0 0.0229 (0.81) 1 1
test_sharing-push (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0005_2.7.3) 35.6838 (1.01) 35.6838 (1.01) 35.6838 (1.01) 0.0000 (1.0) 35.6838 (1.01) 0.0000 (1.0) 0;0 0.0280 (0.99) 1 1
test_sharing-push (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0006_2.6.3) 35.2977 (1.0) 35.2977 (1.0) 35.2977 (1.0) 0.0000 (1.0) 35.2977 (1.0) 0.0000 (1.0) 0;0 0.0283 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 6 tests -------------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0001_main) 1.0709 (1.02) 1.0709 (1.02) 1.0709 (1.02) 0.0000 (1.0) 1.0709 (1.02) 0.0000 (1.0) 0;0 0.9338 (0.98) 1 1
test_sharing-push-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0002_2.10.0) 1.0779 (1.03) 1.0779 (1.03) 1.0779 (1.03) 0.0000 (1.0) 1.0779 (1.03) 0.0000 (1.0) 0;0 0.9278 (0.97) 1 1
test_sharing-push-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0003_2.9.5) 1.0469 (1.0) 1.0469 (1.0) 1.0469 (1.0) 0.0000 (1.0) 1.0469 (1.0) 0.0000 (1.0) 0;0 0.9552 (1.0) 1 1
test_sharing-push-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0004_2.8.3) 1.0756 (1.03) 1.0756 (1.03) 1.0756 (1.03) 0.0000 (1.0) 1.0756 (1.03) 0.0000 (1.0) 0;0 0.9297 (0.97) 1 1
test_sharing-push-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0005_2.7.3) 1.6620 (1.59) 1.6620 (1.59) 1.6620 (1.59) 0.0000 (1.0) 1.6620 (1.59) 0.0000 (1.0) 0;0 0.6017 (0.63) 1 1
test_sharing-push-noop (benchmarks-tests-benchmarks-cli-stories-use-cases-test_sharing.py-test_sharing/Linux-CPython-3.7-64bit/0006_2.6.3) 1.1403 (1.09) 1.1403 (1.09) 1.1403 (1.09) 0.0000 (1.0) 1.1403 (1.09) 0.0000 (1.0) 0;0 0.8770 (0.92) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------------------------------------- benchmark 'test_status-status': 6 tests ---------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0001_main) 45.6338 (1.02) 45.6338 (1.02) 45.6338 (1.02) 0.0000 (1.0) 45.6338 (1.02) 0.0000 (1.0) 0;0 0.0219 (0.98) 1 1
test_status-status (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0002_2.10.0) 44.6269 (1.0) 44.6269 (1.0) 44.6269 (1.0) 0.0000 (1.0) 44.6269 (1.0) 0.0000 (1.0) 0;0 0.0224 (1.0) 1 1
test_status-status (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0003_2.9.5) 45.4905 (1.02) 45.4905 (1.02) 45.4905 (1.02) 0.0000 (1.0) 45.4905 (1.02) 0.0000 (1.0) 0;0 0.0220 (0.98) 1 1
test_status-status (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0004_2.8.3) 49.3100 (1.10) 49.3100 (1.10) 49.3100 (1.10) 0.0000 (1.0) 49.3100 (1.10) 0.0000 (1.0) 0;0 0.0203 (0.91) 1 1
test_status-status (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0005_2.7.3) 50.0685 (1.12) 50.0685 (1.12) 50.0685 (1.12) 0.0000 (1.0) 50.0685 (1.12) 0.0000 (1.0) 0;0 0.0200 (0.89) 1 1
test_status-status (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0006_2.6.3) 47.3631 (1.06) 47.3631 (1.06) 47.3631 (1.06) 0.0000 (1.0) 47.3631 (1.06) 0.0000 (1.0) 0;0 0.0211 (0.94) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------------------------------------- benchmark 'test_status-status-changed': 6 tests ---------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0001_main) 33.9415 (1.0) 33.9415 (1.0) 33.9415 (1.0) 0.0000 (1.0) 33.9415 (1.0) 0.0000 (1.0) 0;0 0.0295 (1.0) 1 1
test_status-status-changed (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0002_2.10.0) 34.1290 (1.01) 34.1290 (1.01) 34.1290 (1.01) 0.0000 (1.0) 34.1290 (1.01) 0.0000 (1.0) 0;0 0.0293 (0.99) 1 1
test_status-status-changed (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0003_2.9.5) 34.2095 (1.01) 34.2095 (1.01) 34.2095 (1.01) 0.0000 (1.0) 34.2095 (1.01) 0.0000 (1.0) 0;0 0.0292 (0.99) 1 1
test_status-status-changed (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0004_2.8.3) 37.8837 (1.12) 37.8837 (1.12) 37.8837 (1.12) 0.0000 (1.0) 37.8837 (1.12) 0.0000 (1.0) 0;0 0.0264 (0.90) 1 1
test_status-status-changed (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0005_2.7.3) 36.8473 (1.09) 36.8473 (1.09) 36.8473 (1.09) 0.0000 (1.0) 36.8473 (1.09) 0.0000 (1.0) 0;0 0.0271 (0.92) 1 1
test_status-status-changed (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0006_2.6.3) 35.7097 (1.05) 35.7097 (1.05) 35.7097 (1.05) 0.0000 (1.0) 35.7097 (1.05) 0.0000 (1.0) 0;0 0.0280 (0.95) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 6 tests ---------------------------------------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0001_main) 33.8253 (1.00) 33.8253 (1.00) 33.8253 (1.00) 0.0000 (1.0) 33.8253 (1.00) 0.0000 (1.0) 0;0 0.0296 (1.00) 1 1
test_status-status-changed-noop (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0002_2.10.0) 33.8216 (1.0) 33.8216 (1.0) 33.8216 (1.0) 0.0000 (1.0) 33.8216 (1.0) 0.0000 (1.0) 0;0 0.0296 (1.0) 1 1
test_status-status-changed-noop (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0003_2.9.5) 33.9227 (1.00) 33.9227 (1.00) 33.9227 (1.00) 0.0000 (1.0) 33.9227 (1.00) 0.0000 (1.0) 0;0 0.0295 (1.00) 1 1
test_status-status-changed-noop (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0004_2.8.3) 36.9409 (1.09) 36.9409 (1.09) 36.9409 (1.09) 0.0000 (1.0) 36.9409 (1.09) 0.0000 (1.0) 0;0 0.0271 (0.92) 1 1
test_status-status-changed-noop (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0005_2.7.3) 37.1352 (1.10) 37.1352 (1.10) 37.1352 (1.10) 0.0000 (1.0) 37.1352 (1.10) 0.0000 (1.0) 0;0 0.0269 (0.91) 1 1
test_status-status-changed-noop (benchmarks-tests-benchmarks-cli-commands-test_status.py-test_status/Linux-CPython-3.7-64bit/0006_2.6.3) 35.2774 (1.04) 35.2774 (1.04) 35.2774 (1.04) 0.0000 (1.0) 35.2774 (1.04) 0.0000 (1.0) 0;0 0.0283 (0.96) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```