Closed dependabot[bot] closed 9 months ago
Thu Sep 28 10:15:29 UTC 2023
dataset: small
project: example-get-started
-------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 12.3029 (1.22) 12.3029 (1.22) 12.3029 (1.22) 0.0000 (1.0) 12.3029 (1.22) 0.0000 (1.0) 0;0 0.0813 (0.82) 1 1
test_import-import[2.40.0] 10.0516 (1.0) 10.0516 (1.0) 10.0516 (1.0) 0.0000 (1.0) 10.0516 (1.0) 0.0000 (1.0) 0;0 0.0995 (1.0) 1 1
test_import-import[2.58.2] 10.3539 (1.03) 10.3539 (1.03) 10.3539 (1.03) 0.0000 (1.0) 10.3539 (1.03) 0.0000 (1.0) 0;0 0.0966 (0.97) 1 1
test_import-import[3.0.0] 10.4319 (1.04) 10.4319 (1.04) 10.4319 (1.04) 0.0000 (1.0) 10.4319 (1.04) 0.0000 (1.0) 0;0 0.0959 (0.96) 1 1
test_import-import[main] 11.1077 (1.11) 11.1077 (1.11) 11.1077 (1.11) 0.0000 (1.0) 11.1077 (1.11) 0.0000 (1.0) 0;0 0.0900 (0.90) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 2.0659 (1.18) 2.0659 (1.18) 2.0659 (1.18) 0.0000 (1.0) 2.0659 (1.18) 0.0000 (1.0) 0;0 0.4840 (0.84) 1 1
test_checkout_symlink-checkout[2.40.0] 1.8998 (1.09) 1.8998 (1.09) 1.8998 (1.09) 0.0000 (1.0) 1.8998 (1.09) 0.0000 (1.0) 0;0 0.5264 (0.92) 1 1
test_checkout_symlink-checkout[2.58.2] 2.1124 (1.21) 2.1124 (1.21) 2.1124 (1.21) 0.0000 (1.0) 2.1124 (1.21) 0.0000 (1.0) 0;0 0.4734 (0.83) 1 1
test_checkout_symlink-checkout[3.0.0] 1.7443 (1.0) 1.7443 (1.0) 1.7443 (1.0) 0.0000 (1.0) 1.7443 (1.0) 0.0000 (1.0) 0;0 0.5733 (1.0) 1 1
test_checkout_symlink-checkout[main] 1.9171 (1.10) 1.9171 (1.10) 1.9171 (1.10) 0.0000 (1.0) 1.9171 (1.10) 0.0000 (1.0) 0;0 0.5216 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 754.8757 (1.0) 754.8757 (1.0) 754.8757 (1.0) 0.0000 (1.0) 754.8757 (1.0) 0.0000 (1.0) 0;0 1.3247 (1.0) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 829.7156 (1.10) 829.7156 (1.10) 829.7156 (1.10) 0.0000 (1.0) 829.7156 (1.10) 0.0000 (1.0) 0;0 1.2052 (0.91) 1 1
test_checkout_symlink-checkout-noop[2.58.2] 962.7053 (1.28) 962.7053 (1.28) 962.7053 (1.28) 0.0000 (1.0) 962.7053 (1.28) 0.0000 (1.0) 0;0 1.0387 (0.78) 1 1
test_checkout_symlink-checkout-noop[3.0.0] 990.6357 (1.31) 990.6357 (1.31) 990.6357 (1.31) 0.0000 (1.0) 990.6357 (1.31) 0.0000 (1.0) 0;0 1.0095 (0.76) 1 1
test_checkout_symlink-checkout-noop[main] 975.8678 (1.29) 975.8678 (1.29) 975.8678 (1.29) 0.0000 (1.0) 975.8678 (1.29) 0.0000 (1.0) 0;0 1.0247 (0.77) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 2.0633 (2.15) 2.0633 (2.15) 2.0633 (2.15) 0.0000 (1.0) 2.0633 (2.15) 0.0000 (1.0) 0;0 0.4847 (0.47) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.9601 (1.0) 0.9601 (1.0) 0.9601 (1.0) 0.0000 (1.0) 0.9601 (1.0) 0.0000 (1.0) 0;0 1.0415 (1.0) 1 1
test_checkout_symlink-checkout-update[2.58.2] 1.2579 (1.31) 1.2579 (1.31) 1.2579 (1.31) 0.0000 (1.0) 1.2579 (1.31) 0.0000 (1.0) 0;0 0.7949 (0.76) 1 1
test_checkout_symlink-checkout-update[3.0.0] 1.1161 (1.16) 1.1161 (1.16) 1.1161 (1.16) 0.0000 (1.0) 1.1161 (1.16) 0.0000 (1.0) 0;0 0.8960 (0.86) 1 1
test_checkout_symlink-checkout-update[main] 1.0971 (1.14) 1.0971 (1.14) 1.0971 (1.14) 0.0000 (1.0) 1.0971 (1.14) 0.0000 (1.0) 0;0 0.9115 (0.88) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 7.3239 (1.78) 7.3239 (1.78) 7.3239 (1.78) 0.0000 (1.0) 7.3239 (1.78) 0.0000 (1.0) 0;0 0.1365 (0.56) 1 1
test_partial_remove-add[2.40.0] 6.1117 (1.49) 6.1117 (1.49) 6.1117 (1.49) 0.0000 (1.0) 6.1117 (1.49) 0.0000 (1.0) 0;0 0.1636 (0.67) 1 1
test_partial_remove-add[2.58.2] 4.1123 (1.0) 4.1123 (1.0) 4.1123 (1.0) 0.0000 (1.0) 4.1123 (1.0) 0.0000 (1.0) 0;0 0.2432 (1.0) 1 1
test_partial_remove-add[3.0.0] 4.2643 (1.04) 4.2643 (1.04) 4.2643 (1.04) 0.0000 (1.0) 4.2643 (1.04) 0.0000 (1.0) 0;0 0.2345 (0.96) 1 1
test_partial_remove-add[main] 4.1138 (1.00) 4.1138 (1.00) 4.1138 (1.00) 0.0000 (1.0) 4.1138 (1.00) 0.0000 (1.0) 0;0 0.2431 (1.00) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.11.0] 2.7664 (1.77) 2.7664 (1.77) 2.7664 (1.77) 0.0000 (1.0) 2.7664 (1.77) 0.0000 (1.0) 0;0 0.3615 (0.57) 1 1
test_partial_remove-add-update[2.40.0] 1.5638 (1.0) 1.5638 (1.0) 1.5638 (1.0) 0.0000 (1.0) 1.5638 (1.0) 0.0000 (1.0) 0;0 0.6395 (1.0) 1 1
test_partial_remove-add-update[2.58.2] 1.6630 (1.06) 1.6630 (1.06) 1.6630 (1.06) 0.0000 (1.0) 1.6630 (1.06) 0.0000 (1.0) 0;0 0.6013 (0.94) 1 1
test_partial_remove-add-update[3.0.0] 1.6632 (1.06) 1.6632 (1.06) 1.6632 (1.06) 0.0000 (1.0) 1.6632 (1.06) 0.0000 (1.0) 0;0 0.6013 (0.94) 1 1
test_partial_remove-add-update[main] 1.6417 (1.05) 1.6417 (1.05) 1.6417 (1.05) 0.0000 (1.0) 1.6417 (1.05) 0.0000 (1.0) 0;0 0.6091 (0.95) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 465.2679 (1.0) 465.2679 (1.0) 465.2679 (1.0) 0.0000 (1.0) 465.2679 (1.0) 0.0000 (1.0) 0;0 2.1493 (1.0) 1 1
test_partial_remove-gc[2.40.0] 534.6756 (1.15) 534.6756 (1.15) 534.6756 (1.15) 0.0000 (1.0) 534.6756 (1.15) 0.0000 (1.0) 0;0 1.8703 (0.87) 1 1
test_partial_remove-gc[2.58.2] 605.7432 (1.30) 605.7432 (1.30) 605.7432 (1.30) 0.0000 (1.0) 605.7432 (1.30) 0.0000 (1.0) 0;0 1.6509 (0.77) 1 1
test_partial_remove-gc[3.0.0] 633.5236 (1.36) 633.5236 (1.36) 633.5236 (1.36) 0.0000 (1.0) 633.5236 (1.36) 0.0000 (1.0) 0;0 1.5785 (0.73) 1 1
test_partial_remove-gc[main] 653.5323 (1.40) 653.5323 (1.40) 653.5323 (1.40) 0.0000 (1.0) 653.5323 (1.40) 0.0000 (1.0) 0;0 1.5301 (0.71) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 507.5720 (1.0) 507.5720 (1.0) 507.5720 (1.0) 0.0000 (1.0) 507.5720 (1.0) 0.0000 (1.0) 0;0 1.9702 (1.0) 1 1
test_partial_remove-gc-cloud[2.40.0] 601.1090 (1.18) 601.1090 (1.18) 601.1090 (1.18) 0.0000 (1.0) 601.1090 (1.18) 0.0000 (1.0) 0;0 1.6636 (0.84) 1 1
test_partial_remove-gc-cloud[2.58.2] 686.2024 (1.35) 686.2024 (1.35) 686.2024 (1.35) 0.0000 (1.0) 686.2024 (1.35) 0.0000 (1.0) 0;0 1.4573 (0.74) 1 1
test_partial_remove-gc-cloud[3.0.0] 720.2289 (1.42) 720.2289 (1.42) 720.2289 (1.42) 0.0000 (1.0) 720.2289 (1.42) 0.0000 (1.0) 0;0 1.3884 (0.70) 1 1
test_partial_remove-gc-cloud[main] 748.0607 (1.47) 748.0607 (1.47) 748.0607 (1.47) 0.0000 (1.0) 748.0607 (1.47) 0.0000 (1.0) 0;0 1.3368 (0.68) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 4.1104 (2.35) 4.1104 (2.35) 4.1104 (2.35) 0.0000 (1.0) 4.1104 (2.35) 0.0000 (1.0) 0;0 0.2433 (0.43) 1 1
test_partial_remove-push[2.40.0] 5.1405 (2.94) 5.1405 (2.94) 5.1405 (2.94) 0.0000 (1.0) 5.1405 (2.94) 0.0000 (1.0) 0;0 0.1945 (0.34) 1 1
test_partial_remove-push[2.58.2] 3.4777 (1.99) 3.4777 (1.99) 3.4777 (1.99) 0.0000 (1.0) 3.4777 (1.99) 0.0000 (1.0) 0;0 0.2875 (0.50) 1 1
test_partial_remove-push[3.0.0] 1.7497 (1.0) 1.7497 (1.0) 1.7497 (1.0) 0.0000 (1.0) 1.7497 (1.0) 0.0000 (1.0) 0;0 0.5715 (1.0) 1 1
test_partial_remove-push[main] 3.4704 (1.98) 3.4704 (1.98) 3.4704 (1.98) 0.0000 (1.0) 3.4704 (1.98) 0.0000 (1.0) 0;0 0.2882 (0.50) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.11.0] 495.6724 (1.0) 495.6724 (1.0) 495.6724 (1.0) 0.0000 (1.0) 495.6724 (1.0) 0.0000 (1.0) 0;0 2.0175 (1.0) 1 1
test_partial_remove-push-update[2.40.0] 544.2688 (1.10) 544.2688 (1.10) 544.2688 (1.10) 0.0000 (1.0) 544.2688 (1.10) 0.0000 (1.0) 0;0 1.8373 (0.91) 1 1
test_partial_remove-push-update[2.58.2] 587.4716 (1.19) 587.4716 (1.19) 587.4716 (1.19) 0.0000 (1.0) 587.4716 (1.19) 0.0000 (1.0) 0;0 1.7022 (0.84) 1 1
test_partial_remove-push-update[3.0.0] 588.0849 (1.19) 588.0849 (1.19) 588.0849 (1.19) 0.0000 (1.0) 588.0849 (1.19) 0.0000 (1.0) 0;0 1.7004 (0.84) 1 1
test_partial_remove-push-update[main] 594.9824 (1.20) 594.9824 (1.20) 594.9824 (1.20) 0.0000 (1.0) 594.9824 (1.20) 0.0000 (1.0) 0;0 1.6807 (0.83) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 444.9965 (1.0) 444.9965 (1.0) 444.9965 (1.0) 0.0000 (1.0) 444.9965 (1.0) 0.0000 (1.0) 0;0 2.2472 (1.0) 1 1
test_gc-gc[2.40.0] 486.4528 (1.09) 486.4528 (1.09) 486.4528 (1.09) 0.0000 (1.0) 486.4528 (1.09) 0.0000 (1.0) 0;0 2.0557 (0.91) 1 1
test_gc-gc[2.58.2] 547.5253 (1.23) 547.5253 (1.23) 547.5253 (1.23) 0.0000 (1.0) 547.5253 (1.23) 0.0000 (1.0) 0;0 1.8264 (0.81) 1 1
test_gc-gc[3.0.0] 546.0016 (1.23) 546.0016 (1.23) 546.0016 (1.23) 0.0000 (1.0) 546.0016 (1.23) 0.0000 (1.0) 0;0 1.8315 (0.82) 1 1
test_gc-gc[main] 540.9401 (1.22) 540.9401 (1.22) 540.9401 (1.22) 0.0000 (1.0) 540.9401 (1.22) 0.0000 (1.0) 0;0 1.8486 (0.82) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 7.7539 (1.86) 7.7539 (1.86) 7.7539 (1.86) 0.0000 (1.0) 7.7539 (1.86) 0.0000 (1.0) 0;0 0.1290 (0.54) 1 1
test_add-add[2.40.0] 6.1611 (1.48) 6.1611 (1.48) 6.1611 (1.48) 0.0000 (1.0) 6.1611 (1.48) 0.0000 (1.0) 0;0 0.1623 (0.68) 1 1
test_add-add[2.58.2] 4.9000 (1.18) 4.9000 (1.18) 4.9000 (1.18) 0.0000 (1.0) 4.9000 (1.18) 0.0000 (1.0) 0;0 0.2041 (0.85) 1 1
test_add-add[3.0.0] 4.3252 (1.04) 4.3252 (1.04) 4.3252 (1.04) 0.0000 (1.0) 4.3252 (1.04) 0.0000 (1.0) 0;0 0.2312 (0.96) 1 1
test_add-add[main] 4.1657 (1.0) 4.1657 (1.0) 4.1657 (1.0) 0.0000 (1.0) 4.1657 (1.0) 0.0000 (1.0) 0;0 0.2401 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.40.0] 859.4156 (1.0) 859.4156 (1.0) 859.4156 (1.0) 0.0000 (1.0) 859.4156 (1.0) 0.0000 (1.0) 0;0 1.1636 (1.0) 1 1
test_exp_show-exp[2.58.2] 1,019.0723 (1.19) 1,019.0723 (1.19) 1,019.0723 (1.19) 0.0000 (1.0) 1,019.0723 (1.19) 0.0000 (1.0) 0;0 0.9813 (0.84) 1 1
test_exp_show-exp[3.0.0] 6,650.0223 (7.74) 6,650.0223 (7.74) 6,650.0223 (7.74) 0.0000 (1.0) 6,650.0223 (7.74) 0.0000 (1.0) 0;0 0.1504 (0.13) 1 1
test_exp_show-exp[main] 5,828.6682 (6.78) 5,828.6682 (6.78) 5,828.6682 (6.78) 0.0000 (1.0) 5,828.6682 (6.78) 0.0000 (1.0) 0;0 0.1716 (0.15) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.11.0] 9.9812 (1.35) 9.9812 (1.35) 9.9812 (1.35) 0.0000 (1.0) 9.9812 (1.35) 0.0000 (1.0) 0;0 0.1002 (0.74) 1 1
test_update-import-url[2.40.0] 9.1533 (1.23) 9.1533 (1.23) 9.1533 (1.23) 0.0000 (1.0) 9.1533 (1.23) 0.0000 (1.0) 0;0 0.1093 (0.81) 1 1
test_update-import-url[2.58.2] 7.4712 (1.01) 7.4712 (1.01) 7.4712 (1.01) 0.0000 (1.0) 7.4712 (1.01) 0.0000 (1.0) 0;0 0.1338 (0.99) 1 1
test_update-import-url[3.0.0] 7.4176 (1.0) 7.4176 (1.0) 7.4176 (1.0) 0.0000 (1.0) 7.4176 (1.0) 0.0000 (1.0) 0;0 0.1348 (1.0) 1 1
test_update-import-url[main] 7.4489 (1.00) 7.4489 (1.00) 7.4489 (1.00) 0.0000 (1.0) 7.4489 (1.00) 0.0000 (1.0) 0;0 0.1342 (1.00) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 8.1847 (1.35) 8.1847 (1.35) 8.1847 (1.35) 0.0000 (1.0) 8.1847 (1.35) 0.0000 (1.0) 0;0 0.1222 (0.74) 1 1
test_update-update[2.40.0] 6.0586 (1.0) 6.0586 (1.0) 6.0586 (1.0) 0.0000 (1.0) 6.0586 (1.0) 0.0000 (1.0) 0;0 0.1651 (1.0) 1 1
test_update-update[2.58.2] 6.5136 (1.08) 6.5136 (1.08) 6.5136 (1.08) 0.0000 (1.0) 6.5136 (1.08) 0.0000 (1.0) 0;0 0.1535 (0.93) 1 1
test_update-update[3.0.0] 6.4472 (1.06) 6.4472 (1.06) 6.4472 (1.06) 0.0000 (1.0) 6.4472 (1.06) 0.0000 (1.0) 0;0 0.1551 (0.94) 1 1
test_update-update[main] 6.6648 (1.10) 6.6648 (1.10) 6.6648 (1.10) 0.0000 (1.0) 6.6648 (1.10) 0.0000 (1.0) 0;0 0.1500 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 487.8012 (1.0) 487.8012 (1.0) 487.8012 (1.0) 0.0000 (1.0) 487.8012 (1.0) 0.0000 (1.0) 0;0 2.0500 (1.0) 1 1
test_update-update-noop[2.40.0] 901.0696 (1.85) 901.0696 (1.85) 901.0696 (1.85) 0.0000 (1.0) 901.0696 (1.85) 0.0000 (1.0) 0;0 1.1098 (0.54) 1 1
test_update-update-noop[2.58.2] 1,059.7039 (2.17) 1,059.7039 (2.17) 1,059.7039 (2.17) 0.0000 (1.0) 1,059.7039 (2.17) 0.0000 (1.0) 0;0 0.9437 (0.46) 1 1
test_update-update-noop[3.0.0] 1,043.0794 (2.14) 1,043.0794 (2.14) 1,043.0794 (2.14) 0.0000 (1.0) 1,043.0794 (2.14) 0.0000 (1.0) 0;0 0.9587 (0.47) 1 1
test_update-update-noop[main] 1,092.5309 (2.24) 1,092.5309 (2.24) 1,092.5309 (2.24) 0.0000 (1.0) 1,092.5309 (2.24) 0.0000 (1.0) 0;0 0.9153 (0.45) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.40.0] 691.4424 (1.02) 746.5398 (1.03) 711.9004 (1.02) 22.7516 (2.19) 711.9836 (1.02) 33.6280 (2.48) 1;0 1.4047 (0.98) 5 3
test_plots-plots-diff[2.58.2] 677.8405 (1.0) 721.4239 (1.0) 697.5433 (1.0) 19.3021 (1.86) 701.1588 (1.0) 34.3353 (2.53) 3;0 1.4336 (1.0) 5 3
test_plots-plots-diff[3.0.0] 1,207.9958 (1.78) 1,260.0875 (1.75) 1,225.0497 (1.76) 20.2923 (1.95) 1,219.8453 (1.74) 17.7530 (1.31) 1;1 0.8163 (0.57) 5 3
test_plots-plots-diff[main] 1,148.2904 (1.69) 1,175.9831 (1.63) 1,160.7096 (1.66) 10.3805 (1.0) 1,160.8228 (1.66) 13.5541 (1.0) 2;0 0.8615 (0.60) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.40.0] 720.9045 (1.04) 743.8219 (1.05) 730.0445 (1.04) 9.3705 (1.23) 725.9117 (1.03) 13.9903 (1.37) 1;0 1.3698 (0.96) 5 3
test_plots-plots-diff-json[2.58.2] 690.0414 (1.0) 709.7562 (1.0) 701.9367 (1.0) 7.6327 (1.0) 703.5462 (1.0) 10.2061 (1.0) 2;0 1.4246 (1.0) 5 3
test_plots-plots-diff-json[3.0.0] 1,604.0263 (2.32) 1,673.4098 (2.36) 1,631.2665 (2.32) 25.8031 (3.38) 1,625.4714 (2.31) 26.2229 (2.57) 2;0 0.6130 (0.43) 5 3
test_plots-plots-diff-json[main] 1,609.0991 (2.33) 1,692.7231 (2.38) 1,659.3040 (2.36) 36.6077 (4.80) 1,677.5788 (2.38) 60.4224 (5.92) 1;0 0.6027 (0.42) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.40.0] 540.8819 (1.0) 577.0543 (1.0) 553.9896 (1.0) 14.6648 (1.36) 551.8105 (1.0) 20.7314 (2.11) 1;0 1.8051 (1.0) 5 3
test_plots-plots-show[2.58.2] 620.4927 (1.15) 649.7921 (1.13) 638.0774 (1.15) 10.7670 (1.0) 640.4473 (1.16) 9.8161 (1.0) 2;0 1.5672 (0.87) 5 3
test_plots-plots-show[3.0.0] 973.1652 (1.80) 1,032.5622 (1.79) 1,002.5647 (1.81) 26.1564 (2.43) 1,015.0269 (1.84) 43.5434 (4.44) 2;0 0.9974 (0.55) 5 3
test_plots-plots-show[main] 1,011.6688 (1.87) 1,121.3621 (1.94) 1,056.5777 (1.91) 47.6085 (4.42) 1,048.1685 (1.90) 82.7000 (8.42) 1;0 0.9465 (0.52) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.40.0] 598.5665 (1.0) 631.5397 (1.0) 613.4693 (1.0) 12.3553 (1.0) 610.3647 (1.0) 15.9169 (1.05) 2;0 1.6301 (1.0) 5 3
test_plots-plots-show-json[2.58.2] 661.5741 (1.11) 690.7316 (1.09) 673.2098 (1.10) 12.4614 (1.01) 670.6837 (1.10) 20.9844 (1.39) 1;0 1.4854 (0.91) 5 3
test_plots-plots-show-json[3.0.0] 1,232.4377 (2.06) 1,267.3152 (2.01) 1,247.7603 (2.03) 12.8476 (1.04) 1,247.1362 (2.04) 15.0983 (1.0) 2;0 0.8014 (0.49) 5 3
test_plots-plots-show-json[main] 1,177.8860 (1.97) 1,242.3846 (1.97) 1,201.0206 (1.96) 26.5811 (2.15) 1,194.1203 (1.96) 39.0761 (2.59) 1;0 0.8326 (0.51) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.40.0] 1.2738 (1.03) 1.2738 (1.03) 1.2738 (1.03) 0.0000 (1.0) 1.2738 (1.03) 0.0000 (1.0) 0;0 0.7850 (0.97) 1 1
test_data_status_all_flags-data-changed[2.58.2] 1.2608 (1.02) 1.2608 (1.02) 1.2608 (1.02) 0.0000 (1.0) 1.2608 (1.02) 0.0000 (1.0) 0;0 0.7931 (0.98) 1 1
test_data_status_all_flags-data-changed[3.0.0] 1.2939 (1.05) 1.2939 (1.05) 1.2939 (1.05) 0.0000 (1.0) 1.2939 (1.05) 0.0000 (1.0) 0;0 0.7729 (0.95) 1 1
test_data_status_all_flags-data-changed[main] 1.2319 (1.0) 1.2319 (1.0) 1.2319 (1.0) 0.0000 (1.0) 1.2319 (1.0) 0.0000 (1.0) 0;0 0.8118 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.40.0] 1.2776 (1.04) 1.2776 (1.04) 1.2776 (1.04) 0.0000 (1.0) 1.2776 (1.04) 0.0000 (1.0) 0;0 0.7827 (0.96) 1 1
test_data_status_all_flags-data-changed-noop[2.58.2] 1.2777 (1.04) 1.2777 (1.04) 1.2777 (1.04) 0.0000 (1.0) 1.2777 (1.04) 0.0000 (1.0) 0;0 0.7827 (0.96) 1 1
test_data_status_all_flags-data-changed-noop[3.0.0] 1.2468 (1.02) 1.2468 (1.02) 1.2468 (1.02) 0.0000 (1.0) 1.2468 (1.02) 0.0000 (1.0) 0;0 0.8020 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.2265 (1.0) 1.2265 (1.0) 1.2265 (1.0) 0.0000 (1.0) 1.2265 (1.0) 0.0000 (1.0) 0;0 0.8153 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.40.0] 2.1403 (1.04) 2.1403 (1.04) 2.1403 (1.04) 0.0000 (1.0) 2.1403 (1.04) 0.0000 (1.0) 0;0 0.4672 (0.97) 1 1
test_data_status_all_flags-data-new[2.58.2] 2.1225 (1.03) 2.1225 (1.03) 2.1225 (1.03) 0.0000 (1.0) 2.1225 (1.03) 0.0000 (1.0) 0;0 0.4711 (0.97) 1 1
test_data_status_all_flags-data-new[3.0.0] 2.2718 (1.10) 2.2718 (1.10) 2.2718 (1.10) 0.0000 (1.0) 2.2718 (1.10) 0.0000 (1.0) 0;0 0.4402 (0.91) 1 1
test_data_status_all_flags-data-new[main] 2.0656 (1.0) 2.0656 (1.0) 2.0656 (1.0) 0.0000 (1.0) 2.0656 (1.0) 0.0000 (1.0) 0;0 0.4841 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.40.0] 1.2305 (1.03) 1.2305 (1.03) 1.2305 (1.03) 0.0000 (1.0) 1.2305 (1.03) 0.0000 (1.0) 0;0 0.8127 (0.97) 1 1
test_data_status_all_flags-data-noop[2.58.2] 1.2893 (1.08) 1.2893 (1.08) 1.2893 (1.08) 0.0000 (1.0) 1.2893 (1.08) 0.0000 (1.0) 0;0 0.7756 (0.93) 1 1
test_data_status_all_flags-data-noop[3.0.0] 1.3100 (1.10) 1.3100 (1.10) 1.3100 (1.10) 0.0000 (1.0) 1.3100 (1.10) 0.0000 (1.0) 0;0 0.7633 (0.91) 1 1
test_data_status_all_flags-data-noop[main] 1.1931 (1.0) 1.1931 (1.0) 1.1931 (1.0) 0.0000 (1.0) 1.1931 (1.0) 0.0000 (1.0) 0;0 0.8382 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.11.0] 7.5701 (1.85) 7.5701 (1.85) 7.5701 (1.85) 0.0000 (1.0) 7.5701 (1.85) 0.0000 (1.0) 0;0 0.1321 (0.54) 1 1
test_sharing_gs-add[2.11.0] 7.3708 (1.80) 7.3708 (1.80) 7.3708 (1.80) 0.0000 (1.0) 7.3708 (1.80) 0.0000 (1.0) 0;0 0.1357 (0.55) 1 1
test_sharing_gs-add[2.40.0] 5.9932 (1.47) 5.9932 (1.47) 5.9932 (1.47) 0.0000 (1.0) 5.9932 (1.47) 0.0000 (1.0) 0;0 0.1669 (0.68) 1 1
test_sharing_gs-add[2.40.0] 5.9626 (1.46) 5.9626 (1.46) 5.9626 (1.46) 0.0000 (1.0) 5.9626 (1.46) 0.0000 (1.0) 0;0 0.1677 (0.69) 1 1
test_sharing_gs-add[2.58.2] 4.1205 (1.01) 4.1205 (1.01) 4.1205 (1.01) 0.0000 (1.0) 4.1205 (1.01) 0.0000 (1.0) 0;0 0.2427 (0.99) 1 1
test_sharing_gs-add[2.58.2] 4.1935 (1.03) 4.1935 (1.03) 4.1935 (1.03) 0.0000 (1.0) 4.1935 (1.03) 0.0000 (1.0) 0;0 0.2385 (0.97) 1 1
test_sharing_gs-add[3.0.0] 4.0867 (1.0) 4.0867 (1.0) 4.0867 (1.0) 0.0000 (1.0) 4.0867 (1.0) 0.0000 (1.0) 0;0 0.2447 (1.0) 1 1
test_sharing_gs-add[3.0.0] 4.1204 (1.01) 4.1204 (1.01) 4.1204 (1.01) 0.0000 (1.0) 4.1204 (1.01) 0.0000 (1.0) 0;0 0.2427 (0.99) 1 1
test_sharing_gs-add[main] 4.1075 (1.01) 4.1075 (1.01) 4.1075 (1.01) 0.0000 (1.0) 4.1075 (1.01) 0.0000 (1.0) 0;0 0.2435 (0.99) 1 1
test_sharing_gs-add[main] 4.1062 (1.00) 4.1062 (1.00) 4.1062 (1.00) 0.0000 (1.0) 4.1062 (1.00) 0.0000 (1.0) 0;0 0.2435 (1.00) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.11.0] 3.5594 (1.41) 3.5594 (1.41) 3.5594 (1.41) 0.0000 (1.0) 3.5594 (1.41) 0.0000 (1.0) 0;0 0.2809 (0.71) 1 1
test_sharing_gs-add-noop[2.11.0] 3.5550 (1.41) 3.5550 (1.41) 3.5550 (1.41) 0.0000 (1.0) 3.5550 (1.41) 0.0000 (1.0) 0;0 0.2813 (0.71) 1 1
test_sharing_gs-add-noop[2.40.0] 2.5498 (1.01) 2.5498 (1.01) 2.5498 (1.01) 0.0000 (1.0) 2.5498 (1.01) 0.0000 (1.0) 0;0 0.3922 (0.99) 1 1
test_sharing_gs-add-noop[2.40.0] 2.5253 (1.0) 2.5253 (1.0) 2.5253 (1.0) 0.0000 (1.0) 2.5253 (1.0) 0.0000 (1.0) 0;0 0.3960 (1.0) 1 1
test_sharing_gs-add-noop[2.58.2] 2.7800 (1.10) 2.7800 (1.10) 2.7800 (1.10) 0.0000 (1.0) 2.7800 (1.10) 0.0000 (1.0) 0;0 0.3597 (0.91) 1 1
test_sharing_gs-add-noop[2.58.2] 2.7627 (1.09) 2.7627 (1.09) 2.7627 (1.09) 0.0000 (1.0) 2.7627 (1.09) 0.0000 (1.0) 0;0 0.3620 (0.91) 1 1
test_sharing_gs-add-noop[3.0.0] 2.7304 (1.08) 2.7304 (1.08) 2.7304 (1.08) 0.0000 (1.0) 2.7304 (1.08) 0.0000 (1.0) 0;0 0.3662 (0.92) 1 1
test_sharing_gs-add-noop[3.0.0] 2.7429 (1.09) 2.7429 (1.09) 2.7429 (1.09) 0.0000 (1.0) 2.7429 (1.09) 0.0000 (1.0) 0;0 0.3646 (0.92) 1 1
test_sharing_gs-add-noop[main] 2.7472 (1.09) 2.7472 (1.09) 2.7472 (1.09) 0.0000 (1.0) 2.7472 (1.09) 0.0000 (1.0) 0;0 0.3640 (0.92) 1 1
test_sharing_gs-add-noop[main] 2.7483 (1.09) 2.7483 (1.09) 2.7483 (1.09) 0.0000 (1.0) 2.7483 (1.09) 0.0000 (1.0) 0;0 0.3639 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.11.0] 518.7150 (1.0) 518.7150 (1.0) 518.7150 (1.0) 0.0000 (1.0) 518.7150 (1.0) 0.0000 (1.0) 0;0 1.9278 (1.0) 1 1
test_sharing_gs-checkout-noop[2.11.0] 523.0978 (1.01) 523.0978 (1.01) 523.0978 (1.01) 0.0000 (1.0) 523.0978 (1.01) 0.0000 (1.0) 0;0 1.9117 (0.99) 1 1
test_sharing_gs-checkout-noop[2.40.0] 649.2901 (1.25) 649.2901 (1.25) 649.2901 (1.25) 0.0000 (1.0) 649.2901 (1.25) 0.0000 (1.0) 0;0 1.5401 (0.80) 1 1
test_sharing_gs-checkout-noop[2.40.0] 616.7481 (1.19) 616.7481 (1.19) 616.7481 (1.19) 0.0000 (1.0) 616.7481 (1.19) 0.0000 (1.0) 0;0 1.6214 (0.84) 1 1
test_sharing_gs-checkout-noop[2.58.2] 674.3956 (1.30) 674.3956 (1.30) 674.3956 (1.30) 0.0000 (1.0) 674.3956 (1.30) 0.0000 (1.0) 0;0 1.4828 (0.77) 1 1
test_sharing_gs-checkout-noop[2.58.2] 674.1929 (1.30) 674.1929 (1.30) 674.1929 (1.30) 0.0000 (1.0) 674.1929 (1.30) 0.0000 (1.0) 0;0 1.4833 (0.77) 1 1
test_sharing_gs-checkout-noop[3.0.0] 703.9138 (1.36) 703.9138 (1.36) 703.9138 (1.36) 0.0000 (1.0) 703.9138 (1.36) 0.0000 (1.0) 0;0 1.4206 (0.74) 1 1
test_sharing_gs-checkout-noop[3.0.0] 691.9611 (1.33) 691.9611 (1.33) 691.9611 (1.33) 0.0000 (1.0) 691.9611 (1.33) 0.0000 (1.0) 0;0 1.4452 (0.75) 1 1
test_sharing_gs-checkout-noop[main] 689.6660 (1.33) 689.6660 (1.33) 689.6660 (1.33) 0.0000 (1.0) 689.6660 (1.33) 0.0000 (1.0) 0;0 1.4500 (0.75) 1 1
test_sharing_gs-checkout-noop[main] 693.1371 (1.34) 693.1371 (1.34) 693.1371 (1.34) 0.0000 (1.0) 693.1371 (1.34) 0.0000 (1.0) 0;0 1.4427 (0.75) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-pull': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull[2.11.0] 7.3732 (1.33) 7.3732 (1.33) 7.3732 (1.33) 0.0000 (1.0) 7.3732 (1.33) 0.0000 (1.0) 0;0 0.1356 (0.75) 1 1
test_sharing_gs-pull[2.11.0] 7.6356 (1.38) 7.6356 (1.38) 7.6356 (1.38) 0.0000 (1.0) 7.6356 (1.38) 0.0000 (1.0) 0;0 0.1310 (0.73) 1 1
test_sharing_gs-pull[2.40.0] 8.7117 (1.57) 8.7117 (1.57) 8.7117 (1.57) 0.0000 (1.0) 8.7117 (1.57) 0.0000 (1.0) 0;0 0.1148 (0.64) 1 1
test_sharing_gs-pull[2.40.0] 9.0583 (1.63) 9.0583 (1.63) 9.0583 (1.63) 0.0000 (1.0) 9.0583 (1.63) 0.0000 (1.0) 0;0 0.1104 (0.61) 1 1
test_sharing_gs-pull[2.58.2] 5.6032 (1.01) 5.6032 (1.01) 5.6032 (1.01) 0.0000 (1.0) 5.6032 (1.01) 0.0000 (1.0) 0;0 0.1785 (0.99) 1 1
test_sharing_gs-pull[2.58.2] 5.5448 (1.0) 5.5448 (1.0) 5.5448 (1.0) 0.0000 (1.0) 5.5448 (1.0) 0.0000 (1.0) 0;0 0.1804 (1.0) 1 1
test_sharing_gs-pull[3.0.0] 7.9993 (1.44) 7.9993 (1.44) 7.9993 (1.44) 0.0000 (1.0) 7.9993 (1.44) 0.0000 (1.0) 0;0 0.1250 (0.69) 1 1
test_sharing_gs-pull[3.0.0] 7.8347 (1.41) 7.8347 (1.41) 7.8347 (1.41) 0.0000 (1.0) 7.8347 (1.41) 0.0000 (1.0) 0;0 0.1276 (0.71) 1 1
test_sharing_gs-pull[main] 7.8267 (1.41) 7.8267 (1.41) 7.8267 (1.41) 0.0000 (1.0) 7.8267 (1.41) 0.0000 (1.0) 0;0 0.1278 (0.71) 1 1
test_sharing_gs-pull[main] 7.8638 (1.42) 7.8638 (1.42) 7.8638 (1.42) 0.0000 (1.0) 7.8638 (1.42) 0.0000 (1.0) 0;0 0.1272 (0.71) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull-noop[2.11.0] 549.9475 (1.0) 549.9475 (1.0) 549.9475 (1.0) 0.0000 (1.0) 549.9475 (1.0) 0.0000 (1.0) 0;0 1.8184 (1.0) 1 1
test_sharing_gs-pull-noop[2.11.0] 555.8734 (1.01) 555.8734 (1.01) 555.8734 (1.01) 0.0000 (1.0) 555.8734 (1.01) 0.0000 (1.0) 0;0 1.7990 (0.99) 1 1
test_sharing_gs-pull-noop[2.40.0] 643.4331 (1.17) 643.4331 (1.17) 643.4331 (1.17) 0.0000 (1.0) 643.4331 (1.17) 0.0000 (1.0) 0;0 1.5542 (0.85) 1 1
test_sharing_gs-pull-noop[2.40.0] 646.0674 (1.17) 646.0674 (1.17) 646.0674 (1.17) 0.0000 (1.0) 646.0674 (1.17) 0.0000 (1.0) 0;0 1.5478 (0.85) 1 1
test_sharing_gs-pull-noop[2.58.2] 723.7748 (1.32) 723.7748 (1.32) 723.7748 (1.32) 0.0000 (1.0) 723.7748 (1.32) 0.0000 (1.0) 0;0 1.3816 (0.76) 1 1
test_sharing_gs-pull-noop[2.58.2] 726.6392 (1.32) 726.6392 (1.32) 726.6392 (1.32) 0.0000 (1.0) 726.6392 (1.32) 0.0000 (1.0) 0;0 1.3762 (0.76) 1 1
test_sharing_gs-pull-noop[3.0.0] 840.6942 (1.53) 840.6942 (1.53) 840.6942 (1.53) 0.0000 (1.0) 840.6942 (1.53) 0.0000 (1.0) 0;0 1.1895 (0.65) 1 1
test_sharing_gs-pull-noop[3.0.0] 837.8980 (1.52) 837.8980 (1.52) 837.8980 (1.52) 0.0000 (1.0) 837.8980 (1.52) 0.0000 (1.0) 0;0 1.1935 (0.66) 1 1
test_sharing_gs-pull-noop[main] 832.4729 (1.51) 832.4729 (1.51) 832.4729 (1.51) 0.0000 (1.0) 832.4729 (1.51) 0.0000 (1.0) 0;0 1.2012 (0.66) 1 1
test_sharing_gs-pull-noop[main] 838.8758 (1.53) 838.8758 (1.53) 838.8758 (1.53) 0.0000 (1.0) 838.8758 (1.53) 0.0000 (1.0) 0;0 1.1921 (0.66) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.11.0] 4.0838 (2.37) 4.0838 (2.37) 4.0838 (2.37) 0.0000 (1.0) 4.0838 (2.37) 0.0000 (1.0) 0;0 0.2449 (0.42) 1 1
test_sharing_gs-push[2.11.0] 4.0395 (2.34) 4.0395 (2.34) 4.0395 (2.34) 0.0000 (1.0) 4.0395 (2.34) 0.0000 (1.0) 0;0 0.2476 (0.43) 1 1
test_sharing_gs-push[2.40.0] 5.1182 (2.97) 5.1182 (2.97) 5.1182 (2.97) 0.0000 (1.0) 5.1182 (2.97) 0.0000 (1.0) 0;0 0.1954 (0.34) 1 1
test_sharing_gs-push[2.40.0] 5.1405 (2.98) 5.1405 (2.98) 5.1405 (2.98) 0.0000 (1.0) 5.1405 (2.98) 0.0000 (1.0) 0;0 0.1945 (0.34) 1 1
test_sharing_gs-push[2.58.2] 3.5622 (2.07) 3.5622 (2.07) 3.5622 (2.07) 0.0000 (1.0) 3.5622 (2.07) 0.0000 (1.0) 0;0 0.2807 (0.48) 1 1
test_sharing_gs-push[2.58.2] 3.6856 (2.14) 3.6856 (2.14) 3.6856 (2.14) 0.0000 (1.0) 3.6856 (2.14) 0.0000 (1.0) 0;0 0.2713 (0.47) 1 1
test_sharing_gs-push[3.0.0] 1.7236 (1.0) 1.7236 (1.0) 1.7236 (1.0) 0.0000 (1.0) 1.7236 (1.0) 0.0000 (1.0) 0;0 0.5802 (1.0) 1 1
test_sharing_gs-push[3.0.0] 2.1884 (1.27) 2.1884 (1.27) 2.1884 (1.27) 0.0000 (1.0) 2.1884 (1.27) 0.0000 (1.0) 0;0 0.4570 (0.79) 1 1
test_sharing_gs-push[main] 3.5211 (2.04) 3.5211 (2.04) 3.5211 (2.04) 0.0000 (1.0) 3.5211 (2.04) 0.0000 (1.0) 0;0 0.2840 (0.49) 1 1
test_sharing_gs-push[main] 3.5637 (2.07) 3.5637 (2.07) 3.5637 (2.07) 0.0000 (1.0) 3.5637 (2.07) 0.0000 (1.0) 0;0 0.2806 (0.48) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.11.0] 458.0830 (1.01) 458.0830 (1.01) 458.0830 (1.01) 0.0000 (1.0) 458.0830 (1.01) 0.0000 (1.0) 0;0 2.1830 (0.99) 1 1
test_sharing_gs-push-noop[2.11.0] 454.3376 (1.0) 454.3376 (1.0) 454.3376 (1.0) 0.0000 (1.0) 454.3376 (1.0) 0.0000 (1.0) 0;0 2.2010 (1.0) 1 1
test_sharing_gs-push-noop[2.40.0] 498.3529 (1.10) 498.3529 (1.10) 498.3529 (1.10) 0.0000 (1.0) 498.3529 (1.10) 0.0000 (1.0) 0;0 2.0066 (0.91) 1 1
test_sharing_gs-push-noop[2.40.0] 492.5788 (1.08) 492.5788 (1.08) 492.5788 (1.08) 0.0000 (1.0) 492.5788 (1.08) 0.0000 (1.0) 0;0 2.0301 (0.92) 1 1
test_sharing_gs-push-noop[2.58.2] 546.8700 (1.20) 546.8700 (1.20) 546.8700 (1.20) 0.0000 (1.0) 546.8700 (1.20) 0.0000 (1.0) 0;0 1.8286 (0.83) 1 1
test_sharing_gs-push-noop[2.58.2] 554.0493 (1.22) 554.0493 (1.22) 554.0493 (1.22) 0.0000 (1.0) 554.0493 (1.22) 0.0000 (1.0) 0;0 1.8049 (0.82) 1 1
test_sharing_gs-push-noop[3.0.0] 547.5890 (1.21) 547.5890 (1.21) 547.5890 (1.21) 0.0000 (1.0) 547.5890 (1.21) 0.0000 (1.0) 0;0 1.8262 (0.83) 1 1
test_sharing_gs-push-noop[3.0.0] 728.8675 (1.60) 728.8675 (1.60) 728.8675 (1.60) 0.0000 (1.0) 728.8675 (1.60) 0.0000 (1.0) 0;0 1.3720 (0.62) 1 1
test_sharing_gs-push-noop[main] 541.5794 (1.19) 541.5794 (1.19) 541.5794 (1.19) 0.0000 (1.0) 541.5794 (1.19) 0.0000 (1.0) 0;0 1.8465 (0.84) 1 1
test_sharing_gs-push-noop[main] 546.9143 (1.20) 546.9143 (1.20) 546.9143 (1.20) 0.0000 (1.0) 546.9143 (1.20) 0.0000 (1.0) 0;0 1.8284 (0.83) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 2.5840 (1.61) 2.5840 (1.61) 2.5840 (1.61) 0.0000 (1.0) 2.5840 (1.61) 0.0000 (1.0) 0;0 0.3870 (0.62) 1 1
test_status-status[2.40.0] 1.6009 (1.0) 1.6009 (1.0) 1.6009 (1.0) 0.0000 (1.0) 1.6009 (1.0) 0.0000 (1.0) 0;0 0.6247 (1.0) 1 1
test_status-status[2.58.2] 1.6875 (1.05) 1.6875 (1.05) 1.6875 (1.05) 0.0000 (1.0) 1.6875 (1.05) 0.0000 (1.0) 0;0 0.5926 (0.95) 1 1
test_status-status[3.0.0] 1.6563 (1.03) 1.6563 (1.03) 1.6563 (1.03) 0.0000 (1.0) 1.6563 (1.03) 0.0000 (1.0) 0;0 0.6038 (0.97) 1 1
test_status-status[main] 1.6232 (1.01) 1.6232 (1.01) 1.6232 (1.01) 0.0000 (1.0) 1.6232 (1.01) 0.0000 (1.0) 0;0 0.6161 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 1.8192 (2.99) 1.8192 (2.99) 1.8192 (2.99) 0.0000 (1.0) 1.8192 (2.99) 0.0000 (1.0) 0;0 0.5497 (0.33) 1 1
test_status-status-changed[2.40.0] 0.6075 (1.0) 0.6075 (1.0) 0.6075 (1.0) 0.0000 (1.0) 0.6075 (1.0) 0.0000 (1.0) 0;0 1.6461 (1.0) 1 1
test_status-status-changed[2.58.2] 0.7008 (1.15) 0.7008 (1.15) 0.7008 (1.15) 0.0000 (1.0) 0.7008 (1.15) 0.0000 (1.0) 0;0 1.4270 (0.87) 1 1
test_status-status-changed[3.0.0] 0.6951 (1.14) 0.6951 (1.14) 0.6951 (1.14) 0.0000 (1.0) 0.6951 (1.14) 0.0000 (1.0) 0;0 1.4386 (0.87) 1 1
test_status-status-changed[main] 0.6628 (1.09) 0.6628 (1.09) 0.6628 (1.09) 0.0000 (1.0) 0.6628 (1.09) 0.0000 (1.0) 0;0 1.5088 (0.92) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 787.1099 (1.26) 787.1099 (1.26) 787.1099 (1.26) 0.0000 (1.0) 787.1099 (1.26) 0.0000 (1.0) 0;0 1.2705 (0.79) 1 1
test_status-status-changed-noop[2.40.0] 624.4262 (1.0) 624.4262 (1.0) 624.4262 (1.0) 0.0000 (1.0) 624.4262 (1.0) 0.0000 (1.0) 0;0 1.6015 (1.0) 1 1
test_status-status-changed-noop[2.58.2] 713.0662 (1.14) 713.0662 (1.14) 713.0662 (1.14) 0.0000 (1.0) 713.0662 (1.14) 0.0000 (1.0) 0;0 1.4024 (0.88) 1 1
test_status-status-changed-noop[3.0.0] 716.0361 (1.15) 716.0361 (1.15) 716.0361 (1.15) 0.0000 (1.0) 716.0361 (1.15) 0.0000 (1.0) 0;0 1.3966 (0.87) 1 1
test_status-status-changed-noop[main] 658.5304 (1.05) 658.5304 (1.05) 658.5304 (1.05) 0.0000 (1.0) 658.5304 (1.05) 0.0000 (1.0) 0;0 1.5185 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 502.8273 (1.0) 502.8273 (1.0) 502.8273 (1.0) 0.0000 (1.0) 502.8273 (1.0) 0.0000 (1.0) 0;0 1.9888 (1.0) 1 1
test_status-status-noop[2.40.0] 604.4836 (1.20) 604.4836 (1.20) 604.4836 (1.20) 0.0000 (1.0) 604.4836 (1.20) 0.0000 (1.0) 0;0 1.6543 (0.83) 1 1
test_status-status-noop[2.58.2] 698.2025 (1.39) 698.2025 (1.39) 698.2025 (1.39) 0.0000 (1.0) 698.2025 (1.39) 0.0000 (1.0) 0;0 1.4322 (0.72) 1 1
test_status-status-noop[3.0.0] 698.9539 (1.39) 698.9539 (1.39) 698.9539 (1.39) 0.0000 (1.0) 698.9539 (1.39) 0.0000 (1.0) 0;0 1.4307 (0.72) 1 1
test_status-status-noop[main] 663.9225 (1.32) 663.9225 (1.32) 663.9225 (1.32) 0.0000 (1.0) 663.9225 (1.32) 0.0000 (1.0) 0;0 1.5062 (0.76) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.11.0] 3.8725 (1.79) 3.8725 (1.79) 3.8725 (1.79) 0.0000 (1.0) 3.8725 (1.79) 0.0000 (1.0) 0;0 0.2582 (0.56) 1 1
test_partial_add-add[2.40.0] 3.2177 (1.49) 3.2177 (1.49) 3.2177 (1.49) 0.0000 (1.0) 3.2177 (1.49) 0.0000 (1.0) 0;0 0.3108 (0.67) 1 1
test_partial_add-add[2.58.2] 2.1768 (1.01) 2.1768 (1.01) 2.1768 (1.01) 0.0000 (1.0) 2.1768 (1.01) 0.0000 (1.0) 0;0 0.4594 (0.99) 1 1
test_partial_add-add[3.0.0] 2.1928 (1.01) 2.1928 (1.01) 2.1928 (1.01) 0.0000 (1.0) 2.1928 (1.01) 0.0000 (1.0) 0;0 0.4560 (0.99) 1 1
test_partial_add-add[main] 2.1616 (1.0) 2.1616 (1.0) 2.1616 (1.0) 0.0000 (1.0) 2.1616 (1.0) 0.0000 (1.0) 0;0 0.4626 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.11.0] 5.7959 (1.85) 5.7959 (1.85) 5.7959 (1.85) 0.0000 (1.0) 5.7959 (1.85) 0.0000 (1.0) 0;0 0.1725 (0.54) 1 1
test_partial_add-add-partial[2.40.0] 3.9906 (1.27) 3.9906 (1.27) 3.9906 (1.27) 0.0000 (1.0) 3.9906 (1.27) 0.0000 (1.0) 0;0 0.2506 (0.79) 1 1
test_partial_add-add-partial[2.58.2] 3.1508 (1.00) 3.1508 (1.00) 3.1508 (1.00) 0.0000 (1.0) 3.1508 (1.00) 0.0000 (1.0) 0;0 0.3174 (1.00) 1 1
test_partial_add-add-partial[3.0.0] 3.1373 (1.0) 3.1373 (1.0) 3.1373 (1.0) 0.0000 (1.0) 3.1373 (1.0) 0.0000 (1.0) 0;0 0.3187 (1.0) 1 1
test_partial_add-add-partial[main] 3.1527 (1.00) 3.1527 (1.00) 3.1527 (1.00) 0.0000 (1.0) 3.1527 (1.00) 0.0000 (1.0) 0;0 0.3172 (1.00) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 517.2537 (1.0) 517.2537 (1.0) 517.2537 (1.0) 0.0000 (1.0) 517.2537 (1.0) 0.0000 (1.0) 0;0 1.9333 (1.0) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 574.7115 (1.11) 574.7115 (1.11) 574.7115 (1.11) 0.0000 (1.0) 574.7115 (1.11) 0.0000 (1.0) 0;0 1.7400 (0.90) 1 1
test_partial_add-gc-cloud-noop[2.58.2] 699.2192 (1.35) 699.2192 (1.35) 699.2192 (1.35) 0.0000 (1.0) 699.2192 (1.35) 0.0000 (1.0) 0;0 1.4302 (0.74) 1 1
test_partial_add-gc-cloud-noop[3.0.0] 825.0241 (1.60) 825.0241 (1.60) 825.0241 (1.60) 0.0000 (1.0) 825.0241 (1.60) 0.0000 (1.0) 0;0 1.2121 (0.63) 1 1
test_partial_add-gc-cloud-noop[main] 845.4448 (1.63) 845.4448 (1.63) 845.4448 (1.63) 0.0000 (1.0) 845.4448 (1.63) 0.0000 (1.0) 0;0 1.1828 (0.61) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 447.6647 (1.0) 447.6647 (1.0) 447.6647 (1.0) 0.0000 (1.0) 447.6647 (1.0) 0.0000 (1.0) 0;0 2.2338 (1.0) 1 1
test_partial_add-gc-noop[2.40.0] 516.2330 (1.15) 516.2330 (1.15) 516.2330 (1.15) 0.0000 (1.0) 516.2330 (1.15) 0.0000 (1.0) 0;0 1.9371 (0.87) 1 1
test_partial_add-gc-noop[2.58.2] 611.1942 (1.37) 611.1942 (1.37) 611.1942 (1.37) 0.0000 (1.0) 611.1942 (1.37) 0.0000 (1.0) 0;0 1.6361 (0.73) 1 1
test_partial_add-gc-noop[3.0.0] 679.1594 (1.52) 679.1594 (1.52) 679.1594 (1.52) 0.0000 (1.0) 679.1594 (1.52) 0.0000 (1.0) 0;0 1.4724 (0.66) 1 1
test_partial_add-gc-noop[main] 694.7529 (1.55) 694.7529 (1.55) 694.7529 (1.55) 0.0000 (1.0) 694.7529 (1.55) 0.0000 (1.0) 0;0 1.4394 (0.64) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.11.0] 2.1987 (2.03) 2.1987 (2.03) 2.1987 (2.03) 0.0000 (1.0) 2.1987 (2.03) 0.0000 (1.0) 0;0 0.4548 (0.49) 1 1
test_partial_add-push[2.40.0] 2.7499 (2.54) 2.7499 (2.54) 2.7499 (2.54) 0.0000 (1.0) 2.7499 (2.54) 0.0000 (1.0) 0;0 0.3637 (0.39) 1 1
test_partial_add-push[2.58.2] 1.9275 (1.78) 1.9275 (1.78) 1.9275 (1.78) 0.0000 (1.0) 1.9275 (1.78) 0.0000 (1.0) 0;0 0.5188 (0.56) 1 1
test_partial_add-push[3.0.0] 1.0847 (1.0) 1.0847 (1.0) 1.0847 (1.0) 0.0000 (1.0) 1.0847 (1.0) 0.0000 (1.0) 0;0 0.9219 (1.0) 1 1
test_partial_add-push[main] 1.9417 (1.79) 1.9417 (1.79) 1.9417 (1.79) 0.0000 (1.0) 1.9417 (1.79) 0.0000 (1.0) 0;0 0.5150 (0.56) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.11.0] 2.2669 (1.88) 2.2669 (1.88) 2.2669 (1.88) 0.0000 (1.0) 2.2669 (1.88) 0.0000 (1.0) 0;0 0.4411 (0.53) 1 1
test_partial_add-push-partial[2.40.0] 2.7638 (2.29) 2.7638 (2.29) 2.7638 (2.29) 0.0000 (1.0) 2.7638 (2.29) 0.0000 (1.0) 0;0 0.3618 (0.44) 1 1
test_partial_add-push-partial[2.58.2] 2.0469 (1.70) 2.0469 (1.70) 2.0469 (1.70) 0.0000 (1.0) 2.0469 (1.70) 0.0000 (1.0) 0;0 0.4885 (0.59) 1 1
test_partial_add-push-partial[3.0.0] 1.2062 (1.0) 1.2062 (1.0) 1.2062 (1.0) 0.0000 (1.0) 1.2062 (1.0) 0.0000 (1.0) 0;0 0.8291 (1.0) 1 1
test_partial_add-push-partial[main] 2.0148 (1.67) 2.0148 (1.67) 2.0148 (1.67) 0.0000 (1.0) 2.0148 (1.67) 0.0000 (1.0) 0;0 0.4963 (0.60) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.40.0] 844.3947 (1.24) 844.3947 (1.24) 844.3947 (1.24) 0.0000 (1.0) 844.3947 (1.24) 0.0000 (1.0) 0;0 1.1843 (0.80) 1 1
test_data_status-data-changed[2.58.2] 749.3698 (1.10) 749.3698 (1.10) 749.3698 (1.10) 0.0000 (1.0) 749.3698 (1.10) 0.0000 (1.0) 0;0 1.3345 (0.91) 1 1
test_data_status-data-changed[3.0.0] 784.4992 (1.16) 784.4992 (1.16) 784.4992 (1.16) 0.0000 (1.0) 784.4992 (1.16) 0.0000 (1.0) 0;0 1.2747 (0.86) 1 1
test_data_status-data-changed[main] 678.2510 (1.0) 678.2510 (1.0) 678.2510 (1.0) 0.0000 (1.0) 678.2510 (1.0) 0.0000 (1.0) 0;0 1.4744 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.40.0] 801.8615 (1.20) 801.8615 (1.20) 801.8615 (1.20) 0.0000 (1.0) 801.8615 (1.20) 0.0000 (1.0) 0;0 1.2471 (0.83) 1 1
test_data_status-data-changed-noop[2.58.2] 776.8865 (1.16) 776.8865 (1.16) 776.8865 (1.16) 0.0000 (1.0) 776.8865 (1.16) 0.0000 (1.0) 0;0 1.2872 (0.86) 1 1
test_data_status-data-changed-noop[3.0.0] 771.0567 (1.15) 771.0567 (1.15) 771.0567 (1.15) 0.0000 (1.0) 771.0567 (1.15) 0.0000 (1.0) 0;0 1.2969 (0.87) 1 1
test_data_status-data-changed-noop[main] 668.8601 (1.0) 668.8601 (1.0) 668.8601 (1.0) 0.0000 (1.0) 668.8601 (1.0) 0.0000 (1.0) 0;0 1.4951 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.40.0] 1.8193 (1.22) 1.8193 (1.22) 1.8193 (1.22) 0.0000 (1.0) 1.8193 (1.22) 0.0000 (1.0) 0;0 0.5497 (0.82) 1 1
test_data_status-data-new[2.58.2] 2.0590 (1.38) 2.0590 (1.38) 2.0590 (1.38) 0.0000 (1.0) 2.0590 (1.38) 0.0000 (1.0) 0;0 0.4857 (0.73) 1 1
test_data_status-data-new[3.0.0] 1.6386 (1.10) 1.6386 (1.10) 1.6386 (1.10) 0.0000 (1.0) 1.6386 (1.10) 0.0000 (1.0) 0;0 0.6103 (0.91) 1 1
test_data_status-data-new[main] 1.4961 (1.0) 1.4961 (1.0) 1.4961 (1.0) 0.0000 (1.0) 1.4961 (1.0) 0.0000 (1.0) 0;0 0.6684 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.40.0] 835.2502 (1.25) 835.2502 (1.25) 835.2502 (1.25) 0.0000 (1.0) 835.2502 (1.25) 0.0000 (1.0) 0;0 1.1972 (0.80) 1 1
test_data_status-data-noop[2.58.2] 768.0766 (1.15) 768.0766 (1.15) 768.0766 (1.15) 0.0000 (1.0) 768.0766 (1.15) 0.0000 (1.0) 0;0 1.3020 (0.87) 1 1
test_data_status-data-noop[3.0.0] 993.4443 (1.48) 993.4443 (1.48) 993.4443 (1.48) 0.0000 (1.0) 993.4443 (1.48) 0.0000 (1.0) 0;0 1.0066 (0.67) 1 1
test_data_status-data-noop[main] 670.2709 (1.0) 670.2709 (1.0) 670.2709 (1.0) 0.0000 (1.0) 670.2709 (1.0) 0.0000 (1.0) 0;0 1.4919 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 1.8474 (1.21) 1.8474 (1.21) 1.8474 (1.21) 0.0000 (1.0) 1.8474 (1.21) 0.0000 (1.0) 0;0 0.5413 (0.83) 1 1
test_diff-diff[2.40.0] 1.5667 (1.02) 1.5667 (1.02) 1.5667 (1.02) 0.0000 (1.0) 1.5667 (1.02) 0.0000 (1.0) 0;0 0.6383 (0.98) 1 1
test_diff-diff[2.58.2] 1.5360 (1.00) 1.5360 (1.00) 1.5360 (1.00) 0.0000 (1.0) 1.5360 (1.00) 0.0000 (1.0) 0;0 0.6510 (1.00) 1 1
test_diff-diff[3.0.0] 1.5714 (1.03) 1.5714 (1.03) 1.5714 (1.03) 0.0000 (1.0) 1.5714 (1.03) 0.0000 (1.0) 0;0 0.6364 (0.97) 1 1
test_diff-diff[main] 1.5289 (1.0) 1.5289 (1.0) 1.5289 (1.0) 0.0000 (1.0) 1.5289 (1.0) 0.0000 (1.0) 0;0 0.6541 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.2218 (1.65) 1.2218 (1.65) 1.2218 (1.65) 0.0000 (1.0) 1.2218 (1.65) 0.0000 (1.0) 0;0 0.8185 (0.61) 1 1
test_diff-diff-changed[2.40.0] 0.7398 (1.0) 0.7398 (1.0) 0.7398 (1.0) 0.0000 (1.0) 0.7398 (1.0) 0.0000 (1.0) 0;0 1.3517 (1.0) 1 1
test_diff-diff-changed[2.58.2] 0.8179 (1.11) 0.8179 (1.11) 0.8179 (1.11) 0.0000 (1.0) 0.8179 (1.11) 0.0000 (1.0) 0;0 1.2226 (0.90) 1 1
test_diff-diff-changed[3.0.0] 0.8442 (1.14) 0.8442 (1.14) 0.8442 (1.14) 0.0000 (1.0) 0.8442 (1.14) 0.0000 (1.0) 0;0 1.1846 (0.88) 1 1
test_diff-diff-changed[main] 0.8338 (1.13) 0.8338 (1.13) 0.8338 (1.13) 0.0000 (1.0) 0.8338 (1.13) 0.0000 (1.0) 0;0 1.1993 (0.89) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 543.3382 (1.0) 543.3382 (1.0) 543.3382 (1.0) 0.0000 (1.0) 543.3382 (1.0) 0.0000 (1.0) 0;0 1.8405 (1.0) 1 1
test_diff-diff-changed-noop[2.40.0] 739.3524 (1.36) 739.3524 (1.36) 739.3524 (1.36) 0.0000 (1.0) 739.3524 (1.36) 0.0000 (1.0) 0;0 1.3525 (0.73) 1 1
test_diff-diff-changed-noop[2.58.2] 777.9427 (1.43) 777.9427 (1.43) 777.9427 (1.43) 0.0000 (1.0) 777.9427 (1.43) 0.0000 (1.0) 0;0 1.2854 (0.70) 1 1
test_diff-diff-changed-noop[3.0.0] 787.2829 (1.45) 787.2829 (1.45) 787.2829 (1.45) 0.0000 (1.0) 787.2829 (1.45) 0.0000 (1.0) 0;0 1.2702 (0.69) 1 1
test_diff-diff-changed-noop[main] 789.9341 (1.45) 789.9341 (1.45) 789.9341 (1.45) 0.0000 (1.0) 789.9341 (1.45) 0.0000 (1.0) 0;0 1.2659 (0.69) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 492.1100 (1.0) 492.1100 (1.0) 492.1100 (1.0) 0.0000 (1.0) 492.1100 (1.0) 0.0000 (1.0) 0;0 2.0321 (1.0) 1 1
test_diff-diff-noop[2.40.0] 696.8812 (1.42) 696.8812 (1.42) 696.8812 (1.42) 0.0000 (1.0) 696.8812 (1.42) 0.0000 (1.0) 0;0 1.4350 (0.71) 1 1
test_diff-diff-noop[2.58.2] 729.6090 (1.48) 729.6090 (1.48) 729.6090 (1.48) 0.0000 (1.0) 729.6090 (1.48) 0.0000 (1.0) 0;0 1.3706 (0.67) 1 1
test_diff-diff-noop[3.0.0] 739.7357 (1.50) 739.7357 (1.50) 739.7357 (1.50) 0.0000 (1.0) 739.7357 (1.50) 0.0000 (1.0) 0;0 1.3518 (0.67) 1 1
test_diff-diff-noop[main] 713.7110 (1.45) 713.7110 (1.45) 713.7110 (1.45) 0.0000 (1.0) 713.7110 (1.45) 0.0000 (1.0) 0;0 1.4011 (0.69) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 7.5302 (1.82) 7.5302 (1.82) 7.5302 (1.82) 0.0000 (1.0) 7.5302 (1.82) 0.0000 (1.0) 0;0 0.1328 (0.55) 1 1
test_sharing-add[2.40.0] 6.1725 (1.49) 6.1725 (1.49) 6.1725 (1.49) 0.0000 (1.0) 6.1725 (1.49) 0.0000 (1.0) 0;0 0.1620 (0.67) 1 1
test_sharing-add[2.58.2] 4.1478 (1.0) 4.1478 (1.0) 4.1478 (1.0) 0.0000 (1.0) 4.1478 (1.0) 0.0000 (1.0) 0;0 0.2411 (1.0) 1 1
test_sharing-add[3.0.0] 4.1583 (1.00) 4.1583 (1.00) 4.1583 (1.00) 0.0000 (1.0) 4.1583 (1.00) 0.0000 (1.0) 0;0 0.2405 (1.00) 1 1
test_sharing-add[main] 4.1623 (1.00) 4.1623 (1.00) 4.1623 (1.00) 0.0000 (1.0) 4.1623 (1.00) 0.0000 (1.0) 0;0 0.2403 (1.00) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 3.5423 (1.40) 3.5423 (1.40) 3.5423 (1.40) 0.0000 (1.0) 3.5423 (1.40) 0.0000 (1.0) 0;0 0.2823 (0.72) 1 1
test_sharing-add-noop[2.40.0] 2.5329 (1.0) 2.5329 (1.0) 2.5329 (1.0) 0.0000 (1.0) 2.5329 (1.0) 0.0000 (1.0) 0;0 0.3948 (1.0) 1 1
test_sharing-add-noop[2.58.2] 2.7715 (1.09) 2.7715 (1.09) 2.7715 (1.09) 0.0000 (1.0) 2.7715 (1.09) 0.0000 (1.0) 0;0 0.3608 (0.91) 1 1
test_sharing-add-noop[3.0.0] 2.7609 (1.09) 2.7609 (1.09) 2.7609 (1.09) 0.0000 (1.0) 2.7609 (1.09) 0.0000 (1.0) 0;0 0.3622 (0.92) 1 1
test_sharing-add-noop[main] 2.7836 (1.10) 2.7836 (1.10) 2.7836 (1.10) 0.0000 (1.0) 2.7836 (1.10) 0.0000 (1.0) 0;0 0.3592 (0.91) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 527.2006 (1.0) 527.2006 (1.0) 527.2006 (1.0) 0.0000 (1.0) 527.2006 (1.0) 0.0000 (1.0) 0;0 1.8968 (1.0) 1 1
test_sharing-checkout-noop[2.40.0] 620.4368 (1.18) 620.4368 (1.18) 620.4368 (1.18) 0.0000 (1.0) 620.4368 (1.18) 0.0000 (1.0) 0;0 1.6118 (0.85) 1 1
test_sharing-checkout-noop[2.58.2] 693.3285 (1.32) 693.3285 (1.32) 693.3285 (1.32) 0.0000 (1.0) 693.3285 (1.32) 0.0000 (1.0) 0;0 1.4423 (0.76) 1 1
test_sharing-checkout-noop[3.0.0] 715.9892 (1.36) 715.9892 (1.36) 715.9892 (1.36) 0.0000 (1.0) 715.9892 (1.36) 0.0000 (1.0) 0;0 1.3967 (0.74) 1 1
test_sharing-checkout-noop[main] 697.7894 (1.32) 697.7894 (1.32) 697.7894 (1.32) 0.0000 (1.0) 697.7894 (1.32) 0.0000 (1.0) 0;0 1.4331 (0.76) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-pull': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 7.3771 (1.31) 7.3771 (1.31) 7.3771 (1.31) 0.0000 (1.0) 7.3771 (1.31) 0.0000 (1.0) 0;0 0.1356 (0.76) 1 1
test_sharing-pull[2.40.0] 8.8119 (1.56) 8.8119 (1.56) 8.8119 (1.56) 0.0000 (1.0) 8.8119 (1.56) 0.0000 (1.0) 0;0 0.1135 (0.64) 1 1
test_sharing-pull[2.58.2] 5.6321 (1.0) 5.6321 (1.0) 5.6321 (1.0) 0.0000 (1.0) 5.6321 (1.0) 0.0000 (1.0) 0;0 0.1776 (1.0) 1 1
test_sharing-pull[3.0.0] 7.9723 (1.42) 7.9723 (1.42) 7.9723 (1.42) 0.0000 (1.0) 7.9723 (1.42) 0.0000 (1.0) 0;0 0.1254 (0.71) 1 1
test_sharing-pull[main] 7.9959 (1.42) 7.9959 (1.42) 7.9959 (1.42) 0.0000 (1.0) 7.9959 (1.42) 0.0000 (1.0) 0;0 0.1251 (0.70) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 563.9590 (1.0) 563.9590 (1.0) 563.9590 (1.0) 0.0000 (1.0) 563.9590 (1.0) 0.0000 (1.0) 0;0 1.7732 (1.0) 1 1
test_sharing-pull-noop[2.40.0] 659.0689 (1.17) 659.0689 (1.17) 659.0689 (1.17) 0.0000 (1.0) 659.0689 (1.17) 0.0000 (1.0) 0;0 1.5173 (0.86) 1 1
test_sharing-pull-noop[2.58.2] 741.4616 (1.31) 741.4616 (1.31) 741.4616 (1.31) 0.0000 (1.0) 741.4616 (1.31) 0.0000 (1.0) 0;0 1.3487 (0.76) 1 1
test_sharing-pull-noop[3.0.0] 857.1380 (1.52) 857.1380 (1.52) 857.1380 (1.52) 0.0000 (1.0) 857.1380 (1.52) 0.0000 (1.0) 0;0 1.1667 (0.66) 1 1
test_sharing-pull-noop[main] 853.4972 (1.51) 853.4972 (1.51) 853.4972 (1.51) 0.0000 (1.0) 853.4972 (1.51) 0.0000 (1.0) 0;0 1.1716 (0.66) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 4.0499 (2.31) 4.0499 (2.31) 4.0499 (2.31) 0.0000 (1.0) 4.0499 (2.31) 0.0000 (1.0) 0;0 0.2469 (0.43) 1 1
test_sharing-push[2.40.0] 5.2693 (3.01) 5.2693 (3.01) 5.2693 (3.01) 0.0000 (1.0) 5.2693 (3.01) 0.0000 (1.0) 0;0 0.1898 (0.33) 1 1
test_sharing-push[2.58.2] 3.5855 (2.05) 3.5855 (2.05) 3.5855 (2.05) 0.0000 (1.0) 3.5855 (2.05) 0.0000 (1.0) 0;0 0.2789 (0.49) 1 1
test_sharing-push[3.0.0] 1.7532 (1.0) 1.7532 (1.0) 1.7532 (1.0) 0.0000 (1.0) 1.7532 (1.0) 0.0000 (1.0) 0;0 0.5704 (1.0) 1 1
test_sharing-push[main] 3.5772 (2.04) 3.5772 (2.04) 3.5772 (2.04) 0.0000 (1.0) 3.5772 (2.04) 0.0000 (1.0) 0;0 0.2795 (0.49) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 458.4751 (1.0) 458.4751 (1.0) 458.4751 (1.0) 0.0000 (1.0) 458.4751 (1.0) 0.0000 (1.0) 0;0 2.1811 (1.0) 1 1
test_sharing-push-noop[2.40.0] 515.9901 (1.13) 515.9901 (1.13) 515.9901 (1.13) 0.0000 (1.0) 515.9901 (1.13) 0.0000 (1.0) 0;0 1.9380 (0.89) 1 1
test_sharing-push-noop[2.58.2] 574.4460 (1.25) 574.4460 (1.25) 574.4460 (1.25) 0.0000 (1.0) 574.4460 (1.25) 0.0000 (1.0) 0;0 1.7408 (0.80) 1 1
test_sharing-push-noop[3.0.0] 557.5766 (1.22) 557.5766 (1.22) 557.5766 (1.22) 0.0000 (1.0) 557.5766 (1.22) 0.0000 (1.0) 0;0 1.7935 (0.82) 1 1
test_sharing-push-noop[main] 558.6390 (1.22) 558.6390 (1.22) 558.6390 (1.22) 0.0000 (1.0) 558.6390 (1.22) 0.0000 (1.0) 0;0 1.7901 (0.82) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 2.7619 (1.0) 2.7619 (1.0) 2.7619 (1.0) 0.0000 (1.0) 2.7619 (1.0) 0.0000 (1.0) 0;0 0.3621 (1.0) 1 1
test_get_url-get-url[2.40.0] 2.8385 (1.03) 2.8385 (1.03) 2.8385 (1.03) 0.0000 (1.0) 2.8385 (1.03) 0.0000 (1.0) 0;0 0.3523 (0.97) 1 1
test_get_url-get-url[2.58.2] 2.9785 (1.08) 2.9785 (1.08) 2.9785 (1.08) 0.0000 (1.0) 2.9785 (1.08) 0.0000 (1.0) 0;0 0.3357 (0.93) 1 1
test_get_url-get-url[3.0.0] 3.0163 (1.09) 3.0163 (1.09) 3.0163 (1.09) 0.0000 (1.0) 3.0163 (1.09) 0.0000 (1.0) 0;0 0.3315 (0.92) 1 1
test_get_url-get-url[main] 3.0861 (1.12) 3.0861 (1.12) 3.0861 (1.12) 0.0000 (1.0) 3.0861 (1.12) 0.0000 (1.0) 0;0 0.3240 (0.89) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0] 10.7372 (1.80) 10.7372 (1.80) 10.7372 (1.80) 0.0000 (1.0) 10.7372 (1.80) 0.0000 (1.0) 0;0 0.0931 (0.56) 1 1
test_sharing_s3-add[2.11.0] 10.9620 (1.84) 10.9620 (1.84) 10.9620 (1.84) 0.0000 (1.0) 10.9620 (1.84) 0.0000 (1.0) 0;0 0.0912 (0.54) 1 1
test_sharing_s3-add[2.40.0] 9.0653 (1.52) 9.0653 (1.52) 9.0653 (1.52) 0.0000 (1.0) 9.0653 (1.52) 0.0000 (1.0) 0;0 0.1103 (0.66) 1 1
test_sharing_s3-add[2.40.0] 9.4116 (1.58) 9.4116 (1.58) 9.4116 (1.58) 0.0000 (1.0) 9.4116 (1.58) 0.0000 (1.0) 0;0 0.1063 (0.63) 1 1
test_sharing_s3-add[2.58.2] 5.9651 (1.0) 5.9651 (1.0) 5.9651 (1.0) 0.0000 (1.0) 5.9651 (1.0) 0.0000 (1.0) 0;0 0.1676 (1.0) 1 1
test_sharing_s3-add[2.58.2] 5.9790 (1.00) 5.9790 (1.00) 5.9790 (1.00) 0.0000 (1.0) 5.9790 (1.00) 0.0000 (1.0) 0;0 0.1673 (1.00) 1 1
test_sharing_s3-add[3.0.0] 6.0970 (1.02) 6.0970 (1.02) 6.0970 (1.02) 0.0000 (1.0) 6.0970 (1.02) 0.0000 (1.0) 0;0 0.1640 (0.98) 1 1
test_sharing_s3-add[3.0.0] 6.1355 (1.03) 6.1355 (1.03) 6.1355 (1.03) 0.0000 (1.0) 6.1355 (1.03) 0.0000 (1.0) 0;0 0.1630 (0.97) 1 1
test_sharing_s3-add[main] 6.2283 (1.04) 6.2283 (1.04) 6.2283 (1.04) 0.0000 (1.0) 6.2283 (1.04) 0.0000 (1.0) 0;0 0.1606 (0.96) 1 1
test_sharing_s3-add[main] 6.0116 (1.01) 6.0116 (1.01) 6.0116 (1.01) 0.0000 (1.0) 6.0116 (1.01) 0.0000 (1.0) 0;0 0.1663 (0.99) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0] 5.0436 (1.36) 5.0436 (1.36) 5.0436 (1.36) 0.0000 (1.0) 5.0436 (1.36) 0.0000 (1.0) 0;0 0.1983 (0.74) 1 1
test_sharing_s3-add-noop[2.11.0] 5.2829 (1.42) 5.2829 (1.42) 5.2829 (1.42) 0.0000 (1.0) 5.2829 (1.42) 0.0000 (1.0) 0;0 0.1893 (0.70) 1 1
test_sharing_s3-add-noop[2.40.0] 3.7148 (1.0) 3.7148 (1.0) 3.7148 (1.0) 0.0000 (1.0) 3.7148 (1.0) 0.0000 (1.0) 0;0 0.2692 (1.0) 1 1
test_sharing_s3-add-noop[2.40.0] 3.7160 (1.00) 3.7160 (1.00) 3.7160 (1.00) 0.0000 (1.0) 3.7160 (1.00) 0.0000 (1.0) 0;0 0.2691 (1.00) 1 1
test_sharing_s3-add-noop[2.58.2] 3.9760 (1.07) 3.9760 (1.07) 3.9760 (1.07) 0.0000 (1.0) 3.9760 (1.07) 0.0000 (1.0) 0;0 0.2515 (0.93) 1 1
test_sharing_s3-add-noop[2.58.2] 3.9268 (1.06) 3.9268 (1.06) 3.9268 (1.06) 0.0000 (1.0) 3.9268 (1.06) 0.0000 (1.0) 0;0 0.2547 (0.95) 1 1
test_sharing_s3-add-noop[3.0.0] 4.0727 (1.10) 4.0727 (1.10) 4.0727 (1.10) 0.0000 (1.0) 4.0727 (1.10) 0.0000 (1.0) 0;0 0.2455 (0.91) 1 1
test_sharing_s3-add-noop[3.0.0] 4.0356 (1.09) 4.0356 (1.09) 4.0356 (1.09) 0.0000 (1.0) 4.0356 (1.09) 0.0000 (1.0) 0;0 0.2478 (0.92) 1 1
test_sharing_s3-add-noop[main] 4.1316 (1.11) 4.1316 (1.11) 4.1316 (1.11) 0.0000 (1.0) 4.1316 (1.11) 0.0000 (1.0) 0;0 0.2420 (0.90) 1 1
test_sharing_s3-add-noop[main] 4.0311 (1.09) 4.0311 (1.09) 4.0311 (1.09) 0.0000 (1.0) 4.0311 (1.09) 0.0000 (1.0) 0;0 0.2481 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0] 687.3047 (1.0) 687.3047 (1.0) 687.3047 (1.0) 0.0000 (1.0) 687.3047 (1.0) 0.0000 (1.0) 0;0 1.4550 (1.0) 1 1
test_sharing_s3-checkout-noop[2.11.0] 699.2475 (1.02) 699.2475 (1.02) 699.2475 (1.02) 0.0000 (1.0) 699.2475 (1.02) 0.0000 (1.0) 0;0 1.4301 (0.98) 1 1
test_sharing_s3-checkout-noop[2.40.0] 883.6048 (1.29) 883.6048 (1.29) 883.6048 (1.29) 0.0000 (1.0) 883.6048 (1.29) 0.0000 (1.0) 0;0 1.1317 (0.78) 1 1
test_sharing_s3-checkout-noop[2.40.0] 872.7672 (1.27) 872.7672 (1.27) 872.7672 (1.27) 0.0000 (1.0) 872.7672 (1.27) 0.0000 (1.0) 0;0 1.1458 (0.79) 1 1
test_sharing_s3-checkout-noop[2.58.2] 1,035.3871 (1.51) 1,035.3871 (1.51) 1,035.3871 (1.51) 0.0000 (1.0) 1,035.3871 (1.51) 0.0000 (1.0) 0;0 0.9658 (0.66) 1 1
test_sharing_s3-checkout-noop[2.58.2] 990.6173 (1.44) 990.6173 (1.44) 990.6173 (1.44) 0.0000 (1.0) 990.6173 (1.44) 0.0000 (1.0) 0;0 1.0095 (0.69) 1 1
test_sharing_s3-checkout-noop[3.0.0] 1,304.2211 (1.90) 1,304.2211 (1.90) 1,304.2211 (1.90) 0.0000 (1.0) 1,304.2211 (1.90) 0.0000 (1.0) 0;0 0.7667 (0.53) 1 1
test_sharing_s3-checkout-noop[3.0.0] 1,225.6365 (1.78) 1,225.6365 (1.78) 1,225.6365 (1.78) 0.0000 (1.0) 1,225.6365 (1.78) 0.0000 (1.0) 0;0 0.8159 (0.56) 1 1
test_sharing_s3-checkout-noop[main] 1,009.3333 (1.47) 1,009.3333 (1.47) 1,009.3333 (1.47) 0.0000 (1.0) 1,009.3333 (1.47) 0.0000 (1.0) 0;0 0.9908 (0.68) 1 1
test_sharing_s3-checkout-noop[main] 1,033.7406 (1.50) 1,033.7406 (1.50) 1,033.7406 (1.50) 0.0000 (1.0) 1,033.7406 (1.50) 0.0000 (1.0) 0;0 0.9674 (0.66) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0] 20.1276 (1.30) 20.1276 (1.30) 20.1276 (1.30) 0.0000 (1.0) 20.1276 (1.30) 0.0000 (1.0) 0;0 0.0497 (0.77) 1 1
test_sharing_s3-pull[2.11.0] 20.1287 (1.30) 20.1287 (1.30) 20.1287 (1.30) 0.0000 (1.0) 20.1287 (1.30) 0.0000 (1.0) 0;0 0.0497 (0.77) 1 1
test_sharing_s3-pull[2.40.0] 22.6670 (1.47) 22.6670 (1.47) 22.6670 (1.47) 0.0000 (1.0) 22.6670 (1.47) 0.0000 (1.0) 0;0 0.0441 (0.68) 1 1
test_sharing_s3-pull[2.40.0] 22.4238 (1.45) 22.4238 (1.45) 22.4238 (1.45) 0.0000 (1.0) 22.4238 (1.45) 0.0000 (1.0) 0;0 0.0446 (0.69) 1 1
test_sharing_s3-pull[2.58.2] 15.7483 (1.02) 15.7483 (1.02) 15.7483 (1.02) 0.0000 (1.0) 15.7483 (1.02) 0.0000 (1.0) 0;0 0.0635 (0.98) 1 1
test_sharing_s3-pull[2.58.2] 15.4492 (1.0) 15.4492 (1.0) 15.4492 (1.0) 0.0000 (1.0) 15.4492 (1.0) 0.0000 (1.0) 0;0 0.0647 (1.0) 1 1
test_sharing_s3-pull[3.0.0] 19.0751 (1.23) 19.0751 (1.23) 19.0751 (1.23) 0.0000 (1.0) 19.0751 (1.23) 0.0000 (1.0) 0;0 0.0524 (0.81) 1 1
test_sharing_s3-pull[3.0.0] 18.8739 (1.22) 18.8739 (1.22) 18.8739 (1.22) 0.0000 (1.0) 18.8739 (1.22) 0.0000 (1.0) 0;0 0.0530 (0.82) 1 1
test_sharing_s3-pull[main] 18.4879 (1.20) 18.4879 (1.20) 18.4879 (1.20) 0.0000 (1.0) 18.4879 (1.20) 0.0000 (1.0) 0;0 0.0541 (0.84) 1 1
test_sharing_s3-pull[main] 18.3718 (1.19) 18.3718 (1.19) 18.3718 (1.19) 0.0000 (1.0) 18.3718 (1.19) 0.0000 (1.0) 0;0 0.0544 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0] 986.7390 (1.0) 986.7390 (1.0) 986.7390 (1.0) 0.0000 (1.0) 986.7390 (1.0) 0.0000 (1.0) 0;0 1.0134 (1.0) 1 1
test_sharing_s3-pull-noop[2.11.0] 1,033.5435 (1.05) 1,033.5435 (1.05) 1,033.5435 (1.05) 0.0000 (1.0) 1,033.5435 (1.05) 0.0000 (1.0) 0;0 0.9675 (0.95) 1 1
test_sharing_s3-pull-noop[2.40.0] 1,234.8728 (1.25) 1,234.8728 (1.25) 1,234.8728 (1.25) 0.0000 (1.0) 1,234.8728 (1.25) 0.0000 (1.0) 0;0 0.8098 (0.80) 1 1
test_sharing_s3-pull-noop[2.40.0] 1,159.7299 (1.18) 1,159.7299 (1.18) 1,159.7299 (1.18) 0.0000 (1.0) 1,159.7299 (1.18) 0.0000 (1.0) 0;0 0.8623 (0.85) 1 1
test_sharing_s3-pull-noop[2.58.2] 1,316.6119 (1.33) 1,316.6119 (1.33) 1,316.6119 (1.33) 0.0000 (1.0) 1,316.6119 (1.33) 0.0000 (1.0) 0;0 0.7595 (0.75) 1 1
test_sharing_s3-pull-noop[2.58.2] 1,270.8720 (1.29) 1,270.8720 (1.29) 1,270.8720 (1.29) 0.0000 (1.0) 1,270.8720 (1.29) 0.0000 (1.0) 0;0 0.7869 (0.78) 1 1
test_sharing_s3-pull-noop[3.0.0] 1,527.2126 (1.55) 1,527.2126 (1.55) 1,527.2126 (1.55) 0.0000 (1.0) 1,527.2126 (1.55) 0.0000 (1.0) 0;0 0.6548 (0.65) 1 1
test_sharing_s3-pull-noop[3.0.0] 1,447.0044 (1.47) 1,447.0044 (1.47) 1,447.0044 (1.47) 0.0000 (1.0) 1,447.0044 (1.47) 0.0000 (1.0) 0;0 0.6911 (0.68) 1 1
test_sharing_s3-pull-noop[main] 1,954.8409 (1.98) 1,954.8409 (1.98) 1,954.8409 (1.98) 0.0000 (1.0) 1,954.8409 (1.98) 0.0000 (1.0) 0;0 0.5116 (0.50) 1 1
test_sharing_s3-pull-noop[main] 1,941.8012 (1.97) 1,941.8012 (1.97) 1,941.8012 (1.97) 0.0000 (1.0) 1,941.8012 (1.97) 0.0000 (1.0) 0;0 0.5150 (0.51) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0] 31.3993 (2.70) 31.3993 (2.70) 31.3993 (2.70) 0.0000 (1.0) 31.3993 (2.70) 0.0000 (1.0) 0;0 0.0318 (0.37) 1 1
test_sharing_s3-push[2.11.0] 31.9990 (2.75) 31.9990 (2.75) 31.9990 (2.75) 0.0000 (1.0) 31.9990 (2.75) 0.0000 (1.0) 0;0 0.0313 (0.36) 1 1
test_sharing_s3-push[2.40.0] 33.5064 (2.88) 33.5064 (2.88) 33.5064 (2.88) 0.0000 (1.0) 33.5064 (2.88) 0.0000 (1.0) 0;0 0.0298 (0.35) 1 1
test_sharing_s3-push[2.40.0] 33.8079 (2.91) 33.8079 (2.91) 33.8079 (2.91) 0.0000 (1.0) 33.8079 (2.91) 0.0000 (1.0) 0;0 0.0296 (0.34) 1 1
test_sharing_s3-push[2.58.2] 13.4464 (1.16) 13.4464 (1.16) 13.4464 (1.16) 0.0000 (1.0) 13.4464 (1.16) 0.0000 (1.0) 0;0 0.0744 (0.86) 1 1
test_sharing_s3-push[2.58.2] 13.3832 (1.15) 13.3832 (1.15) 13.3832 (1.15) 0.0000 (1.0) 13.3832 (1.15) 0.0000 (1.0) 0;0 0.0747 (0.87) 1 1
test_sharing_s3-push[3.0.0] 11.7188 (1.01) 11.7188 (1.01) 11.7188 (1.01) 0.0000 (1.0) 11.7188 (1.01) 0.0000 (1.0) 0;0 0.0853 (0.99) 1 1
test_sharing_s3-push[3.0.0] 11.6296 (1.0) 11.6296 (1.0) 11.6296 (1.0) 0.0000 (1.0) 11.6296 (1.0) 0.0000 (1.0) 0;0 0.0860 (1.0) 1 1
test_sharing_s3-push[main] 13.6874 (1.18) 13.6874 (1.18) 13.6874 (1.18) 0.0000 (1.0) 13.6874 (1.18) 0.0000 (1.0) 0;0 0.0731 (0.85) 1 1
test_sharing_s3-push[main] 13.8212 (1.19) 13.8212 (1.19) 13.8212 (1.19) 0.0000 (1.0) 13.8212 (1.19) 0.0000 (1.0) 0;0 0.0724 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0] 1.3616 (1.00) 1.3616 (1.00) 1.3616 (1.00) 0.0000 (1.0) 1.3616 (1.00) 0.0000 (1.0) 0;0 0.7344 (1.00) 1 1
test_sharing_s3-push-noop[2.11.0] 1.3674 (1.01) 1.3674 (1.01) 1.3674 (1.01) 0.0000 (1.0) 1.3674 (1.01) 0.0000 (1.0) 0;0 0.7313 (0.99) 1 1
test_sharing_s3-push-noop[2.40.0] 1.3871 (1.02) 1.3871 (1.02) 1.3871 (1.02) 0.0000 (1.0) 1.3871 (1.02) 0.0000 (1.0) 0;0 0.7209 (0.98) 1 1
test_sharing_s3-push-noop[2.40.0] 1.3559 (1.0) 1.3559 (1.0) 1.3559 (1.0) 0.0000 (1.0) 1.3559 (1.0) 0.0000 (1.0) 0;0 0.7375 (1.0) 1 1
test_sharing_s3-push-noop[2.58.2] 1.4528 (1.07) 1.4528 (1.07) 1.4528 (1.07) 0.0000 (1.0) 1.4528 (1.07) 0.0000 (1.0) 0;0 0.6883 (0.93) 1 1
test_sharing_s3-push-noop[2.58.2] 1.4352 (1.06) 1.4352 (1.06) 1.4352 (1.06) 0.0000 (1.0) 1.4352 (1.06) 0.0000 (1.0) 0;0 0.6968 (0.94) 1 1
test_sharing_s3-push-noop[3.0.0] 1.4963 (1.10) 1.4963 (1.10) 1.4963 (1.10) 0.0000 (1.0) 1.4963 (1.10) 0.0000 (1.0) 0;0 0.6683 (0.91) 1 1
test_sharing_s3-push-noop[3.0.0] 1.4692 (1.08) 1.4692 (1.08) 1.4692 (1.08) 0.0000 (1.0) 1.4692 (1.08) 0.0000 (1.0) 0;0 0.6806 (0.92) 1 1
test_sharing_s3-push-noop[main] 1.4866 (1.10) 1.4866 (1.10) 1.4866 (1.10) 0.0000 (1.0) 1.4866 (1.10) 0.0000 (1.0) 0;0 0.6727 (0.91) 1 1
test_sharing_s3-push-noop[main] 1.4635 (1.08) 1.4635 (1.08) 1.4635 (1.08) 0.0000 (1.0) 1.4635 (1.08) 0.0000 (1.0) 0;0 0.6833 (0.93) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.11.0] 7.6290 (1.85) 7.6290 (1.85) 7.6290 (1.85) 0.0000 (1.0) 7.6290 (1.85) 0.0000 (1.0) 0;0 0.1311 (0.54) 1 1
test_sharing_azure-add[2.11.0] 8.7438 (2.12) 8.7438 (2.12) 8.7438 (2.12) 0.0000 (1.0) 8.7438 (2.12) 0.0000 (1.0) 0;0 0.1144 (0.47) 1 1
test_sharing_azure-add[2.40.0] 5.9854 (1.45) 5.9854 (1.45) 5.9854 (1.45) 0.0000 (1.0) 5.9854 (1.45) 0.0000 (1.0) 0;0 0.1671 (0.69) 1 1
test_sharing_azure-add[2.40.0] 6.1184 (1.48) 6.1184 (1.48) 6.1184 (1.48) 0.0000 (1.0) 6.1184 (1.48) 0.0000 (1.0) 0;0 0.1634 (0.67) 1 1
test_sharing_azure-add[2.58.2] 4.1665 (1.01) 4.1665 (1.01) 4.1665 (1.01) 0.0000 (1.0) 4.1665 (1.01) 0.0000 (1.0) 0;0 0.2400 (0.99) 1 1
test_sharing_azure-add[2.58.2] 4.1700 (1.01) 4.1700 (1.01) 4.1700 (1.01) 0.0000 (1.0) 4.1700 (1.01) 0.0000 (1.0) 0;0 0.2398 (0.99) 1 1
test_sharing_azure-add[3.0.0] 4.1395 (1.00) 4.1395 (1.00) 4.1395 (1.00) 0.0000 (1.0) 4.1395 (1.00) 0.0000 (1.0) 0;0 0.2416 (1.00) 1 1
test_sharing_azure-add[3.0.0] 4.1791 (1.01) 4.1791 (1.01) 4.1791 (1.01) 0.0000 (1.0) 4.1791 (1.01) 0.0000 (1.0) 0;0 0.2393 (0.99) 1 1
test_sharing_azure-add[main] 4.1266 (1.0) 4.1266 (1.0) 4.1266 (1.0) 0.0000 (1.0) 4.1266 (1.0) 0.0000 (1.0) 0;0 0.2423 (1.0) 1 1
test_sharing_azure-add[main] 4.2401 (1.03) 4.2401 (1.03) 4.2401 (1.03) 0.0000 (1.0) 4.2401 (1.03) 0.0000 (1.0) 0;0 0.2358 (0.97) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.11.0] 3.5916 (1.40) 3.5916 (1.40) 3.5916 (1.40) 0.0000 (1.0) 3.5916 (1.40) 0.0000 (1.0) 0;0 0.2784 (0.71) 1 1
test_sharing_azure-add-noop[2.11.0] 3.5573 (1.39) 3.5573 (1.39) 3.5573 (1.39) 0.0000 (1.0) 3.5573 (1.39) 0.0000 (1.0) 0;0 0.2811 (0.72) 1 1
test_sharing_azure-add-noop[2.40.0] 2.5635 (1.0) 2.5635 (1.0) 2.5635 (1.0) 0.0000 (1.0) 2.5635 (1.0) 0.0000 (1.0) 0;0 0.3901 (1.0) 1 1
test_sharing_azure-add-noop[2.40.0] 2.5722 (1.00) 2.5722 (1.00) 2.5722 (1.00) 0.0000 (1.0) 2.5722 (1.00) 0.0000 (1.0) 0;0 0.3888 (1.00) 1 1
test_sharing_azure-add-noop[2.58.2] 2.7890 (1.09) 2.7890 (1.09) 2.7890 (1.09) 0.0000 (1.0) 2.7890 (1.09) 0.0000 (1.0) 0;0 0.3585 (0.92) 1 1
test_sharing_azure-add-noop[2.58.2] 2.8144 (1.10) 2.8144 (1.10) 2.8144 (1.10) 0.0000 (1.0) 2.8144 (1.10) 0.0000 (1.0) 0;0 0.3553 (0.91) 1 1
test_sharing_azure-add-noop[3.0.0] 2.7662 (1.08) 2.7662 (1.08) 2.7662 (1.08) 0.0000 (1.0) 2.7662 (1.08) 0.0000 (1.0) 0;0 0.3615 (0.93) 1 1
test_sharing_azure-add-noop[3.0.0] 2.7681 (1.08) 2.7681 (1.08) 2.7681 (1.08) 0.0000 (1.0) 2.7681 (1.08) 0.0000 (1.0) 0;0 0.3613 (0.93) 1 1
test_sharing_azure-add-noop[main] 2.7489 (1.07) 2.7489 (1.07) 2.7489 (1.07) 0.0000 (1.0) 2.7489 (1.07) 0.0000 (1.0) 0;0 0.3638 (0.93) 1 1
test_sharing_azure-add-noop[main] 2.7862 (1.09) 2.7862 (1.09) 2.7862 (1.09) 0.0000 (1.0) 2.7862 (1.09) 0.0000 (1.0) 0;0 0.3589 (0.92) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.11.0] 523.9311 (1.01) 523.9311 (1.01) 523.9311 (1.01) 0.0000 (1.0) 523.9311 (1.01) 0.0000 (1.0) 0;0 1.9086 (0.99) 1 1
test_sharing_azure-checkout-noop[2.11.0] 516.2638 (1.0) 516.2638 (1.0) 516.2638 (1.0) 0.0000 (1.0) 516.2638 (1.0) 0.0000 (1.0) 0;0 1.9370 (1.0) 1 1
test_sharing_azure-checkout-noop[2.40.0] 597.1278 (1.16) 597.1278 (1.16) 597.1278 (1.16) 0.0000 (1.0) 597.1278 (1.16) 0.0000 (1.0) 0;0 1.6747 (0.86) 1 1
test_sharing_azure-checkout-noop[2.40.0] 624.7644 (1.21) 624.7644 (1.21) 624.7644 (1.21) 0.0000 (1.0) 624.7644 (1.21) 0.0000 (1.0) 0;0 1.6006 (0.83) 1 1
test_sharing_azure-checkout-noop[2.58.2] 680.7942 (1.32) 680.7942 (1.32) 680.7942 (1.32) 0.0000 (1.0) 680.7942 (1.32) 0.0000 (1.0) 0;0 1.4689 (0.76) 1 1
test_sharing_azure-checkout-noop[2.58.2] 674.8666 (1.31) 674.8666 (1.31) 674.8666 (1.31) 0.0000 (1.0) 674.8666 (1.31) 0.0000 (1.0) 0;0 1.4818 (0.76) 1 1
test_sharing_azure-checkout-noop[3.0.0] 687.3727 (1.33) 687.3727 (1.33) 687.3727 (1.33) 0.0000 (1.0) 687.3727 (1.33) 0.0000 (1.0) 0;0 1.4548 (0.75) 1 1
test_sharing_azure-checkout-noop[3.0.0] 703.5369 (1.36) 703.5369 (1.36) 703.5369 (1.36) 0.0000 (1.0) 703.5369 (1.36) 0.0000 (1.0) 0;0 1.4214 (0.73) 1 1
test_sharing_azure-checkout-noop[main] 704.0545 (1.36) 704.0545 (1.36) 704.0545 (1.36) 0.0000 (1.0) 704.0545 (1.36) 0.0000 (1.0) 0;0 1.4203 (0.73) 1 1
test_sharing_azure-checkout-noop[main] 723.5796 (1.40) 723.5796 (1.40) 723.5796 (1.40) 0.0000 (1.0) 723.5796 (1.40) 0.0000 (1.0) 0;0 1.3820 (0.71) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull[2.11.0] 7.4667 (1.34) 7.4667 (1.34) 7.4667 (1.34) 0.0000 (1.0) 7.4667 (1.34) 0.0000 (1.0) 0;0 0.1339 (0.75) 1 1
test_sharing_azure-pull[2.11.0] 7.5672 (1.36) 7.5672 (1.36) 7.5672 (1.36) 0.0000 (1.0) 7.5672 (1.36) 0.0000 (1.0) 0;0 0.1321 (0.74) 1 1
test_sharing_azure-pull[2.40.0] 8.7206 (1.56) 8.7206 (1.56) 8.7206 (1.56) 0.0000 (1.0) 8.7206 (1.56) 0.0000 (1.0) 0;0 0.1147 (0.64) 1 1
test_sharing_azure-pull[2.40.0] 9.0489 (1.62) 9.0489 (1.62) 9.0489 (1.62) 0.0000 (1.0) 9.0489 (1.62) 0.0000 (1.0) 0;0 0.1105 (0.62) 1 1
test_sharing_azure-pull[2.58.2] 5.6564 (1.01) 5.6564 (1.01) 5.6564 (1.01) 0.0000 (1.0) 5.6564 (1.01) 0.0000 (1.0) 0;0 0.1768 (0.99) 1 1
test_sharing_azure-pull[2.58.2] 5.5786 (1.0) 5.5786 (1.0) 5.5786 (1.0) 0.0000 (1.0) 5.5786 (1.0) 0.0000 (1.0) 0;0 0.1793 (1.0) 1 1
test_sharing_azure-pull[3.0.0] 7.9649 (1.43) 7.9649 (1.43) 7.9649 (1.43) 0.0000 (1.0) 7.9649 (1.43) 0.0000 (1.0) 0;0 0.1256 (0.70) 1 1
test_sharing_azure-pull[3.0.0] 7.8274 (1.40) 7.8274 (1.40) 7.8274 (1.40) 0.0000 (1.0) 7.8274 (1.40) 0.0000 (1.0) 0;0 0.1278 (0.71) 1 1
test_sharing_azure-pull[main] 7.7698 (1.39) 7.7698 (1.39) 7.7698 (1.39) 0.0000 (1.0) 7.7698 (1.39) 0.0000 (1.0) 0;0 0.1287 (0.72) 1 1
test_sharing_azure-pull[main] 7.9624 (1.43) 7.9624 (1.43) 7.9624 (1.43) 0.0000 (1.0) 7.9624 (1.43) 0.0000 (1.0) 0;0 0.1256 (0.70) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests -------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull-noop[2.11.0] 554.2492 (1.0) 554.2492 (1.0) 554.2492 (1.0) 0.0000 (1.0) 554.2492 (1.0) 0.0000 (1.0) 0;0 1.8042 (1.0) 1 1
test_sharing_azure-pull-noop[2.11.0] 1,016.6599 (1.83) 1,016.6599 (1.83) 1,016.6599 (1.83) 0.0000 (1.0) 1,016.6599 (1.83) 0.0000 (1.0) 0;0 0.9836 (0.55) 1 1
test_sharing_azure-pull-noop[2.40.0] 640.4649 (1.16) 640.4649 (1.16) 640.4649 (1.16) 0.0000 (1.0) 640.4649 (1.16) 0.0000 (1.0) 0;0 1.5614 (0.87) 1 1
test_sharing_azure-pull-noop[2.40.0] 658.2879 (1.19) 658.2879 (1.19) 658.2879 (1.19) 0.0000 (1.0) 658.2879 (1.19) 0.0000 (1.0) 0;0 1.5191 (0.84) 1 1
test_sharing_azure-pull-noop[2.58.2] 748.6239 (1.35) 748.6239 (1.35) 748.6239 (1.35) 0.0000 (1.0) 748.6239 (1.35) 0.0000 (1.0) 0;0 1.3358 (0.74) 1 1
test_sharing_azure-pull-noop[2.58.2] 730.0792 (1.32) 730.0792 (1.32) 730.0792 (1.32) 0.0000 (1.0) 730.0792 (1.32) 0.0000 (1.0) 0;0 1.3697 (0.76) 1 1
test_sharing_azure-pull-noop[3.0.0] 845.0263 (1.52) 845.0263 (1.52) 845.0263 (1.52) 0.0000 (1.0) 845.0263 (1.52) 0.0000 (1.0) 0;0 1.1834 (0.66) 1 1
test_sharing_azure-pull-noop[3.0.0] 833.2171 (1.50) 833.2171 (1.50) 833.2171 (1.50) 0.0000 (1.0) 833.2171 (1.50) 0.0000 (1.0) 0;0 1.2002 (0.67) 1 1
test_sharing_azure-pull-noop[main] 841.2635 (1.52) 841.2635 (1.52) 841.2635 (1.52) 0.0000 (1.0) 841.2635 (1.52) 0.0000 (1.0) 0;0 1.1887 (0.66) 1 1
test_sharing_azure-pull-noop[main] 879.5805 (1.59) 879.5805 (1.59) 879.5805 (1.59) 0.0000 (1.0) 879.5805 (1.59) 0.0000 (1.0) 0;0 1.1369 (0.63) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.11.0] 4.0501 (2.30) 4.0501 (2.30) 4.0501 (2.30) 0.0000 (1.0) 4.0501 (2.30) 0.0000 (1.0) 0;0 0.2469 (0.43) 1 1
test_sharing_azure-push[2.11.0] 4.0318 (2.29) 4.0318 (2.29) 4.0318 (2.29) 0.0000 (1.0) 4.0318 (2.29) 0.0000 (1.0) 0;0 0.2480 (0.44) 1 1
test_sharing_azure-push[2.40.0] 5.1356 (2.92) 5.1356 (2.92) 5.1356 (2.92) 0.0000 (1.0) 5.1356 (2.92) 0.0000 (1.0) 0;0 0.1947 (0.34) 1 1
test_sharing_azure-push[2.40.0] 5.1663 (2.94) 5.1663 (2.94) 5.1663 (2.94) 0.0000 (1.0) 5.1663 (2.94) 0.0000 (1.0) 0;0 0.1936 (0.34) 1 1
test_sharing_azure-push[2.58.2] 3.5382 (2.01) 3.5382 (2.01) 3.5382 (2.01) 0.0000 (1.0) 3.5382 (2.01) 0.0000 (1.0) 0;0 0.2826 (0.50) 1 1
test_sharing_azure-push[2.58.2] 3.6876 (2.10) 3.6876 (2.10) 3.6876 (2.10) 0.0000 (1.0) 3.6876 (2.10) 0.0000 (1.0) 0;0 0.2712 (0.48) 1 1
test_sharing_azure-push[3.0.0] 1.7583 (1.0) 1.7583 (1.0) 1.7583 (1.0) 0.0000 (1.0) 1.7583 (1.0) 0.0000 (1.0) 0;0 0.5687 (1.0) 1 1
test_sharing_azure-push[3.0.0] 2.0231 (1.15) 2.0231 (1.15) 2.0231 (1.15) 0.0000 (1.0) 2.0231 (1.15) 0.0000 (1.0) 0;0 0.4943 (0.87) 1 1
test_sharing_azure-push[main] 3.5234 (2.00) 3.5234 (2.00) 3.5234 (2.00) 0.0000 (1.0) 3.5234 (2.00) 0.0000 (1.0) 0;0 0.2838 (0.50) 1 1
test_sharing_azure-push[main] 3.7101 (2.11) 3.7101 (2.11) 3.7101 (2.11) 0.0000 (1.0) 3.7101 (2.11) 0.0000 (1.0) 0;0 0.2695 (0.47) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.11.0] 464.4641 (1.04) 464.4641 (1.04) 464.4641 (1.04) 0.0000 (1.0) 464.4641 (1.04) 0.0000 (1.0) 0;0 2.1530 (0.96) 1 1
test_sharing_azure-push-noop[2.11.0] 447.5645 (1.0) 447.5645 (1.0) 447.5645 (1.0) 0.0000 (1.0) 447.5645 (1.0) 0.0000 (1.0) 0;0 2.2343 (1.0) 1 1
test_sharing_azure-push-noop[2.40.0] 485.6857 (1.09) 485.6857 (1.09) 485.6857 (1.09) 0.0000 (1.0) 485.6857 (1.09) 0.0000 (1.0) 0;0 2.0589 (0.92) 1 1
test_sharing_azure-push-noop[2.40.0] 502.0298 (1.12) 502.0298 (1.12) 502.0298 (1.12) 0.0000 (1.0) 502.0298 (1.12) 0.0000 (1.0) 0;0 1.9919 (0.89) 1 1
test_sharing_azure-push-noop[2.58.2] 556.9125 (1.24) 556.9125 (1.24) 556.9125 (1.24) 0.0000 (1.0) 556.9125 (1.24) 0.0000 (1.0) 0;0 1.7956 (0.80) 1 1
test_sharing_azure-push-noop[2.58.2] 578.7598 (1.29) 578.7598 (1.29) 578.7598 (1.29) 0.0000 (1.0) 578.7598 (1.29) 0.0000 (1.0) 0;0 1.7278 (0.77) 1 1
test_sharing_azure-push-noop[3.0.0] 541.9002 (1.21) 541.9002 (1.21) 541.9002 (1.21) 0.0000 (1.0) 541.9002 (1.21) 0.0000 (1.0) 0;0 1.8454 (0.83) 1 1
test_sharing_azure-push-noop[3.0.0] 773.9379 (1.73) 773.9379 (1.73) 773.9379 (1.73) 0.0000 (1.0) 773.9379 (1.73) 0.0000 (1.0) 0;0 1.2921 (0.58) 1 1
test_sharing_azure-push-noop[main] 534.1262 (1.19) 534.1262 (1.19) 534.1262 (1.19) 0.0000 (1.0) 534.1262 (1.19) 0.0000 (1.0) 0;0 1.8722 (0.84) 1 1
test_sharing_azure-push-noop[main] 558.7057 (1.25) 558.7057 (1.25) 558.7057 (1.25) 0.0000 (1.0) 558.7057 (1.25) 0.0000 (1.0) 0;0 1.7899 (0.80) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.2729 (1.08) 1.2729 (1.08) 1.2729 (1.08) 0.0000 (1.0) 1.2729 (1.08) 0.0000 (1.0) 0;0 0.7856 (0.93) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.2386 (1.05) 1.2386 (1.05) 1.2386 (1.05) 0.0000 (1.0) 1.2386 (1.05) 0.0000 (1.0) 0;0 0.8074 (0.95) 1 1
test_checkout_hardlink-checkout[2.58.2] 1.3697 (1.16) 1.3697 (1.16) 1.3697 (1.16) 0.0000 (1.0) 1.3697 (1.16) 0.0000 (1.0) 0;0 0.7301 (0.86) 1 1
test_checkout_hardlink-checkout[3.0.0] 1.1780 (1.0) 1.1780 (1.0) 1.1780 (1.0) 0.0000 (1.0) 1.1780 (1.0) 0.0000 (1.0) 0;0 0.8489 (1.0) 1 1
test_checkout_hardlink-checkout[main] 1.2163 (1.03) 1.2163 (1.03) 1.2163 (1.03) 0.0000 (1.0) 1.2163 (1.03) 0.0000 (1.0) 0;0 0.8222 (0.97) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 493.4167 (1.0) 493.4167 (1.0) 493.4167 (1.0) 0.0000 (1.0) 493.4167 (1.0) 0.0000 (1.0) 0;0 2.0267 (1.0) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 596.5681 (1.21) 596.5681 (1.21) 596.5681 (1.21) 0.0000 (1.0) 596.5681 (1.21) 0.0000 (1.0) 0;0 1.6763 (0.83) 1 1
test_checkout_hardlink-checkout-noop[2.58.2] 654.0693 (1.33) 654.0693 (1.33) 654.0693 (1.33) 0.0000 (1.0) 654.0693 (1.33) 0.0000 (1.0) 0;0 1.5289 (0.75) 1 1
test_checkout_hardlink-checkout-noop[3.0.0] 680.5378 (1.38) 680.5378 (1.38) 680.5378 (1.38) 0.0000 (1.0) 680.5378 (1.38) 0.0000 (1.0) 0;0 1.4694 (0.73) 1 1
test_checkout_hardlink-checkout-noop[main] 667.1007 (1.35) 667.1007 (1.35) 667.1007 (1.35) 0.0000 (1.0) 667.1007 (1.35) 0.0000 (1.0) 0;0 1.4990 (0.74) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.2878 (1.91) 1.2878 (1.91) 1.2878 (1.91) 0.0000 (1.0) 1.2878 (1.91) 0.0000 (1.0) 0;0 0.7765 (0.52) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.6755 (1.0) 0.6755 (1.0) 0.6755 (1.0) 0.0000 (1.0) 0.6755 (1.0) 0.0000 (1.0) 0;0 1.4804 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.58.2] 0.8383 (1.24) 0.8383 (1.24) 0.8383 (1.24) 0.0000 (1.0) 0.8383 (1.24) 0.0000 (1.0) 0;0 1.1929 (0.81) 1 1
test_checkout_hardlink-checkout-update[3.0.0] 0.9573 (1.42) 0.9573 (1.42) 0.9573 (1.42) 0.0000 (1.0) 0.9573 (1.42) 0.0000 (1.0) 0;0 1.0446 (0.71) 1 1
test_checkout_hardlink-checkout-update[main] 0.7381 (1.09) 0.7381 (1.09) 0.7381 (1.09) 0.0000 (1.0) 0.7381 (1.09) 0.0000 (1.0) 0;0 1.3548 (0.92) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 5.4141 (1.31) 5.4141 (1.31) 5.4141 (1.31) 0.0000 (1.0) 5.4141 (1.31) 0.0000 (1.0) 0;0 0.1847 (0.76) 1 1
test_get-get[2.40.0] 4.1275 (1.0) 4.1275 (1.0) 4.1275 (1.0) 0.0000 (1.0) 4.1275 (1.0) 0.0000 (1.0) 0;0 0.2423 (1.0) 1 1
test_get-get[2.58.2] 6.6993 (1.62) 6.6993 (1.62) 6.6993 (1.62) 0.0000 (1.0) 6.6993 (1.62) 0.0000 (1.0) 0;0 0.1493 (0.62) 1 1
test_get-get[3.0.0] 6.6744 (1.62) 6.6744 (1.62) 6.6744 (1.62) 0.0000 (1.0) 6.6744 (1.62) 0.0000 (1.0) 0;0 0.1498 (0.62) 1 1
test_get-get[main] 7.5614 (1.83) 7.5614 (1.83) 7.5614 (1.83) 0.0000 (1.0) 7.5614 (1.83) 0.0000 (1.0) 0;0 0.1323 (0.55) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 5.9441 (2.33) 5.9441 (2.33) 5.9441 (2.33) 0.0000 (1.0) 5.9441 (2.33) 0.0000 (1.0) 0;0 0.1682 (0.43) 1 1
test_push-push[2.40.0] 7.2977 (2.86) 7.2977 (2.86) 7.2977 (2.86) 0.0000 (1.0) 7.2977 (2.86) 0.0000 (1.0) 0;0 0.1370 (0.35) 1 1
test_push-push[2.58.2] 5.0416 (1.98) 5.0416 (1.98) 5.0416 (1.98) 0.0000 (1.0) 5.0416 (1.98) 0.0000 (1.0) 0;0 0.1984 (0.51) 1 1
test_push-push[3.0.0] 2.5510 (1.0) 2.5510 (1.0) 2.5510 (1.0) 0.0000 (1.0) 2.5510 (1.0) 0.0000 (1.0) 0;0 0.3920 (1.0) 1 1
test_push-push[main] 4.9667 (1.95) 4.9667 (1.95) 4.9667 (1.95) 0.0000 (1.0) 4.9667 (1.95) 0.0000 (1.0) 0;0 0.2013 (0.51) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 4.5926 (1.51) 4.5926 (1.51) 4.5926 (1.51) 0.0000 (1.0) 4.5926 (1.51) 0.0000 (1.0) 0;0 0.2177 (0.66) 1 1
test_checkout_copy-checkout[2.40.0] 4.6826 (1.54) 4.6826 (1.54) 4.6826 (1.54) 0.0000 (1.0) 4.6826 (1.54) 0.0000 (1.0) 0;0 0.2136 (0.65) 1 1
test_checkout_copy-checkout[2.58.2] 3.0479 (1.0) 3.0479 (1.0) 3.0479 (1.0) 0.0000 (1.0) 3.0479 (1.0) 0.0000 (1.0) 0;0 0.3281 (1.0) 1 1
test_checkout_copy-checkout[3.0.0] 5.8704 (1.93) 5.8704 (1.93) 5.8704 (1.93) 0.0000 (1.0) 5.8704 (1.93) 0.0000 (1.0) 0;0 0.1703 (0.52) 1 1
test_checkout_copy-checkout[main] 5.8163 (1.91) 5.8163 (1.91) 5.8163 (1.91) 0.0000 (1.0) 5.8163 (1.91) 0.0000 (1.0) 0;0 0.1719 (0.52) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 673.5810 (1.0) 673.5810 (1.0) 673.5810 (1.0) 0.0000 (1.0) 673.5810 (1.0) 0.0000 (1.0) 0;0 1.4846 (1.0) 1 1
test_checkout_copy-checkout-noop[2.40.0] 848.7663 (1.26) 848.7663 (1.26) 848.7663 (1.26) 0.0000 (1.0) 848.7663 (1.26) 0.0000 (1.0) 0;0 1.1782 (0.79) 1 1
test_checkout_copy-checkout-noop[2.58.2] 956.5066 (1.42) 956.5066 (1.42) 956.5066 (1.42) 0.0000 (1.0) 956.5066 (1.42) 0.0000 (1.0) 0;0 1.0455 (0.70) 1 1
test_checkout_copy-checkout-noop[3.0.0] 991.7875 (1.47) 991.7875 (1.47) 991.7875 (1.47) 0.0000 (1.0) 991.7875 (1.47) 0.0000 (1.0) 0;0 1.0083 (0.68) 1 1
test_checkout_copy-checkout-noop[main] 961.7241 (1.43) 961.7241 (1.43) 961.7241 (1.43) 0.0000 (1.0) 961.7241 (1.43) 0.0000 (1.0) 0;0 1.0398 (0.70) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.8454 (1.87) 1.8454 (1.87) 1.8454 (1.87) 0.0000 (1.0) 1.8454 (1.87) 0.0000 (1.0) 0;0 0.5419 (0.53) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.9870 (1.0) 0.9870 (1.0) 0.9870 (1.0) 0.0000 (1.0) 0.9870 (1.0) 0.0000 (1.0) 0;0 1.0132 (1.0) 1 1
test_checkout_copy-checkout-update[2.58.2] 1.2165 (1.23) 1.2165 (1.23) 1.2165 (1.23) 0.0000 (1.0) 1.2165 (1.23) 0.0000 (1.0) 0;0 0.8220 (0.81) 1 1
test_checkout_copy-checkout-update[3.0.0] 1.0889 (1.10) 1.0889 (1.10) 1.0889 (1.10) 0.0000 (1.0) 1.0889 (1.10) 0.0000 (1.0) 0;0 0.9184 (0.91) 1 1
test_checkout_copy-checkout-update[main] 1.0637 (1.08) 1.0637 (1.08) 1.0637 (1.08) 0.0000 (1.0) 1.0637 (1.08) 0.0000 (1.0) 0;0 0.9401 (0.93) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_pull-pull': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 9.2143 (1.22) 9.2143 (1.22) 9.2143 (1.22) 0.0000 (1.0) 9.2143 (1.22) 0.0000 (1.0) 0;0 0.1085 (0.82) 1 1
test_pull-pull[2.40.0] 10.6960 (1.42) 10.6960 (1.42) 10.6960 (1.42) 0.0000 (1.0) 10.6960 (1.42) 0.0000 (1.0) 0;0 0.0935 (0.71) 1 1
test_pull-pull[2.58.2] 7.5418 (1.0) 7.5418 (1.0) 7.5418 (1.0) 0.0000 (1.0) 7.5418 (1.0) 0.0000 (1.0) 0;0 0.1326 (1.0) 1 1
test_pull-pull[3.0.0] 10.1845 (1.35) 10.1845 (1.35) 10.1845 (1.35) 0.0000 (1.0) 10.1845 (1.35) 0.0000 (1.0) 0;0 0.0982 (0.74) 1 1
test_pull-pull[main] 9.8737 (1.31) 9.8737 (1.31) 9.8737 (1.31) 0.0000 (1.0) 9.8737 (1.31) 0.0000 (1.0) 0;0 0.1013 (0.76) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 14.6993 (1.38) 14.6993 (1.38) 14.6993 (1.38) 0.0000 (1.0) 14.6993 (1.38) 0.0000 (1.0) 0;0 0.0680 (0.72) 1 1
test_import_url-import-url[2.40.0] 13.1230 (1.23) 13.1230 (1.23) 13.1230 (1.23) 0.0000 (1.0) 13.1230 (1.23) 0.0000 (1.0) 0;0 0.0762 (0.81) 1 1
test_import_url-import-url[2.58.2] 10.6528 (1.0) 10.6528 (1.0) 10.6528 (1.0) 0.0000 (1.0) 10.6528 (1.0) 0.0000 (1.0) 0;0 0.0939 (1.0) 1 1
test_import_url-import-url[3.0.0] 10.7619 (1.01) 10.7619 (1.01) 10.7619 (1.01) 0.0000 (1.0) 10.7619 (1.01) 0.0000 (1.0) 0;0 0.0929 (0.99) 1 1
test_import_url-import-url[main] 11.0646 (1.04) 11.0646 (1.04) 11.0646 (1.04) 0.0000 (1.0) 11.0646 (1.04) 0.0000 (1.0) 0;0 0.0904 (0.96) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------------ benchmark 'test_init-init': 5 tests ------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 466.0105 (1.0) 588.2584 (1.0) 502.3886 (1.0) 21.1681 (1.25) 498.1140 (1.0) 27.6824 (1.22) 25;3 1.9905 (1.0) 100 1
test_init-init[2.40.0] 545.1790 (1.17) 1,103.3731 (1.88) 600.5860 (1.20) 57.2412 (3.37) 593.3051 (1.19) 35.2620 (1.56) 3;3 1.6650 (0.84) 100 1
test_init-init[2.58.2] 625.6034 (1.34) 728.2762 (1.24) 669.1397 (1.33) 20.7837 (1.22) 667.5777 (1.34) 31.9582 (1.41) 34;0 1.4945 (0.75) 100 1
test_init-init[3.0.0] 612.9204 (1.32) 707.6955 (1.20) 651.3240 (1.30) 17.2075 (1.01) 649.3699 (1.30) 25.3515 (1.12) 26;1 1.5353 (0.77) 100 1
test_init-init[main] 630.2760 (1.35) 716.6567 (1.22) 669.9506 (1.33) 16.9966 (1.0) 668.2798 (1.34) 22.6617 (1.0) 29;1 1.4926 (0.75) 100 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 149.3363 (1.0) 156.2961 (1.0) 151.4650 (1.0) 1.2516 (1.0) 151.2751 (1.0) 1.5412 (1.0) 27;2 6.6022 (1.0) 100 1
test_help---help[2.40.0] 197.2015 (1.32) 205.6523 (1.32) 200.6042 (1.32) 1.7302 (1.38) 200.4503 (1.33) 2.3715 (1.54) 32;1 4.9849 (0.76) 100 1
test_help---help[2.58.2] 156.7680 (1.05) 180.8300 (1.16) 160.7312 (1.06) 2.6025 (2.08) 160.4169 (1.06) 1.7543 (1.14) 13;7 6.2216 (0.94) 100 1
test_help---help[3.0.0] 153.8447 (1.03) 162.7689 (1.04) 157.8224 (1.04) 1.7952 (1.43) 157.7809 (1.04) 2.4812 (1.61) 33;1 6.3362 (0.96) 100 1
test_help---help[main] 154.4748 (1.03) 163.5024 (1.05) 157.1640 (1.04) 1.3557 (1.08) 157.1087 (1.04) 1.7871 (1.16) 24;2 6.3628 (0.96) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 460.3730 (1.02) 460.3730 (1.02) 460.3730 (1.02) 0.0000 (1.0) 460.3730 (1.02) 0.0000 (1.0) 0;0 2.1722 (0.98) 1 1
test_list-list[2.40.0] 452.9846 (1.0) 452.9846 (1.0) 452.9846 (1.0) 0.0000 (1.0) 452.9846 (1.0) 0.0000 (1.0) 0;0 2.2076 (1.0) 1 1
test_list-list[2.58.2] 515.8523 (1.14) 515.8523 (1.14) 515.8523 (1.14) 0.0000 (1.0) 515.8523 (1.14) 0.0000 (1.0) 0;0 1.9385 (0.88) 1 1
test_list-list[3.0.0] 503.4193 (1.11) 503.4193 (1.11) 503.4193 (1.11) 0.0000 (1.0) 503.4193 (1.11) 0.0000 (1.0) 0;0 1.9864 (0.90) 1 1
test_list-list[main] 486.5212 (1.07) 486.5212 (1.07) 486.5212 (1.07) 0.0000 (1.0) 486.5212 (1.07) 0.0000 (1.0) 0;0 2.0554 (0.93) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 439.4609 (1.01) 439.4609 (1.01) 439.4609 (1.01) 0.0000 (1.0) 439.4609 (1.01) 0.0000 (1.0) 0;0 2.2755 (0.99) 1 1
test_list-list-dvc-only[2.40.0] 432.9970 (1.0) 432.9970 (1.0) 432.9970 (1.0) 0.0000 (1.0) 432.9970 (1.0) 0.0000 (1.0) 0;0 2.3095 (1.0) 1 1
test_list-list-dvc-only[2.58.2] 491.6351 (1.14) 491.6351 (1.14) 491.6351 (1.14) 0.0000 (1.0) 491.6351 (1.14) 0.0000 (1.0) 0;0 2.0340 (0.88) 1 1
test_list-list-dvc-only[3.0.0] 485.9128 (1.12) 485.9128 (1.12) 485.9128 (1.12) 0.0000 (1.0) 485.9128 (1.12) 0.0000 (1.0) 0;0 2.0580 (0.89) 1 1
test_list-list-dvc-only[main] 478.7911 (1.11) 478.7911 (1.11) 478.7911 (1.11) 0.0000 (1.0) 478.7911 (1.11) 0.0000 (1.0) 0;0 2.0886 (0.90) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.7598 (3.44) 1.7598 (3.44) 1.7598 (3.44) 0.0000 (1.0) 1.7598 (3.44) 0.0000 (1.0) 0;0 0.5682 (0.29) 1 1
test_list-list-recursive[2.40.0] 0.5114 (1.0) 0.5114 (1.0) 0.5114 (1.0) 0.0000 (1.0) 0.5114 (1.0) 0.0000 (1.0) 0;0 1.9555 (1.0) 1 1
test_list-list-recursive[2.58.2] 0.6127 (1.20) 0.6127 (1.20) 0.6127 (1.20) 0.0000 (1.0) 0.6127 (1.20) 0.0000 (1.0) 0;0 1.6322 (0.83) 1 1
test_list-list-recursive[3.0.0] 0.6017 (1.18) 0.6017 (1.18) 0.6017 (1.18) 0.0000 (1.0) 0.6017 (1.18) 0.0000 (1.0) 0;0 1.6619 (0.85) 1 1
test_list-list-recursive[main] 0.5823 (1.14) 0.5823 (1.14) 0.5823 (1.14) 0.0000 (1.0) 0.5823 (1.14) 0.0000 (1.0) 0;0 1.7175 (0.88) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 432.3858 (1.0) 432.3858 (1.0) 432.3858 (1.0) 0.0000 (1.0) 432.3858 (1.0) 0.0000 (1.0) 0;0 2.3127 (1.0) 1 1
test_list-list-shallow[2.40.0] 459.6061 (1.06) 459.6061 (1.06) 459.6061 (1.06) 0.0000 (1.0) 459.6061 (1.06) 0.0000 (1.0) 0;0 2.1758 (0.94) 1 1
test_list-list-shallow[2.58.2] 506.9078 (1.17) 506.9078 (1.17) 506.9078 (1.17) 0.0000 (1.0) 506.9078 (1.17) 0.0000 (1.0) 0;0 1.9727 (0.85) 1 1
test_list-list-shallow[3.0.0] 492.7432 (1.14) 492.7432 (1.14) 492.7432 (1.14) 0.0000 (1.0) 492.7432 (1.14) 0.0000 (1.0) 0;0 2.0295 (0.88) 1 1
test_list-list-shallow[main] 483.4655 (1.12) 483.4655 (1.12) 483.4655 (1.12) 0.0000 (1.0) 483.4655 (1.12) 0.0000 (1.0) 0;0 2.0684 (0.89) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
Bumps iterative/setup-cml from 1 to 2.
Release notes
Sourced from iterative/setup-cml's releases.
Commits
f714cd2
Create v2 (#94)0424d86
v2 baselineYou can trigger a rebase of this PR by commenting
@dependabot rebase
.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show