github-actions[bot]
commented
10 months ago
Mon Oct 16 09:40:02 UTC 2023
dataset: small
project: example-get-started
-------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 14.8564 (1.26) 14.8564 (1.26) 14.8564 (1.26) 0.0000 (1.0) 14.8564 (1.26) 0.0000 (1.0) 0;0 0.0673 (0.79) 1 1
test_import-import[2.40.0] 11.7913 (1.0) 11.7913 (1.0) 11.7913 (1.0) 0.0000 (1.0) 11.7913 (1.0) 0.0000 (1.0) 0;0 0.0848 (1.0) 1 1
test_import-import[2.58.2] 12.5350 (1.06) 12.5350 (1.06) 12.5350 (1.06) 0.0000 (1.0) 12.5350 (1.06) 0.0000 (1.0) 0;0 0.0798 (0.94) 1 1
test_import-import[3.0.0] 12.6560 (1.07) 12.6560 (1.07) 12.6560 (1.07) 0.0000 (1.0) 12.6560 (1.07) 0.0000 (1.0) 0;0 0.0790 (0.93) 1 1
test_import-import[main] 13.6175 (1.15) 13.6175 (1.15) 13.6175 (1.15) 0.0000 (1.0) 13.6175 (1.15) 0.0000 (1.0) 0;0 0.0734 (0.87) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 1.4292 (1.08) 1.4292 (1.08) 1.4292 (1.08) 0.0000 (1.0) 1.4292 (1.08) 0.0000 (1.0) 0;0 0.6997 (0.93) 1 1
test_checkout_symlink-checkout[2.40.0] 1.3858 (1.04) 1.3858 (1.04) 1.3858 (1.04) 0.0000 (1.0) 1.3858 (1.04) 0.0000 (1.0) 0;0 0.7216 (0.96) 1 1
test_checkout_symlink-checkout[2.58.2] 1.8140 (1.37) 1.8140 (1.37) 1.8140 (1.37) 0.0000 (1.0) 1.8140 (1.37) 0.0000 (1.0) 0;0 0.5513 (0.73) 1 1
test_checkout_symlink-checkout[3.0.0] 1.8218 (1.37) 1.8218 (1.37) 1.8218 (1.37) 0.0000 (1.0) 1.8218 (1.37) 0.0000 (1.0) 0;0 0.5489 (0.73) 1 1
test_checkout_symlink-checkout[main] 1.3278 (1.0) 1.3278 (1.0) 1.3278 (1.0) 0.0000 (1.0) 1.3278 (1.0) 0.0000 (1.0) 0;0 0.7531 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 539.8758 (1.0) 539.8758 (1.0) 539.8758 (1.0) 0.0000 (1.0) 539.8758 (1.0) 0.0000 (1.0) 0;0 1.8523 (1.0) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 619.1615 (1.15) 619.1615 (1.15) 619.1615 (1.15) 0.0000 (1.0) 619.1615 (1.15) 0.0000 (1.0) 0;0 1.6151 (0.87) 1 1
test_checkout_symlink-checkout-noop[2.58.2] 725.3165 (1.34) 725.3165 (1.34) 725.3165 (1.34) 0.0000 (1.0) 725.3165 (1.34) 0.0000 (1.0) 0;0 1.3787 (0.74) 1 1
test_checkout_symlink-checkout-noop[3.0.0] 733.0087 (1.36) 733.0087 (1.36) 733.0087 (1.36) 0.0000 (1.0) 733.0087 (1.36) 0.0000 (1.0) 0;0 1.3642 (0.74) 1 1
test_checkout_symlink-checkout-noop[main] 728.3508 (1.35) 728.3508 (1.35) 728.3508 (1.35) 0.0000 (1.0) 728.3508 (1.35) 0.0000 (1.0) 0;0 1.3730 (0.74) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 1.5126 (2.08) 1.5126 (2.08) 1.5126 (2.08) 0.0000 (1.0) 1.5126 (2.08) 0.0000 (1.0) 0;0 0.6611 (0.48) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.7289 (1.0) 0.7289 (1.0) 0.7289 (1.0) 0.0000 (1.0) 0.7289 (1.0) 0.0000 (1.0) 0;0 1.3719 (1.0) 1 1
test_checkout_symlink-checkout-update[2.58.2] 0.9634 (1.32) 0.9634 (1.32) 0.9634 (1.32) 0.0000 (1.0) 0.9634 (1.32) 0.0000 (1.0) 0;0 1.0379 (0.76) 1 1
test_checkout_symlink-checkout-update[3.0.0] 0.8450 (1.16) 0.8450 (1.16) 0.8450 (1.16) 0.0000 (1.0) 0.8450 (1.16) 0.0000 (1.0) 0;0 1.1835 (0.86) 1 1
test_checkout_symlink-checkout-update[main] 0.8278 (1.14) 0.8278 (1.14) 0.8278 (1.14) 0.0000 (1.0) 0.8278 (1.14) 0.0000 (1.0) 0;0 1.2081 (0.88) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 8.8464 (1.77) 8.8464 (1.77) 8.8464 (1.77) 0.0000 (1.0) 8.8464 (1.77) 0.0000 (1.0) 0;0 0.1130 (0.56) 1 1
test_partial_remove-add[2.40.0] 7.8724 (1.58) 7.8724 (1.58) 7.8724 (1.58) 0.0000 (1.0) 7.8724 (1.58) 0.0000 (1.0) 0;0 0.1270 (0.63) 1 1
test_partial_remove-add[2.58.2] 5.1285 (1.03) 5.1285 (1.03) 5.1285 (1.03) 0.0000 (1.0) 5.1285 (1.03) 0.0000 (1.0) 0;0 0.1950 (0.97) 1 1
test_partial_remove-add[3.0.0] 5.0100 (1.00) 5.0100 (1.00) 5.0100 (1.00) 0.0000 (1.0) 5.0100 (1.00) 0.0000 (1.0) 0;0 0.1996 (1.00) 1 1
test_partial_remove-add[main] 4.9970 (1.0) 4.9970 (1.0) 4.9970 (1.0) 0.0000 (1.0) 4.9970 (1.0) 0.0000 (1.0) 0;0 0.2001 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.11.0] 3.3265 (1.74) 3.3265 (1.74) 3.3265 (1.74) 0.0000 (1.0) 3.3265 (1.74) 0.0000 (1.0) 0;0 0.3006 (0.57) 1 1
test_partial_remove-add-update[2.40.0] 1.9096 (1.0) 1.9096 (1.0) 1.9096 (1.0) 0.0000 (1.0) 1.9096 (1.0) 0.0000 (1.0) 0;0 0.5237 (1.0) 1 1
test_partial_remove-add-update[2.58.2] 2.0612 (1.08) 2.0612 (1.08) 2.0612 (1.08) 0.0000 (1.0) 2.0612 (1.08) 0.0000 (1.0) 0;0 0.4852 (0.93) 1 1
test_partial_remove-add-update[3.0.0] 2.0075 (1.05) 2.0075 (1.05) 2.0075 (1.05) 0.0000 (1.0) 2.0075 (1.05) 0.0000 (1.0) 0;0 0.4981 (0.95) 1 1
test_partial_remove-add-update[main] 1.9958 (1.05) 1.9958 (1.05) 1.9958 (1.05) 0.0000 (1.0) 1.9958 (1.05) 0.0000 (1.0) 0;0 0.5010 (0.96) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 537.7050 (1.0) 537.7050 (1.0) 537.7050 (1.0) 0.0000 (1.0) 537.7050 (1.0) 0.0000 (1.0) 0;0 1.8598 (1.0) 1 1
test_partial_remove-gc[2.40.0] 623.4498 (1.16) 623.4498 (1.16) 623.4498 (1.16) 0.0000 (1.0) 623.4498 (1.16) 0.0000 (1.0) 0;0 1.6040 (0.86) 1 1
test_partial_remove-gc[2.58.2] 793.5618 (1.48) 793.5618 (1.48) 793.5618 (1.48) 0.0000 (1.0) 793.5618 (1.48) 0.0000 (1.0) 0;0 1.2601 (0.68) 1 1
test_partial_remove-gc[3.0.0] 781.8319 (1.45) 781.8319 (1.45) 781.8319 (1.45) 0.0000 (1.0) 781.8319 (1.45) 0.0000 (1.0) 0;0 1.2790 (0.69) 1 1
test_partial_remove-gc[main] 789.5397 (1.47) 789.5397 (1.47) 789.5397 (1.47) 0.0000 (1.0) 789.5397 (1.47) 0.0000 (1.0) 0;0 1.2666 (0.68) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 594.5356 (1.0) 594.5356 (1.0) 594.5356 (1.0) 0.0000 (1.0) 594.5356 (1.0) 0.0000 (1.0) 0;0 1.6820 (1.0) 1 1
test_partial_remove-gc-cloud[2.40.0] 752.7470 (1.27) 752.7470 (1.27) 752.7470 (1.27) 0.0000 (1.0) 752.7470 (1.27) 0.0000 (1.0) 0;0 1.3285 (0.79) 1 1
test_partial_remove-gc-cloud[2.58.2] 865.8807 (1.46) 865.8807 (1.46) 865.8807 (1.46) 0.0000 (1.0) 865.8807 (1.46) 0.0000 (1.0) 0;0 1.1549 (0.69) 1 1
test_partial_remove-gc-cloud[3.0.0] 894.1186 (1.50) 894.1186 (1.50) 894.1186 (1.50) 0.0000 (1.0) 894.1186 (1.50) 0.0000 (1.0) 0;0 1.1184 (0.66) 1 1
test_partial_remove-gc-cloud[main] 927.0141 (1.56) 927.0141 (1.56) 927.0141 (1.56) 0.0000 (1.0) 927.0141 (1.56) 0.0000 (1.0) 0;0 1.0787 (0.64) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 4.9260 (2.38) 4.9260 (2.38) 4.9260 (2.38) 0.0000 (1.0) 4.9260 (2.38) 0.0000 (1.0) 0;0 0.2030 (0.42) 1 1
test_partial_remove-push[2.40.0] 6.5233 (3.16) 6.5233 (3.16) 6.5233 (3.16) 0.0000 (1.0) 6.5233 (3.16) 0.0000 (1.0) 0;0 0.1533 (0.32) 1 1
test_partial_remove-push[2.58.2] 4.4903 (2.17) 4.4903 (2.17) 4.4903 (2.17) 0.0000 (1.0) 4.4903 (2.17) 0.0000 (1.0) 0;0 0.2227 (0.46) 1 1
test_partial_remove-push[3.0.0] 2.0670 (1.0) 2.0670 (1.0) 2.0670 (1.0) 0.0000 (1.0) 2.0670 (1.0) 0.0000 (1.0) 0;0 0.4838 (1.0) 1 1
test_partial_remove-push[main] 4.5895 (2.22) 4.5895 (2.22) 4.5895 (2.22) 0.0000 (1.0) 4.5895 (2.22) 0.0000 (1.0) 0;0 0.2179 (0.45) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.11.0] 606.9008 (1.0) 606.9008 (1.0) 606.9008 (1.0) 0.0000 (1.0) 606.9008 (1.0) 0.0000 (1.0) 0;0 1.6477 (1.0) 1 1
test_partial_remove-push-update[2.40.0] 652.2067 (1.07) 652.2067 (1.07) 652.2067 (1.07) 0.0000 (1.0) 652.2067 (1.07) 0.0000 (1.0) 0;0 1.5333 (0.93) 1 1
test_partial_remove-push-update[2.58.2] 781.7829 (1.29) 781.7829 (1.29) 781.7829 (1.29) 0.0000 (1.0) 781.7829 (1.29) 0.0000 (1.0) 0;0 1.2791 (0.78) 1 1
test_partial_remove-push-update[3.0.0] 709.1472 (1.17) 709.1472 (1.17) 709.1472 (1.17) 0.0000 (1.0) 709.1472 (1.17) 0.0000 (1.0) 0;0 1.4101 (0.86) 1 1
test_partial_remove-push-update[main] 707.5753 (1.17) 707.5753 (1.17) 707.5753 (1.17) 0.0000 (1.0) 707.5753 (1.17) 0.0000 (1.0) 0;0 1.4133 (0.86) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 453.2620 (1.0) 453.2620 (1.0) 453.2620 (1.0) 0.0000 (1.0) 453.2620 (1.0) 0.0000 (1.0) 0;0 2.2062 (1.0) 1 1
test_gc-gc[2.40.0] 504.3065 (1.11) 504.3065 (1.11) 504.3065 (1.11) 0.0000 (1.0) 504.3065 (1.11) 0.0000 (1.0) 0;0 1.9829 (0.90) 1 1
test_gc-gc[2.58.2] 569.6908 (1.26) 569.6908 (1.26) 569.6908 (1.26) 0.0000 (1.0) 569.6908 (1.26) 0.0000 (1.0) 0;0 1.7553 (0.80) 1 1
test_gc-gc[3.0.0] 572.5141 (1.26) 572.5141 (1.26) 572.5141 (1.26) 0.0000 (1.0) 572.5141 (1.26) 0.0000 (1.0) 0;0 1.7467 (0.79) 1 1
test_gc-gc[main] 559.7427 (1.23) 559.7427 (1.23) 559.7427 (1.23) 0.0000 (1.0) 559.7427 (1.23) 0.0000 (1.0) 0;0 1.7865 (0.81) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 6.6233 (1.82) 6.6233 (1.82) 6.6233 (1.82) 0.0000 (1.0) 6.6233 (1.82) 0.0000 (1.0) 0;0 0.1510 (0.55) 1 1
test_add-add[2.40.0] 6.0045 (1.65) 6.0045 (1.65) 6.0045 (1.65) 0.0000 (1.0) 6.0045 (1.65) 0.0000 (1.0) 0;0 0.1665 (0.61) 1 1
test_add-add[2.58.2] 3.6621 (1.01) 3.6621 (1.01) 3.6621 (1.01) 0.0000 (1.0) 3.6621 (1.01) 0.0000 (1.0) 0;0 0.2731 (0.99) 1 1
test_add-add[3.0.0] 3.9077 (1.07) 3.9077 (1.07) 3.9077 (1.07) 0.0000 (1.0) 3.9077 (1.07) 0.0000 (1.0) 0;0 0.2559 (0.93) 1 1
test_add-add[main] 3.6382 (1.0) 3.6382 (1.0) 3.6382 (1.0) 0.0000 (1.0) 3.6382 (1.0) 0.0000 (1.0) 0;0 0.2749 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.40.0] 955.6663 (1.0) 955.6663 (1.0) 955.6663 (1.0) 0.0000 (1.0) 955.6663 (1.0) 0.0000 (1.0) 0;0 1.0464 (1.0) 1 1
test_exp_show-exp[2.58.2] 1,117.2986 (1.17) 1,117.2986 (1.17) 1,117.2986 (1.17) 0.0000 (1.0) 1,117.2986 (1.17) 0.0000 (1.0) 0;0 0.8950 (0.86) 1 1
test_exp_show-exp[3.0.0] 5,056.3122 (5.29) 5,056.3122 (5.29) 5,056.3122 (5.29) 0.0000 (1.0) 5,056.3122 (5.29) 0.0000 (1.0) 0;0 0.1978 (0.19) 1 1
test_exp_show-exp[main] 4,548.5208 (4.76) 4,548.5208 (4.76) 4,548.5208 (4.76) 0.0000 (1.0) 4,548.5208 (4.76) 0.0000 (1.0) 0;0 0.2199 (0.21) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.11.0] 14.4195 (1.43) 14.4195 (1.43) 14.4195 (1.43) 0.0000 (1.0) 14.4195 (1.43) 0.0000 (1.0) 0;0 0.0694 (0.70) 1 1
test_update-import-url[2.40.0] 12.3325 (1.22) 12.3325 (1.22) 12.3325 (1.22) 0.0000 (1.0) 12.3325 (1.22) 0.0000 (1.0) 0;0 0.0811 (0.82) 1 1
test_update-import-url[2.58.2] 10.2247 (1.01) 10.2247 (1.01) 10.2247 (1.01) 0.0000 (1.0) 10.2247 (1.01) 0.0000 (1.0) 0;0 0.0978 (0.99) 1 1
test_update-import-url[3.0.0] 10.1181 (1.0) 10.1181 (1.0) 10.1181 (1.0) 0.0000 (1.0) 10.1181 (1.0) 0.0000 (1.0) 0;0 0.0988 (1.0) 1 1
test_update-import-url[main] 10.3033 (1.02) 10.3033 (1.02) 10.3033 (1.02) 0.0000 (1.0) 10.3033 (1.02) 0.0000 (1.0) 0;0 0.0971 (0.98) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 11.2169 (1.38) 11.2169 (1.38) 11.2169 (1.38) 0.0000 (1.0) 11.2169 (1.38) 0.0000 (1.0) 0;0 0.0892 (0.72) 1 1
test_update-update[2.40.0] 8.1113 (1.0) 8.1113 (1.0) 8.1113 (1.0) 0.0000 (1.0) 8.1113 (1.0) 0.0000 (1.0) 0;0 0.1233 (1.0) 1 1
test_update-update[2.58.2] 8.6924 (1.07) 8.6924 (1.07) 8.6924 (1.07) 0.0000 (1.0) 8.6924 (1.07) 0.0000 (1.0) 0;0 0.1150 (0.93) 1 1
test_update-update[3.0.0] 8.8495 (1.09) 8.8495 (1.09) 8.8495 (1.09) 0.0000 (1.0) 8.8495 (1.09) 0.0000 (1.0) 0;0 0.1130 (0.92) 1 1
test_update-update[main] 9.1276 (1.13) 9.1276 (1.13) 9.1276 (1.13) 0.0000 (1.0) 9.1276 (1.13) 0.0000 (1.0) 0;0 0.1096 (0.89) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 673.4939 (1.0) 673.4939 (1.0) 673.4939 (1.0) 0.0000 (1.0) 673.4939 (1.0) 0.0000 (1.0) 0;0 1.4848 (1.0) 1 1
test_update-update-noop[2.40.0] 1,124.2809 (1.67) 1,124.2809 (1.67) 1,124.2809 (1.67) 0.0000 (1.0) 1,124.2809 (1.67) 0.0000 (1.0) 0;0 0.8895 (0.60) 1 1
test_update-update-noop[2.58.2] 1,406.5591 (2.09) 1,406.5591 (2.09) 1,406.5591 (2.09) 0.0000 (1.0) 1,406.5591 (2.09) 0.0000 (1.0) 0;0 0.7110 (0.48) 1 1
test_update-update-noop[3.0.0] 1,353.0066 (2.01) 1,353.0066 (2.01) 1,353.0066 (2.01) 0.0000 (1.0) 1,353.0066 (2.01) 0.0000 (1.0) 0;0 0.7391 (0.50) 1 1
test_update-update-noop[main] 1,430.3190 (2.12) 1,430.3190 (2.12) 1,430.3190 (2.12) 0.0000 (1.0) 1,430.3190 (2.12) 0.0000 (1.0) 0;0 0.6991 (0.47) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.40.0] 513.4106 (1.04) 522.1264 (1.05) 517.4420 (1.04) 3.4498 (2.31) 516.7834 (1.04) 5.3565 (2.44) 2;0 1.9326 (0.96) 5 3
test_plots-plots-diff[2.58.2] 495.3895 (1.0) 499.0508 (1.0) 497.0761 (1.0) 1.4915 (1.0) 497.5001 (1.0) 2.3065 (1.05) 2;0 2.0118 (1.0) 5 3
test_plots-plots-diff[3.0.0] 885.8034 (1.79) 891.8012 (1.79) 889.6540 (1.79) 2.2881 (1.53) 890.4840 (1.79) 2.1981 (1.0) 1;0 1.1240 (0.56) 5 3
test_plots-plots-diff[main] 894.0875 (1.80) 904.3010 (1.81) 900.4737 (1.81) 3.9539 (2.65) 901.9474 (1.81) 4.7633 (2.17) 1;0 1.1105 (0.55) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.40.0] 552.3402 (1.08) 559.7049 (1.08) 556.6182 (1.08) 3.0330 (1.20) 557.5682 (1.08) 4.8479 (1.20) 2;0 1.7966 (0.92) 5 3
test_plots-plots-diff-json[2.58.2] 511.6256 (1.0) 517.8488 (1.0) 514.6337 (1.0) 2.5265 (1.0) 513.9103 (1.0) 4.0414 (1.0) 2;0 1.9431 (1.0) 5 3
test_plots-plots-diff-json[3.0.0] 1,226.4655 (2.40) 1,255.9283 (2.43) 1,237.2625 (2.40) 11.4377 (4.53) 1,236.9512 (2.41) 13.1402 (3.25) 1;0 0.8082 (0.42) 5 3
test_plots-plots-diff-json[main] 1,244.5492 (2.43) 1,253.0334 (2.42) 1,247.8885 (2.42) 3.6051 (1.43) 1,246.3277 (2.43) 5.7799 (1.43) 1;0 0.8014 (0.41) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.40.0] 401.6472 (1.0) 405.7489 (1.0) 403.9235 (1.0) 1.4657 (1.0) 404.0564 (1.0) 1.1370 (1.0) 2;1 2.4757 (1.0) 5 3
test_plots-plots-show[2.58.2] 465.2747 (1.16) 469.6794 (1.16) 467.1576 (1.16) 1.9828 (1.35) 466.5132 (1.15) 3.5673 (3.14) 1;0 2.1406 (0.86) 5 3
test_plots-plots-show[3.0.0] 732.0699 (1.82) 741.0446 (1.83) 735.6300 (1.82) 4.2836 (2.92) 732.9615 (1.81) 7.4347 (6.54) 1;0 1.3594 (0.55) 5 3
test_plots-plots-show[main] 740.4853 (1.84) 747.0851 (1.84) 743.2033 (1.84) 2.6351 (1.80) 742.0291 (1.84) 3.7551 (3.30) 2;0 1.3455 (0.54) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.40.0] 436.1343 (1.0) 439.2930 (1.0) 437.8534 (1.0) 1.3858 (1.0) 438.0744 (1.0) 2.5010 (1.0) 2;0 2.2839 (1.0) 5 3
test_plots-plots-show-json[2.58.2] 478.0634 (1.10) 485.3001 (1.10) 481.4668 (1.10) 2.5938 (1.87) 481.1215 (1.10) 2.5681 (1.03) 2;0 2.0770 (0.91) 5 3
test_plots-plots-show-json[3.0.0] 921.0605 (2.11) 932.1777 (2.12) 927.8902 (2.12) 4.5140 (3.26) 929.6887 (2.12) 6.5987 (2.64) 1;0 1.0777 (0.47) 5 3
test_plots-plots-show-json[main] 930.1028 (2.13) 938.7987 (2.14) 933.3544 (2.13) 3.2662 (2.36) 932.8847 (2.13) 3.0941 (1.24) 1;0 1.0714 (0.47) 5 3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.40.0] 1.5073 (1.05) 1.5073 (1.05) 1.5073 (1.05) 0.0000 (1.0) 1.5073 (1.05) 0.0000 (1.0) 0;0 0.6635 (0.95) 1 1
test_data_status_all_flags-data-changed[2.58.2] 1.4954 (1.05) 1.4954 (1.05) 1.4954 (1.05) 0.0000 (1.0) 1.4954 (1.05) 0.0000 (1.0) 0;0 0.6687 (0.96) 1 1
test_data_status_all_flags-data-changed[3.0.0] 1.4294 (1.0) 1.4294 (1.0) 1.4294 (1.0) 0.0000 (1.0) 1.4294 (1.0) 0.0000 (1.0) 0;0 0.6996 (1.0) 1 1
test_data_status_all_flags-data-changed[main] 1.4308 (1.00) 1.4308 (1.00) 1.4308 (1.00) 0.0000 (1.0) 1.4308 (1.00) 0.0000 (1.0) 0;0 0.6989 (1.00) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.40.0] 1.4370 (1.03) 1.4370 (1.03) 1.4370 (1.03) 0.0000 (1.0) 1.4370 (1.03) 0.0000 (1.0) 0;0 0.6959 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[2.58.2] 1.6924 (1.21) 1.6924 (1.21) 1.6924 (1.21) 0.0000 (1.0) 1.6924 (1.21) 0.0000 (1.0) 0;0 0.5909 (0.83) 1 1
test_data_status_all_flags-data-changed-noop[3.0.0] 1.3970 (1.0) 1.3970 (1.0) 1.3970 (1.0) 0.0000 (1.0) 1.3970 (1.0) 0.0000 (1.0) 0;0 0.7158 (1.0) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.5945 (1.14) 1.5945 (1.14) 1.5945 (1.14) 0.0000 (1.0) 1.5945 (1.14) 0.0000 (1.0) 0;0 0.6272 (0.88) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.40.0] 2.5514 (1.07) 2.5514 (1.07) 2.5514 (1.07) 0.0000 (1.0) 2.5514 (1.07) 0.0000 (1.0) 0;0 0.3919 (0.93) 1 1
test_data_status_all_flags-data-new[2.58.2] 2.4115 (1.01) 2.4115 (1.01) 2.4115 (1.01) 0.0000 (1.0) 2.4115 (1.01) 0.0000 (1.0) 0;0 0.4147 (0.99) 1 1
test_data_status_all_flags-data-new[3.0.0] 2.3842 (1.0) 2.3842 (1.0) 2.3842 (1.0) 0.0000 (1.0) 2.3842 (1.0) 0.0000 (1.0) 0;0 0.4194 (1.0) 1 1
test_data_status_all_flags-data-new[main] 2.4564 (1.03) 2.4564 (1.03) 2.4564 (1.03) 0.0000 (1.0) 2.4564 (1.03) 0.0000 (1.0) 0;0 0.4071 (0.97) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.40.0] 1.4677 (1.03) 1.4677 (1.03) 1.4677 (1.03) 0.0000 (1.0) 1.4677 (1.03) 0.0000 (1.0) 0;0 0.6813 (0.97) 1 1
test_data_status_all_flags-data-noop[2.58.2] 1.4224 (1.0) 1.4224 (1.0) 1.4224 (1.0) 0.0000 (1.0) 1.4224 (1.0) 0.0000 (1.0) 0;0 0.7030 (1.0) 1 1
test_data_status_all_flags-data-noop[3.0.0] 1.4455 (1.02) 1.4455 (1.02) 1.4455 (1.02) 0.0000 (1.0) 1.4455 (1.02) 0.0000 (1.0) 0;0 0.6918 (0.98) 1 1
test_data_status_all_flags-data-noop[main] 1.5332 (1.08) 1.5332 (1.08) 1.5332 (1.08) 0.0000 (1.0) 1.5332 (1.08) 0.0000 (1.0) 0;0 0.6522 (0.93) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.11.0] 7.4022 (1.78) 7.4022 (1.78) 7.4022 (1.78) 0.0000 (1.0) 7.4022 (1.78) 0.0000 (1.0) 0;0 0.1351 (0.56) 1 1
test_sharing_gs-add[2.11.0] 7.1891 (1.73) 7.1891 (1.73) 7.1891 (1.73) 0.0000 (1.0) 7.1891 (1.73) 0.0000 (1.0) 0;0 0.1391 (0.58) 1 1
test_sharing_gs-add[2.40.0] 6.1283 (1.47) 6.1283 (1.47) 6.1283 (1.47) 0.0000 (1.0) 6.1283 (1.47) 0.0000 (1.0) 0;0 0.1632 (0.68) 1 1
test_sharing_gs-add[2.40.0] 6.0385 (1.45) 6.0385 (1.45) 6.0385 (1.45) 0.0000 (1.0) 6.0385 (1.45) 0.0000 (1.0) 0;0 0.1656 (0.69) 1 1
test_sharing_gs-add[2.58.2] 4.2036 (1.01) 4.2036 (1.01) 4.2036 (1.01) 0.0000 (1.0) 4.2036 (1.01) 0.0000 (1.0) 0;0 0.2379 (0.99) 1 1
test_sharing_gs-add[2.58.2] 4.5294 (1.09) 4.5294 (1.09) 4.5294 (1.09) 0.0000 (1.0) 4.5294 (1.09) 0.0000 (1.0) 0;0 0.2208 (0.92) 1 1
test_sharing_gs-add[3.0.0] 4.1592 (1.0) 4.1592 (1.0) 4.1592 (1.0) 0.0000 (1.0) 4.1592 (1.0) 0.0000 (1.0) 0;0 0.2404 (1.0) 1 1
test_sharing_gs-add[3.0.0] 4.1811 (1.01) 4.1811 (1.01) 4.1811 (1.01) 0.0000 (1.0) 4.1811 (1.01) 0.0000 (1.0) 0;0 0.2392 (0.99) 1 1
test_sharing_gs-add[main] 4.1930 (1.01) 4.1930 (1.01) 4.1930 (1.01) 0.0000 (1.0) 4.1930 (1.01) 0.0000 (1.0) 0;0 0.2385 (0.99) 1 1
test_sharing_gs-add[main] 4.2338 (1.02) 4.2338 (1.02) 4.2338 (1.02) 0.0000 (1.0) 4.2338 (1.02) 0.0000 (1.0) 0;0 0.2362 (0.98) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.11.0] 3.6151 (1.42) 3.6151 (1.42) 3.6151 (1.42) 0.0000 (1.0) 3.6151 (1.42) 0.0000 (1.0) 0;0 0.2766 (0.70) 1 1
test_sharing_gs-add-noop[2.11.0] 3.5738 (1.41) 3.5738 (1.41) 3.5738 (1.41) 0.0000 (1.0) 3.5738 (1.41) 0.0000 (1.0) 0;0 0.2798 (0.71) 1 1
test_sharing_gs-add-noop[2.40.0] 2.5781 (1.02) 2.5781 (1.02) 2.5781 (1.02) 0.0000 (1.0) 2.5781 (1.02) 0.0000 (1.0) 0;0 0.3879 (0.98) 1 1
test_sharing_gs-add-noop[2.40.0] 2.5373 (1.0) 2.5373 (1.0) 2.5373 (1.0) 0.0000 (1.0) 2.5373 (1.0) 0.0000 (1.0) 0;0 0.3941 (1.0) 1 1
test_sharing_gs-add-noop[2.58.2] 2.8042 (1.11) 2.8042 (1.11) 2.8042 (1.11) 0.0000 (1.0) 2.8042 (1.11) 0.0000 (1.0) 0;0 0.3566 (0.90) 1 1
test_sharing_gs-add-noop[2.58.2] 3.2462 (1.28) 3.2462 (1.28) 3.2462 (1.28) 0.0000 (1.0) 3.2462 (1.28) 0.0000 (1.0) 0;0 0.3080 (0.78) 1 1
test_sharing_gs-add-noop[3.0.0] 2.7843 (1.10) 2.7843 (1.10) 2.7843 (1.10) 0.0000 (1.0) 2.7843 (1.10) 0.0000 (1.0) 0;0 0.3592 (0.91) 1 1
test_sharing_gs-add-noop[3.0.0] 2.7663 (1.09) 2.7663 (1.09) 2.7663 (1.09) 0.0000 (1.0) 2.7663 (1.09) 0.0000 (1.0) 0;0 0.3615 (0.92) 1 1
test_sharing_gs-add-noop[main] 2.7846 (1.10) 2.7846 (1.10) 2.7846 (1.10) 0.0000 (1.0) 2.7846 (1.10) 0.0000 (1.0) 0;0 0.3591 (0.91) 1 1
test_sharing_gs-add-noop[main] 2.7824 (1.10) 2.7824 (1.10) 2.7824 (1.10) 0.0000 (1.0) 2.7824 (1.10) 0.0000 (1.0) 0;0 0.3594 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.11.0] 521.4721 (1.01) 521.4721 (1.01) 521.4721 (1.01) 0.0000 (1.0) 521.4721 (1.01) 0.0000 (1.0) 0;0 1.9176 (0.99) 1 1
test_sharing_gs-checkout-noop[2.11.0] 514.7759 (1.0) 514.7759 (1.0) 514.7759 (1.0) 0.0000 (1.0) 514.7759 (1.0) 0.0000 (1.0) 0;0 1.9426 (1.0) 1 1
test_sharing_gs-checkout-noop[2.40.0] 615.9677 (1.20) 615.9677 (1.20) 615.9677 (1.20) 0.0000 (1.0) 615.9677 (1.20) 0.0000 (1.0) 0;0 1.6235 (0.84) 1 1
test_sharing_gs-checkout-noop[2.40.0] 612.2271 (1.19) 612.2271 (1.19) 612.2271 (1.19) 0.0000 (1.0) 612.2271 (1.19) 0.0000 (1.0) 0;0 1.6334 (0.84) 1 1
test_sharing_gs-checkout-noop[2.58.2] 674.5006 (1.31) 674.5006 (1.31) 674.5006 (1.31) 0.0000 (1.0) 674.5006 (1.31) 0.0000 (1.0) 0;0 1.4826 (0.76) 1 1
test_sharing_gs-checkout-noop[2.58.2] 682.7360 (1.33) 682.7360 (1.33) 682.7360 (1.33) 0.0000 (1.0) 682.7360 (1.33) 0.0000 (1.0) 0;0 1.4647 (0.75) 1 1
test_sharing_gs-checkout-noop[3.0.0] 695.1806 (1.35) 695.1806 (1.35) 695.1806 (1.35) 0.0000 (1.0) 695.1806 (1.35) 0.0000 (1.0) 0;0 1.4385 (0.74) 1 1
test_sharing_gs-checkout-noop[3.0.0] 697.5846 (1.36) 697.5846 (1.36) 697.5846 (1.36) 0.0000 (1.0) 697.5846 (1.36) 0.0000 (1.0) 0;0 1.4335 (0.74) 1 1
test_sharing_gs-checkout-noop[main] 695.4160 (1.35) 695.4160 (1.35) 695.4160 (1.35) 0.0000 (1.0) 695.4160 (1.35) 0.0000 (1.0) 0;0 1.4380 (0.74) 1 1
test_sharing_gs-checkout-noop[main] 707.9371 (1.38) 707.9371 (1.38) 707.9371 (1.38) 0.0000 (1.0) 707.9371 (1.38) 0.0000 (1.0) 0;0 1.4126 (0.73) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-pull': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull[2.11.0] 7.5701 (1.36) 7.5701 (1.36) 7.5701 (1.36) 0.0000 (1.0) 7.5701 (1.36) 0.0000 (1.0) 0;0 0.1321 (0.74) 1 1
test_sharing_gs-pull[2.11.0] 7.5082 (1.34) 7.5082 (1.34) 7.5082 (1.34) 0.0000 (1.0) 7.5082 (1.34) 0.0000 (1.0) 0;0 0.1332 (0.74) 1 1
test_sharing_gs-pull[2.40.0] 8.8477 (1.58) 8.8477 (1.58) 8.8477 (1.58) 0.0000 (1.0) 8.8477 (1.58) 0.0000 (1.0) 0;0 0.1130 (0.63) 1 1
test_sharing_gs-pull[2.40.0] 9.1182 (1.63) 9.1182 (1.63) 9.1182 (1.63) 0.0000 (1.0) 9.1182 (1.63) 0.0000 (1.0) 0;0 0.1097 (0.61) 1 1
test_sharing_gs-pull[2.58.2] 5.6633 (1.01) 5.6633 (1.01) 5.6633 (1.01) 0.0000 (1.0) 5.6633 (1.01) 0.0000 (1.0) 0;0 0.1766 (0.99) 1 1
test_sharing_gs-pull[2.58.2] 5.5852 (1.0) 5.5852 (1.0) 5.5852 (1.0) 0.0000 (1.0) 5.5852 (1.0) 0.0000 (1.0) 0;0 0.1790 (1.0) 1 1
test_sharing_gs-pull[3.0.0] 7.9829 (1.43) 7.9829 (1.43) 7.9829 (1.43) 0.0000 (1.0) 7.9829 (1.43) 0.0000 (1.0) 0;0 0.1253 (0.70) 1 1
test_sharing_gs-pull[3.0.0] 7.9183 (1.42) 7.9183 (1.42) 7.9183 (1.42) 0.0000 (1.0) 7.9183 (1.42) 0.0000 (1.0) 0;0 0.1263 (0.71) 1 1
test_sharing_gs-pull[main] 7.8354 (1.40) 7.8354 (1.40) 7.8354 (1.40) 0.0000 (1.0) 7.8354 (1.40) 0.0000 (1.0) 0;0 0.1276 (0.71) 1 1
test_sharing_gs-pull[main] 7.8504 (1.41) 7.8504 (1.41) 7.8504 (1.41) 0.0000 (1.0) 7.8504 (1.41) 0.0000 (1.0) 0;0 0.1274 (0.71) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull-noop[2.11.0] 1.2293 (2.21) 1.2293 (2.21) 1.2293 (2.21) 0.0000 (1.0) 1.2293 (2.21) 0.0000 (1.0) 0;0 0.8135 (0.45) 1 1
test_sharing_gs-pull-noop[2.11.0] 0.5557 (1.0) 0.5557 (1.0) 0.5557 (1.0) 0.0000 (1.0) 0.5557 (1.0) 0.0000 (1.0) 0;0 1.7996 (1.0) 1 1
test_sharing_gs-pull-noop[2.40.0] 0.6433 (1.16) 0.6433 (1.16) 0.6433 (1.16) 0.0000 (1.0) 0.6433 (1.16) 0.0000 (1.0) 0;0 1.5546 (0.86) 1 1
test_sharing_gs-pull-noop[2.40.0] 0.6511 (1.17) 0.6511 (1.17) 0.6511 (1.17) 0.0000 (1.0) 0.6511 (1.17) 0.0000 (1.0) 0;0 1.5358 (0.85) 1 1
test_sharing_gs-pull-noop[2.58.2] 0.7295 (1.31) 0.7295 (1.31) 0.7295 (1.31) 0.0000 (1.0) 0.7295 (1.31) 0.0000 (1.0) 0;0 1.3707 (0.76) 1 1
test_sharing_gs-pull-noop[2.58.2] 0.7243 (1.30) 0.7243 (1.30) 0.7243 (1.30) 0.0000 (1.0) 0.7243 (1.30) 0.0000 (1.0) 0;0 1.3807 (0.77) 1 1
test_sharing_gs-pull-noop[3.0.0] 0.8383 (1.51) 0.8383 (1.51) 0.8383 (1.51) 0.0000 (1.0) 0.8383 (1.51) 0.0000 (1.0) 0;0 1.1928 (0.66) 1 1
test_sharing_gs-pull-noop[3.0.0] 0.8399 (1.51) 0.8399 (1.51) 0.8399 (1.51) 0.0000 (1.0) 0.8399 (1.51) 0.0000 (1.0) 0;0 1.1907 (0.66) 1 1
test_sharing_gs-pull-noop[main] 0.8438 (1.52) 0.8438 (1.52) 0.8438 (1.52) 0.0000 (1.0) 0.8438 (1.52) 0.0000 (1.0) 0;0 1.1852 (0.66) 1 1
test_sharing_gs-pull-noop[main] 0.8431 (1.52) 0.8431 (1.52) 0.8431 (1.52) 0.0000 (1.0) 0.8431 (1.52) 0.0000 (1.0) 0;0 1.1862 (0.66) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.11.0] 4.0837 (2.20) 4.0837 (2.20) 4.0837 (2.20) 0.0000 (1.0) 4.0837 (2.20) 0.0000 (1.0) 0;0 0.2449 (0.45) 1 1
test_sharing_gs-push[2.11.0] 4.0827 (2.20) 4.0827 (2.20) 4.0827 (2.20) 0.0000 (1.0) 4.0827 (2.20) 0.0000 (1.0) 0;0 0.2449 (0.45) 1 1
test_sharing_gs-push[2.40.0] 5.2008 (2.81) 5.2008 (2.81) 5.2008 (2.81) 0.0000 (1.0) 5.2008 (2.81) 0.0000 (1.0) 0;0 0.1923 (0.36) 1 1
test_sharing_gs-push[2.40.0] 5.1284 (2.77) 5.1284 (2.77) 5.1284 (2.77) 0.0000 (1.0) 5.1284 (2.77) 0.0000 (1.0) 0;0 0.1950 (0.36) 1 1
test_sharing_gs-push[2.58.2] 3.5626 (1.92) 3.5626 (1.92) 3.5626 (1.92) 0.0000 (1.0) 3.5626 (1.92) 0.0000 (1.0) 0;0 0.2807 (0.52) 1 1
test_sharing_gs-push[2.58.2] 3.5359 (1.91) 3.5359 (1.91) 3.5359 (1.91) 0.0000 (1.0) 3.5359 (1.91) 0.0000 (1.0) 0;0 0.2828 (0.52) 1 1
test_sharing_gs-push[3.0.0] 1.8532 (1.0) 1.8532 (1.0) 1.8532 (1.0) 0.0000 (1.0) 1.8532 (1.0) 0.0000 (1.0) 0;0 0.5396 (1.0) 1 1
test_sharing_gs-push[3.0.0] 2.2146 (1.20) 2.2146 (1.20) 2.2146 (1.20) 0.0000 (1.0) 2.2146 (1.20) 0.0000 (1.0) 0;0 0.4515 (0.84) 1 1
test_sharing_gs-push[main] 3.6202 (1.95) 3.6202 (1.95) 3.6202 (1.95) 0.0000 (1.0) 3.6202 (1.95) 0.0000 (1.0) 0;0 0.2762 (0.51) 1 1
test_sharing_gs-push[main] 3.6126 (1.95) 3.6126 (1.95) 3.6126 (1.95) 0.0000 (1.0) 3.6126 (1.95) 0.0000 (1.0) 0;0 0.2768 (0.51) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.11.0] 463.6795 (1.01) 463.6795 (1.01) 463.6795 (1.01) 0.0000 (1.0) 463.6795 (1.01) 0.0000 (1.0) 0;0 2.1567 (0.99) 1 1
test_sharing_gs-push-noop[2.11.0] 457.1539 (1.0) 457.1539 (1.0) 457.1539 (1.0) 0.0000 (1.0) 457.1539 (1.0) 0.0000 (1.0) 0;0 2.1874 (1.0) 1 1
test_sharing_gs-push-noop[2.40.0] 495.0690 (1.08) 495.0690 (1.08) 495.0690 (1.08) 0.0000 (1.0) 495.0690 (1.08) 0.0000 (1.0) 0;0 2.0199 (0.92) 1 1
test_sharing_gs-push-noop[2.40.0] 494.9022 (1.08) 494.9022 (1.08) 494.9022 (1.08) 0.0000 (1.0) 494.9022 (1.08) 0.0000 (1.0) 0;0 2.0206 (0.92) 1 1
test_sharing_gs-push-noop[2.58.2] 552.4777 (1.21) 552.4777 (1.21) 552.4777 (1.21) 0.0000 (1.0) 552.4777 (1.21) 0.0000 (1.0) 0;0 1.8100 (0.83) 1 1
test_sharing_gs-push-noop[2.58.2] 555.3421 (1.21) 555.3421 (1.21) 555.3421 (1.21) 0.0000 (1.0) 555.3421 (1.21) 0.0000 (1.0) 0;0 1.8007 (0.82) 1 1
test_sharing_gs-push-noop[3.0.0] 546.8085 (1.20) 546.8085 (1.20) 546.8085 (1.20) 0.0000 (1.0) 546.8085 (1.20) 0.0000 (1.0) 0;0 1.8288 (0.84) 1 1
test_sharing_gs-push-noop[3.0.0] 834.5977 (1.83) 834.5977 (1.83) 834.5977 (1.83) 0.0000 (1.0) 834.5977 (1.83) 0.0000 (1.0) 0;0 1.1982 (0.55) 1 1
test_sharing_gs-push-noop[main] 553.7232 (1.21) 553.7232 (1.21) 553.7232 (1.21) 0.0000 (1.0) 553.7232 (1.21) 0.0000 (1.0) 0;0 1.8060 (0.83) 1 1
test_sharing_gs-push-noop[main] 549.7513 (1.20) 549.7513 (1.20) 549.7513 (1.20) 0.0000 (1.0) 549.7513 (1.20) 0.0000 (1.0) 0;0 1.8190 (0.83) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 2.2633 (1.56) 2.2633 (1.56) 2.2633 (1.56) 0.0000 (1.0) 2.2633 (1.56) 0.0000 (1.0) 0;0 0.4418 (0.64) 1 1
test_status-status[2.40.0] 1.4555 (1.0) 1.4555 (1.0) 1.4555 (1.0) 0.0000 (1.0) 1.4555 (1.0) 0.0000 (1.0) 0;0 0.6871 (1.0) 1 1
test_status-status[2.58.2] 1.4785 (1.02) 1.4785 (1.02) 1.4785 (1.02) 0.0000 (1.0) 1.4785 (1.02) 0.0000 (1.0) 0;0 0.6764 (0.98) 1 1
test_status-status[3.0.0] 1.4653 (1.01) 1.4653 (1.01) 1.4653 (1.01) 0.0000 (1.0) 1.4653 (1.01) 0.0000 (1.0) 0;0 0.6825 (0.99) 1 1
test_status-status[main] 1.4920 (1.03) 1.4920 (1.03) 1.4920 (1.03) 0.0000 (1.0) 1.4920 (1.03) 0.0000 (1.0) 0;0 0.6702 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 1.6119 (2.74) 1.6119 (2.74) 1.6119 (2.74) 0.0000 (1.0) 1.6119 (2.74) 0.0000 (1.0) 0;0 0.6204 (0.37) 1 1
test_status-status-changed[2.40.0] 0.5886 (1.0) 0.5886 (1.0) 0.5886 (1.0) 0.0000 (1.0) 0.5886 (1.0) 0.0000 (1.0) 0;0 1.6989 (1.0) 1 1
test_status-status-changed[2.58.2] 0.6552 (1.11) 0.6552 (1.11) 0.6552 (1.11) 0.0000 (1.0) 0.6552 (1.11) 0.0000 (1.0) 0;0 1.5263 (0.90) 1 1
test_status-status-changed[3.0.0] 0.6459 (1.10) 0.6459 (1.10) 0.6459 (1.10) 0.0000 (1.0) 0.6459 (1.10) 0.0000 (1.0) 0;0 1.5482 (0.91) 1 1
test_status-status-changed[main] 0.6435 (1.09) 0.6435 (1.09) 0.6435 (1.09) 0.0000 (1.0) 0.6435 (1.09) 0.0000 (1.0) 0;0 1.5539 (0.91) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 701.9442 (1.20) 701.9442 (1.20) 701.9442 (1.20) 0.0000 (1.0) 701.9442 (1.20) 0.0000 (1.0) 0;0 1.4246 (0.83) 1 1
test_status-status-changed-noop[2.40.0] 585.7790 (1.0) 585.7790 (1.0) 585.7790 (1.0) 0.0000 (1.0) 585.7790 (1.0) 0.0000 (1.0) 0;0 1.7071 (1.0) 1 1
test_status-status-changed-noop[2.58.2] 652.5088 (1.11) 652.5088 (1.11) 652.5088 (1.11) 0.0000 (1.0) 652.5088 (1.11) 0.0000 (1.0) 0;0 1.5325 (0.90) 1 1
test_status-status-changed-noop[3.0.0] 640.6660 (1.09) 640.6660 (1.09) 640.6660 (1.09) 0.0000 (1.0) 640.6660 (1.09) 0.0000 (1.0) 0;0 1.5609 (0.91) 1 1
test_status-status-changed-noop[main] 650.7858 (1.11) 650.7858 (1.11) 650.7858 (1.11) 0.0000 (1.0) 650.7858 (1.11) 0.0000 (1.0) 0;0 1.5366 (0.90) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 455.5680 (1.0) 455.5680 (1.0) 455.5680 (1.0) 0.0000 (1.0) 455.5680 (1.0) 0.0000 (1.0) 0;0 2.1951 (1.0) 1 1
test_status-status-noop[2.40.0] 581.1773 (1.28) 581.1773 (1.28) 581.1773 (1.28) 0.0000 (1.0) 581.1773 (1.28) 0.0000 (1.0) 0;0 1.7206 (0.78) 1 1
test_status-status-noop[2.58.2] 837.0256 (1.84) 837.0256 (1.84) 837.0256 (1.84) 0.0000 (1.0) 837.0256 (1.84) 0.0000 (1.0) 0;0 1.1947 (0.54) 1 1
test_status-status-noop[3.0.0] 985.9588 (2.16) 985.9588 (2.16) 985.9588 (2.16) 0.0000 (1.0) 985.9588 (2.16) 0.0000 (1.0) 0;0 1.0142 (0.46) 1 1
test_status-status-noop[main] 651.0807 (1.43) 651.0807 (1.43) 651.0807 (1.43) 0.0000 (1.0) 651.0807 (1.43) 0.0000 (1.0) 0;0 1.5359 (0.70) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.11.0] 5.3276 (1.77) 5.3276 (1.77) 5.3276 (1.77) 0.0000 (1.0) 5.3276 (1.77) 0.0000 (1.0) 0;0 0.1877 (0.56) 1 1
test_partial_add-add[2.40.0] 4.4066 (1.47) 4.4066 (1.47) 4.4066 (1.47) 0.0000 (1.0) 4.4066 (1.47) 0.0000 (1.0) 0;0 0.2269 (0.68) 1 1
test_partial_add-add[2.58.2] 3.0073 (1.0) 3.0073 (1.0) 3.0073 (1.0) 0.0000 (1.0) 3.0073 (1.0) 0.0000 (1.0) 0;0 0.3325 (1.0) 1 1
test_partial_add-add[3.0.0] 3.0946 (1.03) 3.0946 (1.03) 3.0946 (1.03) 0.0000 (1.0) 3.0946 (1.03) 0.0000 (1.0) 0;0 0.3231 (0.97) 1 1
test_partial_add-add[main] 3.0732 (1.02) 3.0732 (1.02) 3.0732 (1.02) 0.0000 (1.0) 3.0732 (1.02) 0.0000 (1.0) 0;0 0.3254 (0.98) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.11.0] 8.0096 (1.82) 8.0096 (1.82) 8.0096 (1.82) 0.0000 (1.0) 8.0096 (1.82) 0.0000 (1.0) 0;0 0.1249 (0.55) 1 1
test_partial_add-add-partial[2.40.0] 5.6535 (1.29) 5.6535 (1.29) 5.6535 (1.29) 0.0000 (1.0) 5.6535 (1.29) 0.0000 (1.0) 0;0 0.1769 (0.78) 1 1
test_partial_add-add-partial[2.58.2] 4.3934 (1.0) 4.3934 (1.0) 4.3934 (1.0) 0.0000 (1.0) 4.3934 (1.0) 0.0000 (1.0) 0;0 0.2276 (1.0) 1 1
test_partial_add-add-partial[3.0.0] 4.5156 (1.03) 4.5156 (1.03) 4.5156 (1.03) 0.0000 (1.0) 4.5156 (1.03) 0.0000 (1.0) 0;0 0.2215 (0.97) 1 1
test_partial_add-add-partial[main] 4.5787 (1.04) 4.5787 (1.04) 4.5787 (1.04) 0.0000 (1.0) 4.5787 (1.04) 0.0000 (1.0) 0;0 0.2184 (0.96) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 591.2692 (1.0) 591.2692 (1.0) 591.2692 (1.0) 0.0000 (1.0) 591.2692 (1.0) 0.0000 (1.0) 0;0 1.6913 (1.0) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 715.2538 (1.21) 715.2538 (1.21) 715.2538 (1.21) 0.0000 (1.0) 715.2538 (1.21) 0.0000 (1.0) 0;0 1.3981 (0.83) 1 1
test_partial_add-gc-cloud-noop[2.58.2] 820.8392 (1.39) 820.8392 (1.39) 820.8392 (1.39) 0.0000 (1.0) 820.8392 (1.39) 0.0000 (1.0) 0;0 1.2183 (0.72) 1 1
test_partial_add-gc-cloud-noop[3.0.0] 925.4439 (1.57) 925.4439 (1.57) 925.4439 (1.57) 0.0000 (1.0) 925.4439 (1.57) 0.0000 (1.0) 0;0 1.0806 (0.64) 1 1
test_partial_add-gc-cloud-noop[main] 951.8827 (1.61) 951.8827 (1.61) 951.8827 (1.61) 0.0000 (1.0) 951.8827 (1.61) 0.0000 (1.0) 0;0 1.0505 (0.62) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 535.2301 (1.0) 535.2301 (1.0) 535.2301 (1.0) 0.0000 (1.0) 535.2301 (1.0) 0.0000 (1.0) 0;0 1.8684 (1.0) 1 1
test_partial_add-gc-noop[2.40.0] 623.4879 (1.16) 623.4879 (1.16) 623.4879 (1.16) 0.0000 (1.0) 623.4879 (1.16) 0.0000 (1.0) 0;0 1.6039 (0.86) 1 1
test_partial_add-gc-noop[2.58.2] 707.5312 (1.32) 707.5312 (1.32) 707.5312 (1.32) 0.0000 (1.0) 707.5312 (1.32) 0.0000 (1.0) 0;0 1.4134 (0.76) 1 1
test_partial_add-gc-noop[3.0.0] 781.5640 (1.46) 781.5640 (1.46) 781.5640 (1.46) 0.0000 (1.0) 781.5640 (1.46) 0.0000 (1.0) 0;0 1.2795 (0.68) 1 1
test_partial_add-gc-noop[main] 830.1398 (1.55) 830.1398 (1.55) 830.1398 (1.55) 0.0000 (1.0) 830.1398 (1.55) 0.0000 (1.0) 0;0 1.2046 (0.64) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.11.0] 2.8539 (1.88) 2.8539 (1.88) 2.8539 (1.88) 0.0000 (1.0) 2.8539 (1.88) 0.0000 (1.0) 0;0 0.3504 (0.53) 1 1
test_partial_add-push[2.40.0] 3.6455 (2.40) 3.6455 (2.40) 3.6455 (2.40) 0.0000 (1.0) 3.6455 (2.40) 0.0000 (1.0) 0;0 0.2743 (0.42) 1 1
test_partial_add-push[2.58.2] 2.7227 (1.80) 2.7227 (1.80) 2.7227 (1.80) 0.0000 (1.0) 2.7227 (1.80) 0.0000 (1.0) 0;0 0.3673 (0.56) 1 1
test_partial_add-push[3.0.0] 1.5166 (1.0) 1.5166 (1.0) 1.5166 (1.0) 0.0000 (1.0) 1.5166 (1.0) 0.0000 (1.0) 0;0 0.6594 (1.0) 1 1
test_partial_add-push[main] 2.6074 (1.72) 2.6074 (1.72) 2.6074 (1.72) 0.0000 (1.0) 2.6074 (1.72) 0.0000 (1.0) 0;0 0.3835 (0.58) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.11.0] 3.1658 (1.93) 3.1658 (1.93) 3.1658 (1.93) 0.0000 (1.0) 3.1658 (1.93) 0.0000 (1.0) 0;0 0.3159 (0.52) 1 1
test_partial_add-push-partial[2.40.0] 3.6074 (2.20) 3.6074 (2.20) 3.6074 (2.20) 0.0000 (1.0) 3.6074 (2.20) 0.0000 (1.0) 0;0 0.2772 (0.46) 1 1
test_partial_add-push-partial[2.58.2] 2.7808 (1.69) 2.7808 (1.69) 2.7808 (1.69) 0.0000 (1.0) 2.7808 (1.69) 0.0000 (1.0) 0;0 0.3596 (0.59) 1 1
test_partial_add-push-partial[3.0.0] 1.6427 (1.0) 1.6427 (1.0) 1.6427 (1.0) 0.0000 (1.0) 1.6427 (1.0) 0.0000 (1.0) 0;0 0.6087 (1.0) 1 1
test_partial_add-push-partial[main] 2.7864 (1.70) 2.7864 (1.70) 2.7864 (1.70) 0.0000 (1.0) 2.7864 (1.70) 0.0000 (1.0) 0;0 0.3589 (0.59) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.40.0] 690.7483 (1.06) 690.7483 (1.06) 690.7483 (1.06) 0.0000 (1.0) 690.7483 (1.06) 0.0000 (1.0) 0;0 1.4477 (0.94) 1 1
test_data_status-data-changed[2.58.2] 672.7781 (1.03) 672.7781 (1.03) 672.7781 (1.03) 0.0000 (1.0) 672.7781 (1.03) 0.0000 (1.0) 0;0 1.4864 (0.97) 1 1
test_data_status-data-changed[3.0.0] 674.2104 (1.04) 674.2104 (1.04) 674.2104 (1.04) 0.0000 (1.0) 674.2104 (1.04) 0.0000 (1.0) 0;0 1.4832 (0.97) 1 1
test_data_status-data-changed[main] 650.7533 (1.0) 650.7533 (1.0) 650.7533 (1.0) 0.0000 (1.0) 650.7533 (1.0) 0.0000 (1.0) 0;0 1.5367 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.40.0] 691.7411 (1.06) 691.7411 (1.06) 691.7411 (1.06) 0.0000 (1.0) 691.7411 (1.06) 0.0000 (1.0) 0;0 1.4456 (0.94) 1 1
test_data_status-data-changed-noop[2.58.2] 676.0341 (1.04) 676.0341 (1.04) 676.0341 (1.04) 0.0000 (1.0) 676.0341 (1.04) 0.0000 (1.0) 0;0 1.4792 (0.96) 1 1
test_data_status-data-changed-noop[3.0.0] 680.0992 (1.05) 680.0992 (1.05) 680.0992 (1.05) 0.0000 (1.0) 680.0992 (1.05) 0.0000 (1.0) 0;0 1.4704 (0.96) 1 1
test_data_status-data-changed-noop[main] 650.0524 (1.0) 650.0524 (1.0) 650.0524 (1.0) 0.0000 (1.0) 650.0524 (1.0) 0.0000 (1.0) 0;0 1.5383 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.40.0] 1.4974 (1.09) 1.4974 (1.09) 1.4974 (1.09) 0.0000 (1.0) 1.4974 (1.09) 0.0000 (1.0) 0;0 0.6678 (0.91) 1 1
test_data_status-data-new[2.58.2] 1.4063 (1.03) 1.4063 (1.03) 1.4063 (1.03) 0.0000 (1.0) 1.4063 (1.03) 0.0000 (1.0) 0;0 0.7111 (0.97) 1 1
test_data_status-data-new[3.0.0] 1.4321 (1.05) 1.4321 (1.05) 1.4321 (1.05) 0.0000 (1.0) 1.4321 (1.05) 0.0000 (1.0) 0;0 0.6983 (0.96) 1 1
test_data_status-data-new[main] 1.3678 (1.0) 1.3678 (1.0) 1.3678 (1.0) 0.0000 (1.0) 1.3678 (1.0) 0.0000 (1.0) 0;0 0.7311 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.40.0] 679.8799 (1.04) 679.8799 (1.04) 679.8799 (1.04) 0.0000 (1.0) 679.8799 (1.04) 0.0000 (1.0) 0;0 1.4708 (0.96) 1 1
test_data_status-data-noop[2.58.2] 680.4217 (1.04) 680.4217 (1.04) 680.4217 (1.04) 0.0000 (1.0) 680.4217 (1.04) 0.0000 (1.0) 0;0 1.4697 (0.96) 1 1
test_data_status-data-noop[3.0.0] 678.4701 (1.04) 678.4701 (1.04) 678.4701 (1.04) 0.0000 (1.0) 678.4701 (1.04) 0.0000 (1.0) 0;0 1.4739 (0.96) 1 1
test_data_status-data-noop[main] 651.4721 (1.0) 651.4721 (1.0) 651.4721 (1.0) 0.0000 (1.0) 651.4721 (1.0) 0.0000 (1.0) 0;0 1.5350 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 2.1062 (1.21) 2.1062 (1.21) 2.1062 (1.21) 0.0000 (1.0) 2.1062 (1.21) 0.0000 (1.0) 0;0 0.4748 (0.83) 1 1
test_diff-diff[2.40.0] 1.8037 (1.03) 1.8037 (1.03) 1.8037 (1.03) 0.0000 (1.0) 1.8037 (1.03) 0.0000 (1.0) 0;0 0.5544 (0.97) 1 1
test_diff-diff[2.58.2] 1.7453 (1.0) 1.7453 (1.0) 1.7453 (1.0) 0.0000 (1.0) 1.7453 (1.0) 0.0000 (1.0) 0;0 0.5730 (1.0) 1 1
test_diff-diff[3.0.0] 1.7626 (1.01) 1.7626 (1.01) 1.7626 (1.01) 0.0000 (1.0) 1.7626 (1.01) 0.0000 (1.0) 0;0 0.5673 (0.99) 1 1
test_diff-diff[main] 1.8918 (1.08) 1.8918 (1.08) 1.8918 (1.08) 0.0000 (1.0) 1.8918 (1.08) 0.0000 (1.0) 0;0 0.5286 (0.92) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.4207 (1.72) 1.4207 (1.72) 1.4207 (1.72) 0.0000 (1.0) 1.4207 (1.72) 0.0000 (1.0) 0;0 0.7039 (0.58) 1 1
test_diff-diff-changed[2.40.0] 0.8262 (1.0) 0.8262 (1.0) 0.8262 (1.0) 0.0000 (1.0) 0.8262 (1.0) 0.0000 (1.0) 0;0 1.2104 (1.0) 1 1
test_diff-diff-changed[2.58.2] 0.9220 (1.12) 0.9220 (1.12) 0.9220 (1.12) 0.0000 (1.0) 0.9220 (1.12) 0.0000 (1.0) 0;0 1.0846 (0.90) 1 1
test_diff-diff-changed[3.0.0] 0.9481 (1.15) 0.9481 (1.15) 0.9481 (1.15) 0.0000 (1.0) 0.9481 (1.15) 0.0000 (1.0) 0;0 1.0548 (0.87) 1 1
test_diff-diff-changed[main] 0.8837 (1.07) 0.8837 (1.07) 0.8837 (1.07) 0.0000 (1.0) 0.8837 (1.07) 0.0000 (1.0) 0;0 1.1316 (0.93) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 627.8763 (1.0) 627.8763 (1.0) 627.8763 (1.0) 0.0000 (1.0) 627.8763 (1.0) 0.0000 (1.0) 0;0 1.5927 (1.0) 1 1
test_diff-diff-changed-noop[2.40.0] 842.6013 (1.34) 842.6013 (1.34) 842.6013 (1.34) 0.0000 (1.0) 842.6013 (1.34) 0.0000 (1.0) 0;0 1.1868 (0.75) 1 1
test_diff-diff-changed-noop[2.58.2] 874.2403 (1.39) 874.2403 (1.39) 874.2403 (1.39) 0.0000 (1.0) 874.2403 (1.39) 0.0000 (1.0) 0;0 1.1439 (0.72) 1 1
test_diff-diff-changed-noop[3.0.0] 892.9853 (1.42) 892.9853 (1.42) 892.9853 (1.42) 0.0000 (1.0) 892.9853 (1.42) 0.0000 (1.0) 0;0 1.1198 (0.70) 1 1
test_diff-diff-changed-noop[main] 887.0971 (1.41) 887.0971 (1.41) 887.0971 (1.41) 0.0000 (1.0) 887.0971 (1.41) 0.0000 (1.0) 0;0 1.1273 (0.71) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 573.3006 (1.0) 573.3006 (1.0) 573.3006 (1.0) 0.0000 (1.0) 573.3006 (1.0) 0.0000 (1.0) 0;0 1.7443 (1.0) 1 1
test_diff-diff-noop[2.40.0] 782.0028 (1.36) 782.0028 (1.36) 782.0028 (1.36) 0.0000 (1.0) 782.0028 (1.36) 0.0000 (1.0) 0;0 1.2788 (0.73) 1 1
test_diff-diff-noop[2.58.2] 807.4113 (1.41) 807.4113 (1.41) 807.4113 (1.41) 0.0000 (1.0) 807.4113 (1.41) 0.0000 (1.0) 0;0 1.2385 (0.71) 1 1
test_diff-diff-noop[3.0.0] 828.5514 (1.45) 828.5514 (1.45) 828.5514 (1.45) 0.0000 (1.0) 828.5514 (1.45) 0.0000 (1.0) 0;0 1.2069 (0.69) 1 1
test_diff-diff-noop[main] 875.4415 (1.53) 875.4415 (1.53) 875.4415 (1.53) 0.0000 (1.0) 875.4415 (1.53) 0.0000 (1.0) 0;0 1.1423 (0.65) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 7.3675 (1.78) 7.3675 (1.78) 7.3675 (1.78) 0.0000 (1.0) 7.3675 (1.78) 0.0000 (1.0) 0;0 0.1357 (0.56) 1 1
test_sharing-add[2.40.0] 6.2304 (1.50) 6.2304 (1.50) 6.2304 (1.50) 0.0000 (1.0) 6.2304 (1.50) 0.0000 (1.0) 0;0 0.1605 (0.67) 1 1
test_sharing-add[2.58.2] 4.4714 (1.08) 4.4714 (1.08) 4.4714 (1.08) 0.0000 (1.0) 4.4714 (1.08) 0.0000 (1.0) 0;0 0.2236 (0.93) 1 1
test_sharing-add[3.0.0] 4.1457 (1.0) 4.1457 (1.0) 4.1457 (1.0) 0.0000 (1.0) 4.1457 (1.0) 0.0000 (1.0) 0;0 0.2412 (1.0) 1 1
test_sharing-add[main] 4.1540 (1.00) 4.1540 (1.00) 4.1540 (1.00) 0.0000 (1.0) 4.1540 (1.00) 0.0000 (1.0) 0;0 0.2407 (1.00) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 3.5261 (1.39) 3.5261 (1.39) 3.5261 (1.39) 0.0000 (1.0) 3.5261 (1.39) 0.0000 (1.0) 0;0 0.2836 (0.72) 1 1
test_sharing-add-noop[2.40.0] 2.5404 (1.0) 2.5404 (1.0) 2.5404 (1.0) 0.0000 (1.0) 2.5404 (1.0) 0.0000 (1.0) 0;0 0.3936 (1.0) 1 1
test_sharing-add-noop[2.58.2] 2.7599 (1.09) 2.7599 (1.09) 2.7599 (1.09) 0.0000 (1.0) 2.7599 (1.09) 0.0000 (1.0) 0;0 0.3623 (0.92) 1 1
test_sharing-add-noop[3.0.0] 2.7942 (1.10) 2.7942 (1.10) 2.7942 (1.10) 0.0000 (1.0) 2.7942 (1.10) 0.0000 (1.0) 0;0 0.3579 (0.91) 1 1
test_sharing-add-noop[main] 2.7803 (1.09) 2.7803 (1.09) 2.7803 (1.09) 0.0000 (1.0) 2.7803 (1.09) 0.0000 (1.0) 0;0 0.3597 (0.91) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 576.6678 (1.0) 576.6678 (1.0) 576.6678 (1.0) 0.0000 (1.0) 576.6678 (1.0) 0.0000 (1.0) 0;0 1.7341 (1.0) 1 1
test_sharing-checkout-noop[2.40.0] 606.3782 (1.05) 606.3782 (1.05) 606.3782 (1.05) 0.0000 (1.0) 606.3782 (1.05) 0.0000 (1.0) 0;0 1.6491 (0.95) 1 1
test_sharing-checkout-noop[2.58.2] 677.6125 (1.18) 677.6125 (1.18) 677.6125 (1.18) 0.0000 (1.0) 677.6125 (1.18) 0.0000 (1.0) 0;0 1.4758 (0.85) 1 1
test_sharing-checkout-noop[3.0.0] 708.2724 (1.23) 708.2724 (1.23) 708.2724 (1.23) 0.0000 (1.0) 708.2724 (1.23) 0.0000 (1.0) 0;0 1.4119 (0.81) 1 1
test_sharing-checkout-noop[main] 686.0323 (1.19) 686.0323 (1.19) 686.0323 (1.19) 0.0000 (1.0) 686.0323 (1.19) 0.0000 (1.0) 0;0 1.4577 (0.84) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-pull': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 7.3169 (1.33) 7.3169 (1.33) 7.3169 (1.33) 0.0000 (1.0) 7.3169 (1.33) 0.0000 (1.0) 0;0 0.1367 (0.75) 1 1
test_sharing-pull[2.40.0] 8.8109 (1.61) 8.8109 (1.61) 8.8109 (1.61) 0.0000 (1.0) 8.8109 (1.61) 0.0000 (1.0) 0;0 0.1135 (0.62) 1 1
test_sharing-pull[2.58.2] 5.4830 (1.0) 5.4830 (1.0) 5.4830 (1.0) 0.0000 (1.0) 5.4830 (1.0) 0.0000 (1.0) 0;0 0.1824 (1.0) 1 1
test_sharing-pull[3.0.0] 7.9335 (1.45) 7.9335 (1.45) 7.9335 (1.45) 0.0000 (1.0) 7.9335 (1.45) 0.0000 (1.0) 0;0 0.1260 (0.69) 1 1
test_sharing-pull[main] 7.8470 (1.43) 7.8470 (1.43) 7.8470 (1.43) 0.0000 (1.0) 7.8470 (1.43) 0.0000 (1.0) 0;0 0.1274 (0.70) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 539.3263 (1.0) 539.3263 (1.0) 539.3263 (1.0) 0.0000 (1.0) 539.3263 (1.0) 0.0000 (1.0) 0;0 1.8542 (1.0) 1 1
test_sharing-pull-noop[2.40.0] 645.4329 (1.20) 645.4329 (1.20) 645.4329 (1.20) 0.0000 (1.0) 645.4329 (1.20) 0.0000 (1.0) 0;0 1.5493 (0.84) 1 1
test_sharing-pull-noop[2.58.2] 722.5859 (1.34) 722.5859 (1.34) 722.5859 (1.34) 0.0000 (1.0) 722.5859 (1.34) 0.0000 (1.0) 0;0 1.3839 (0.75) 1 1
test_sharing-pull-noop[3.0.0] 847.2679 (1.57) 847.2679 (1.57) 847.2679 (1.57) 0.0000 (1.0) 847.2679 (1.57) 0.0000 (1.0) 0;0 1.1803 (0.64) 1 1
test_sharing-pull-noop[main] 839.5492 (1.56) 839.5492 (1.56) 839.5492 (1.56) 0.0000 (1.0) 839.5492 (1.56) 0.0000 (1.0) 0;0 1.1911 (0.64) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 4.0192 (2.23) 4.0192 (2.23) 4.0192 (2.23) 0.0000 (1.0) 4.0192 (2.23) 0.0000 (1.0) 0;0 0.2488 (0.45) 1 1
test_sharing-push[2.40.0] 5.1877 (2.88) 5.1877 (2.88) 5.1877 (2.88) 0.0000 (1.0) 5.1877 (2.88) 0.0000 (1.0) 0;0 0.1928 (0.35) 1 1
test_sharing-push[2.58.2] 3.5182 (1.95) 3.5182 (1.95) 3.5182 (1.95) 0.0000 (1.0) 3.5182 (1.95) 0.0000 (1.0) 0;0 0.2842 (0.51) 1 1
test_sharing-push[3.0.0] 1.8004 (1.0) 1.8004 (1.0) 1.8004 (1.0) 0.0000 (1.0) 1.8004 (1.0) 0.0000 (1.0) 0;0 0.5554 (1.0) 1 1
test_sharing-push[main] 3.5397 (1.97) 3.5397 (1.97) 3.5397 (1.97) 0.0000 (1.0) 3.5397 (1.97) 0.0000 (1.0) 0;0 0.2825 (0.51) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 455.4183 (1.0) 455.4183 (1.0) 455.4183 (1.0) 0.0000 (1.0) 455.4183 (1.0) 0.0000 (1.0) 0;0 2.1958 (1.0) 1 1
test_sharing-push-noop[2.40.0] 496.9643 (1.09) 496.9643 (1.09) 496.9643 (1.09) 0.0000 (1.0) 496.9643 (1.09) 0.0000 (1.0) 0;0 2.0122 (0.92) 1 1
test_sharing-push-noop[2.58.2] 544.4432 (1.20) 544.4432 (1.20) 544.4432 (1.20) 0.0000 (1.0) 544.4432 (1.20) 0.0000 (1.0) 0;0 1.8367 (0.84) 1 1
test_sharing-push-noop[3.0.0] 559.0920 (1.23) 559.0920 (1.23) 559.0920 (1.23) 0.0000 (1.0) 559.0920 (1.23) 0.0000 (1.0) 0;0 1.7886 (0.81) 1 1
test_sharing-push-noop[main] 539.2852 (1.18) 539.2852 (1.18) 539.2852 (1.18) 0.0000 (1.0) 539.2852 (1.18) 0.0000 (1.0) 0;0 1.8543 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 3.0321 (1.0) 3.0321 (1.0) 3.0321 (1.0) 0.0000 (1.0) 3.0321 (1.0) 0.0000 (1.0) 0;0 0.3298 (1.0) 1 1
test_get_url-get-url[2.40.0] 3.1084 (1.03) 3.1084 (1.03) 3.1084 (1.03) 0.0000 (1.0) 3.1084 (1.03) 0.0000 (1.0) 0;0 0.3217 (0.98) 1 1
test_get_url-get-url[2.58.2] 3.0772 (1.01) 3.0772 (1.01) 3.0772 (1.01) 0.0000 (1.0) 3.0772 (1.01) 0.0000 (1.0) 0;0 0.3250 (0.99) 1 1
test_get_url-get-url[3.0.0] 3.0542 (1.01) 3.0542 (1.01) 3.0542 (1.01) 0.0000 (1.0) 3.0542 (1.01) 0.0000 (1.0) 0;0 0.3274 (0.99) 1 1
test_get_url-get-url[main] 3.2002 (1.06) 3.2002 (1.06) 3.2002 (1.06) 0.0000 (1.0) 3.2002 (1.06) 0.0000 (1.0) 0;0 0.3125 (0.95) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0] 7.3448 (1.74) 7.3448 (1.74) 7.3448 (1.74) 0.0000 (1.0) 7.3448 (1.74) 0.0000 (1.0) 0;0 0.1362 (0.57) 1 1
test_sharing_s3-add[2.11.0] 7.5009 (1.78) 7.5009 (1.78) 7.5009 (1.78) 0.0000 (1.0) 7.5009 (1.78) 0.0000 (1.0) 0;0 0.1333 (0.56) 1 1
test_sharing_s3-add[2.40.0] 6.7661 (1.60) 6.7661 (1.60) 6.7661 (1.60) 0.0000 (1.0) 6.7661 (1.60) 0.0000 (1.0) 0;0 0.1478 (0.62) 1 1
test_sharing_s3-add[2.40.0] 6.6476 (1.58) 6.6476 (1.58) 6.6476 (1.58) 0.0000 (1.0) 6.6476 (1.58) 0.0000 (1.0) 0;0 0.1504 (0.63) 1 1
test_sharing_s3-add[2.58.2] 4.2180 (1.0) 4.2180 (1.0) 4.2180 (1.0) 0.0000 (1.0) 4.2180 (1.0) 0.0000 (1.0) 0;0 0.2371 (1.0) 1 1
test_sharing_s3-add[2.58.2] 4.6321 (1.10) 4.6321 (1.10) 4.6321 (1.10) 0.0000 (1.0) 4.6321 (1.10) 0.0000 (1.0) 0;0 0.2159 (0.91) 1 1
test_sharing_s3-add[3.0.0] 4.3972 (1.04) 4.3972 (1.04) 4.3972 (1.04) 0.0000 (1.0) 4.3972 (1.04) 0.0000 (1.0) 0;0 0.2274 (0.96) 1 1
test_sharing_s3-add[3.0.0] 4.4180 (1.05) 4.4180 (1.05) 4.4180 (1.05) 0.0000 (1.0) 4.4180 (1.05) 0.0000 (1.0) 0;0 0.2263 (0.95) 1 1
test_sharing_s3-add[main] 4.4889 (1.06) 4.4889 (1.06) 4.4889 (1.06) 0.0000 (1.0) 4.4889 (1.06) 0.0000 (1.0) 0;0 0.2228 (0.94) 1 1
test_sharing_s3-add[main] 4.3168 (1.02) 4.3168 (1.02) 4.3168 (1.02) 0.0000 (1.0) 4.3168 (1.02) 0.0000 (1.0) 0;0 0.2317 (0.98) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0] 3.6132 (1.38) 3.6132 (1.38) 3.6132 (1.38) 0.0000 (1.0) 3.6132 (1.38) 0.0000 (1.0) 0;0 0.2768 (0.73) 1 1
test_sharing_s3-add-noop[2.11.0] 3.5995 (1.37) 3.5995 (1.37) 3.5995 (1.37) 0.0000 (1.0) 3.5995 (1.37) 0.0000 (1.0) 0;0 0.2778 (0.73) 1 1
test_sharing_s3-add-noop[2.40.0] 2.8712 (1.09) 2.8712 (1.09) 2.8712 (1.09) 0.0000 (1.0) 2.8712 (1.09) 0.0000 (1.0) 0;0 0.3483 (0.91) 1 1
test_sharing_s3-add-noop[2.40.0] 2.6252 (1.0) 2.6252 (1.0) 2.6252 (1.0) 0.0000 (1.0) 2.6252 (1.0) 0.0000 (1.0) 0;0 0.3809 (1.0) 1 1
test_sharing_s3-add-noop[2.58.2] 2.8231 (1.08) 2.8231 (1.08) 2.8231 (1.08) 0.0000 (1.0) 2.8231 (1.08) 0.0000 (1.0) 0;0 0.3542 (0.93) 1 1
test_sharing_s3-add-noop[2.58.2] 2.7931 (1.06) 2.7931 (1.06) 2.7931 (1.06) 0.0000 (1.0) 2.7931 (1.06) 0.0000 (1.0) 0;0 0.3580 (0.94) 1 1
test_sharing_s3-add-noop[3.0.0] 2.9271 (1.12) 2.9271 (1.12) 2.9271 (1.12) 0.0000 (1.0) 2.9271 (1.12) 0.0000 (1.0) 0;0 0.3416 (0.90) 1 1
test_sharing_s3-add-noop[3.0.0] 2.8565 (1.09) 2.8565 (1.09) 2.8565 (1.09) 0.0000 (1.0) 2.8565 (1.09) 0.0000 (1.0) 0;0 0.3501 (0.92) 1 1
test_sharing_s3-add-noop[main] 2.9965 (1.14) 2.9965 (1.14) 2.9965 (1.14) 0.0000 (1.0) 2.9965 (1.14) 0.0000 (1.0) 0;0 0.3337 (0.88) 1 1
test_sharing_s3-add-noop[main] 2.7676 (1.05) 2.7676 (1.05) 2.7676 (1.05) 0.0000 (1.0) 2.7676 (1.05) 0.0000 (1.0) 0;0 0.3613 (0.95) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0] 492.0672 (1.0) 492.0672 (1.0) 492.0672 (1.0) 0.0000 (1.0) 492.0672 (1.0) 0.0000 (1.0) 0;0 2.0322 (1.0) 1 1
test_sharing_s3-checkout-noop[2.11.0] 547.0905 (1.11) 547.0905 (1.11) 547.0905 (1.11) 0.0000 (1.0) 547.0905 (1.11) 0.0000 (1.0) 0;0 1.8279 (0.90) 1 1
test_sharing_s3-checkout-noop[2.40.0] 660.3445 (1.34) 660.3445 (1.34) 660.3445 (1.34) 0.0000 (1.0) 660.3445 (1.34) 0.0000 (1.0) 0;0 1.5144 (0.75) 1 1
test_sharing_s3-checkout-noop[2.40.0] 586.5442 (1.19) 586.5442 (1.19) 586.5442 (1.19) 0.0000 (1.0) 586.5442 (1.19) 0.0000 (1.0) 0;0 1.7049 (0.84) 1 1
test_sharing_s3-checkout-noop[2.58.2] 758.6446 (1.54) 758.6446 (1.54) 758.6446 (1.54) 0.0000 (1.0) 758.6446 (1.54) 0.0000 (1.0) 0;0 1.3181 (0.65) 1 1
test_sharing_s3-checkout-noop[2.58.2] 675.8141 (1.37) 675.8141 (1.37) 675.8141 (1.37) 0.0000 (1.0) 675.8141 (1.37) 0.0000 (1.0) 0;0 1.4797 (0.73) 1 1
test_sharing_s3-checkout-noop[3.0.0] 894.7550 (1.82) 894.7550 (1.82) 894.7550 (1.82) 0.0000 (1.0) 894.7550 (1.82) 0.0000 (1.0) 0;0 1.1176 (0.55) 1 1
test_sharing_s3-checkout-noop[3.0.0] 844.2764 (1.72) 844.2764 (1.72) 844.2764 (1.72) 0.0000 (1.0) 844.2764 (1.72) 0.0000 (1.0) 0;0 1.1844 (0.58) 1 1
test_sharing_s3-checkout-noop[main] 721.5999 (1.47) 721.5999 (1.47) 721.5999 (1.47) 0.0000 (1.0) 721.5999 (1.47) 0.0000 (1.0) 0;0 1.3858 (0.68) 1 1
test_sharing_s3-checkout-noop[main] 678.1406 (1.38) 678.1406 (1.38) 678.1406 (1.38) 0.0000 (1.0) 678.1406 (1.38) 0.0000 (1.0) 0;0 1.4746 (0.73) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0] 13.5212 (1.18) 13.5212 (1.18) 13.5212 (1.18) 0.0000 (1.0) 13.5212 (1.18) 0.0000 (1.0) 0;0 0.0740 (0.84) 1 1
test_sharing_s3-pull[2.11.0] 14.6767 (1.29) 14.6767 (1.29) 14.6767 (1.29) 0.0000 (1.0) 14.6767 (1.29) 0.0000 (1.0) 0;0 0.0681 (0.78) 1 1
test_sharing_s3-pull[2.40.0] 16.3780 (1.43) 16.3780 (1.43) 16.3780 (1.43) 0.0000 (1.0) 16.3780 (1.43) 0.0000 (1.0) 0;0 0.0611 (0.70) 1 1
test_sharing_s3-pull[2.40.0] 14.5805 (1.28) 14.5805 (1.28) 14.5805 (1.28) 0.0000 (1.0) 14.5805 (1.28) 0.0000 (1.0) 0;0 0.0686 (0.78) 1 1
test_sharing_s3-pull[2.58.2] 11.9184 (1.04) 11.9184 (1.04) 11.9184 (1.04) 0.0000 (1.0) 11.9184 (1.04) 0.0000 (1.0) 0;0 0.0839 (0.96) 1 1
test_sharing_s3-pull[2.58.2] 11.4155 (1.0) 11.4155 (1.0) 11.4155 (1.0) 0.0000 (1.0) 11.4155 (1.0) 0.0000 (1.0) 0;0 0.0876 (1.0) 1 1
test_sharing_s3-pull[3.0.0] 13.1116 (1.15) 13.1116 (1.15) 13.1116 (1.15) 0.0000 (1.0) 13.1116 (1.15) 0.0000 (1.0) 0;0 0.0763 (0.87) 1 1
test_sharing_s3-pull[3.0.0] 14.0089 (1.23) 14.0089 (1.23) 14.0089 (1.23) 0.0000 (1.0) 14.0089 (1.23) 0.0000 (1.0) 0;0 0.0714 (0.81) 1 1
test_sharing_s3-pull[main] 14.1740 (1.24) 14.1740 (1.24) 14.1740 (1.24) 0.0000 (1.0) 14.1740 (1.24) 0.0000 (1.0) 0;0 0.0706 (0.81) 1 1
test_sharing_s3-pull[main] 13.0946 (1.15) 13.0946 (1.15) 13.0946 (1.15) 0.0000 (1.0) 13.0946 (1.15) 0.0000 (1.0) 0;0 0.0764 (0.87) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0] 716.4683 (1.0) 716.4683 (1.0) 716.4683 (1.0) 0.0000 (1.0) 716.4683 (1.0) 0.0000 (1.0) 0;0 1.3957 (1.0) 1 1
test_sharing_s3-pull-noop[2.11.0] 813.3320 (1.14) 813.3320 (1.14) 813.3320 (1.14) 0.0000 (1.0) 813.3320 (1.14) 0.0000 (1.0) 0;0 1.2295 (0.88) 1 1
test_sharing_s3-pull-noop[2.40.0] 964.4970 (1.35) 964.4970 (1.35) 964.4970 (1.35) 0.0000 (1.0) 964.4970 (1.35) 0.0000 (1.0) 0;0 1.0368 (0.74) 1 1
test_sharing_s3-pull-noop[2.40.0] 802.4518 (1.12) 802.4518 (1.12) 802.4518 (1.12) 0.0000 (1.0) 802.4518 (1.12) 0.0000 (1.0) 0;0 1.2462 (0.89) 1 1
test_sharing_s3-pull-noop[2.58.2] 1,016.4230 (1.42) 1,016.4230 (1.42) 1,016.4230 (1.42) 0.0000 (1.0) 1,016.4230 (1.42) 0.0000 (1.0) 0;0 0.9838 (0.70) 1 1
test_sharing_s3-pull-noop[2.58.2] 931.2339 (1.30) 931.2339 (1.30) 931.2339 (1.30) 0.0000 (1.0) 931.2339 (1.30) 0.0000 (1.0) 0;0 1.0738 (0.77) 1 1
test_sharing_s3-pull-noop[3.0.0] 1,188.0863 (1.66) 1,188.0863 (1.66) 1,188.0863 (1.66) 0.0000 (1.0) 1,188.0863 (1.66) 0.0000 (1.0) 0;0 0.8417 (0.60) 1 1
test_sharing_s3-pull-noop[3.0.0] 1,105.6893 (1.54) 1,105.6893 (1.54) 1,105.6893 (1.54) 0.0000 (1.0) 1,105.6893 (1.54) 0.0000 (1.0) 0;0 0.9044 (0.65) 1 1
test_sharing_s3-pull-noop[main] 1,554.4384 (2.17) 1,554.4384 (2.17) 1,554.4384 (2.17) 0.0000 (1.0) 1,554.4384 (2.17) 0.0000 (1.0) 0;0 0.6433 (0.46) 1 1
test_sharing_s3-pull-noop[main] 1,334.6879 (1.86) 1,334.6879 (1.86) 1,334.6879 (1.86) 0.0000 (1.0) 1,334.6879 (1.86) 0.0000 (1.0) 0;0 0.7492 (0.54) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0] 23.0281 (2.88) 23.0281 (2.88) 23.0281 (2.88) 0.0000 (1.0) 23.0281 (2.88) 0.0000 (1.0) 0;0 0.0434 (0.35) 1 1
test_sharing_s3-push[2.11.0] 22.9613 (2.87) 22.9613 (2.87) 22.9613 (2.87) 0.0000 (1.0) 22.9613 (2.87) 0.0000 (1.0) 0;0 0.0436 (0.35) 1 1
test_sharing_s3-push[2.40.0] 23.7415 (2.97) 23.7415 (2.97) 23.7415 (2.97) 0.0000 (1.0) 23.7415 (2.97) 0.0000 (1.0) 0;0 0.0421 (0.34) 1 1
test_sharing_s3-push[2.40.0] 23.2362 (2.91) 23.2362 (2.91) 23.2362 (2.91) 0.0000 (1.0) 23.2362 (2.91) 0.0000 (1.0) 0;0 0.0430 (0.34) 1 1
test_sharing_s3-push[2.58.2] 9.9571 (1.25) 9.9571 (1.25) 9.9571 (1.25) 0.0000 (1.0) 9.9571 (1.25) 0.0000 (1.0) 0;0 0.1004 (0.80) 1 1
test_sharing_s3-push[2.58.2] 9.8040 (1.23) 9.8040 (1.23) 9.8040 (1.23) 0.0000 (1.0) 9.8040 (1.23) 0.0000 (1.0) 0;0 0.1020 (0.82) 1 1
test_sharing_s3-push[3.0.0] 7.9951 (1.0) 7.9951 (1.0) 7.9951 (1.0) 0.0000 (1.0) 7.9951 (1.0) 0.0000 (1.0) 0;0 0.1251 (1.0) 1 1
test_sharing_s3-push[3.0.0] 8.3306 (1.04) 8.3306 (1.04) 8.3306 (1.04) 0.0000 (1.0) 8.3306 (1.04) 0.0000 (1.0) 0;0 0.1200 (0.96) 1 1
test_sharing_s3-push[main] 10.2323 (1.28) 10.2323 (1.28) 10.2323 (1.28) 0.0000 (1.0) 10.2323 (1.28) 0.0000 (1.0) 0;0 0.0977 (0.78) 1 1
test_sharing_s3-push[main] 9.5714 (1.20) 9.5714 (1.20) 9.5714 (1.20) 0.0000 (1.0) 9.5714 (1.20) 0.0000 (1.0) 0;0 0.1045 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0] 1.0076 (1.03) 1.0076 (1.03) 1.0076 (1.03) 0.0000 (1.0) 1.0076 (1.03) 0.0000 (1.0) 0;0 0.9925 (0.97) 1 1
test_sharing_s3-push-noop[2.11.0] 1.0620 (1.08) 1.0620 (1.08) 1.0620 (1.08) 0.0000 (1.0) 1.0620 (1.08) 0.0000 (1.0) 0;0 0.9416 (0.92) 1 1
test_sharing_s3-push-noop[2.40.0] 1.0826 (1.10) 1.0826 (1.10) 1.0826 (1.10) 0.0000 (1.0) 1.0826 (1.10) 0.0000 (1.0) 0;0 0.9237 (0.91) 1 1
test_sharing_s3-push-noop[2.40.0] 0.9799 (1.0) 0.9799 (1.0) 0.9799 (1.0) 0.0000 (1.0) 0.9799 (1.0) 0.0000 (1.0) 0;0 1.0205 (1.0) 1 1
test_sharing_s3-push-noop[2.58.2] 1.1821 (1.21) 1.1821 (1.21) 1.1821 (1.21) 0.0000 (1.0) 1.1821 (1.21) 0.0000 (1.0) 0;0 0.8459 (0.83) 1 1
test_sharing_s3-push-noop[2.58.2] 1.1469 (1.17) 1.1469 (1.17) 1.1469 (1.17) 0.0000 (1.0) 1.1469 (1.17) 0.0000 (1.0) 0;0 0.8720 (0.85) 1 1
test_sharing_s3-push-noop[3.0.0] 1.0611 (1.08) 1.0611 (1.08) 1.0611 (1.08) 0.0000 (1.0) 1.0611 (1.08) 0.0000 (1.0) 0;0 0.9425 (0.92) 1 1
test_sharing_s3-push-noop[3.0.0] 1.1341 (1.16) 1.1341 (1.16) 1.1341 (1.16) 0.0000 (1.0) 1.1341 (1.16) 0.0000 (1.0) 0;0 0.8818 (0.86) 1 1
test_sharing_s3-push-noop[main] 1.2055 (1.23) 1.2055 (1.23) 1.2055 (1.23) 0.0000 (1.0) 1.2055 (1.23) 0.0000 (1.0) 0;0 0.8295 (0.81) 1 1
test_sharing_s3-push-noop[main] 1.0675 (1.09) 1.0675 (1.09) 1.0675 (1.09) 0.0000 (1.0) 1.0675 (1.09) 0.0000 (1.0) 0;0 0.9367 (0.92) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.11.0] 9.6929 (2.06) 9.6929 (2.06) 9.6929 (2.06) 0.0000 (1.0) 9.6929 (2.06) 0.0000 (1.0) 0;0 0.1032 (0.49) 1 1
test_sharing_azure-add[2.11.0] 8.9714 (1.91) 8.9714 (1.91) 8.9714 (1.91) 0.0000 (1.0) 8.9714 (1.91) 0.0000 (1.0) 0;0 0.1115 (0.52) 1 1
test_sharing_azure-add[2.40.0] 9.1045 (1.93) 9.1045 (1.93) 9.1045 (1.93) 0.0000 (1.0) 9.1045 (1.93) 0.0000 (1.0) 0;0 0.1098 (0.52) 1 1
test_sharing_azure-add[2.40.0] 8.5223 (1.81) 8.5223 (1.81) 8.5223 (1.81) 0.0000 (1.0) 8.5223 (1.81) 0.0000 (1.0) 0;0 0.1173 (0.55) 1 1
test_sharing_azure-add[2.58.2] 5.3368 (1.13) 5.3368 (1.13) 5.3368 (1.13) 0.0000 (1.0) 5.3368 (1.13) 0.0000 (1.0) 0;0 0.1874 (0.88) 1 1
test_sharing_azure-add[2.58.2] 5.2147 (1.11) 5.2147 (1.11) 5.2147 (1.11) 0.0000 (1.0) 5.2147 (1.11) 0.0000 (1.0) 0;0 0.1918 (0.90) 1 1
test_sharing_azure-add[3.0.0] 5.5522 (1.18) 5.5522 (1.18) 5.5522 (1.18) 0.0000 (1.0) 5.5522 (1.18) 0.0000 (1.0) 0;0 0.1801 (0.85) 1 1
test_sharing_azure-add[3.0.0] 5.0368 (1.07) 5.0368 (1.07) 5.0368 (1.07) 0.0000 (1.0) 5.0368 (1.07) 0.0000 (1.0) 0;0 0.1985 (0.93) 1 1
test_sharing_azure-add[main] 4.7073 (1.0) 4.7073 (1.0) 4.7073 (1.0) 0.0000 (1.0) 4.7073 (1.0) 0.0000 (1.0) 0;0 0.2124 (1.0) 1 1
test_sharing_azure-add[main] 4.9162 (1.04) 4.9162 (1.04) 4.9162 (1.04) 0.0000 (1.0) 4.9162 (1.04) 0.0000 (1.0) 0;0 0.2034 (0.96) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.11.0] 4.1229 (1.31) 4.1229 (1.31) 4.1229 (1.31) 0.0000 (1.0) 4.1229 (1.31) 0.0000 (1.0) 0;0 0.2425 (0.76) 1 1
test_sharing_azure-add-noop[2.11.0] 3.9294 (1.25) 3.9294 (1.25) 3.9294 (1.25) 0.0000 (1.0) 3.9294 (1.25) 0.0000 (1.0) 0;0 0.2545 (0.80) 1 1
test_sharing_azure-add-noop[2.40.0] 3.5542 (1.13) 3.5542 (1.13) 3.5542 (1.13) 0.0000 (1.0) 3.5542 (1.13) 0.0000 (1.0) 0;0 0.2814 (0.89) 1 1
test_sharing_azure-add-noop[2.40.0] 3.5367 (1.12) 3.5367 (1.12) 3.5367 (1.12) 0.0000 (1.0) 3.5367 (1.12) 0.0000 (1.0) 0;0 0.2828 (0.89) 1 1
test_sharing_azure-add-noop[2.58.2] 3.2133 (1.02) 3.2133 (1.02) 3.2133 (1.02) 0.0000 (1.0) 3.2133 (1.02) 0.0000 (1.0) 0;0 0.3112 (0.98) 1 1
test_sharing_azure-add-noop[2.58.2] 3.5137 (1.11) 3.5137 (1.11) 3.5137 (1.11) 0.0000 (1.0) 3.5137 (1.11) 0.0000 (1.0) 0;0 0.2846 (0.90) 1 1
test_sharing_azure-add-noop[3.0.0] 3.5531 (1.13) 3.5531 (1.13) 3.5531 (1.13) 0.0000 (1.0) 3.5531 (1.13) 0.0000 (1.0) 0;0 0.2814 (0.89) 1 1
test_sharing_azure-add-noop[3.0.0] 3.5059 (1.11) 3.5059 (1.11) 3.5059 (1.11) 0.0000 (1.0) 3.5059 (1.11) 0.0000 (1.0) 0;0 0.2852 (0.90) 1 1
test_sharing_azure-add-noop[main] 3.1536 (1.0) 3.1536 (1.0) 3.1536 (1.0) 0.0000 (1.0) 3.1536 (1.0) 0.0000 (1.0) 0;0 0.3171 (1.0) 1 1
test_sharing_azure-add-noop[main] 3.2170 (1.02) 3.2170 (1.02) 3.2170 (1.02) 0.0000 (1.0) 3.2170 (1.02) 0.0000 (1.0) 0;0 0.3109 (0.98) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.11.0] 520.6266 (1.0) 520.6266 (1.0) 520.6266 (1.0) 0.0000 (1.0) 520.6266 (1.0) 0.0000 (1.0) 0;0 1.9208 (1.0) 1 1
test_sharing_azure-checkout-noop[2.11.0] 530.2852 (1.02) 530.2852 (1.02) 530.2852 (1.02) 0.0000 (1.0) 530.2852 (1.02) 0.0000 (1.0) 0;0 1.8858 (0.98) 1 1
test_sharing_azure-checkout-noop[2.40.0] 818.8898 (1.57) 818.8898 (1.57) 818.8898 (1.57) 0.0000 (1.0) 818.8898 (1.57) 0.0000 (1.0) 0;0 1.2212 (0.64) 1 1
test_sharing_azure-checkout-noop[2.40.0] 817.3541 (1.57) 817.3541 (1.57) 817.3541 (1.57) 0.0000 (1.0) 817.3541 (1.57) 0.0000 (1.0) 0;0 1.2235 (0.64) 1 1
test_sharing_azure-checkout-noop[2.58.2] 773.5468 (1.49) 773.5468 (1.49) 773.5468 (1.49) 0.0000 (1.0) 773.5468 (1.49) 0.0000 (1.0) 0;0 1.2927 (0.67) 1 1
test_sharing_azure-checkout-noop[2.58.2] 817.9516 (1.57) 817.9516 (1.57) 817.9516 (1.57) 0.0000 (1.0) 817.9516 (1.57) 0.0000 (1.0) 0;0 1.2226 (0.64) 1 1
test_sharing_azure-checkout-noop[3.0.0] 844.1690 (1.62) 844.1690 (1.62) 844.1690 (1.62) 0.0000 (1.0) 844.1690 (1.62) 0.0000 (1.0) 0;0 1.1846 (0.62) 1 1
test_sharing_azure-checkout-noop[3.0.0] 872.0657 (1.68) 872.0657 (1.68) 872.0657 (1.68) 0.0000 (1.0) 872.0657 (1.68) 0.0000 (1.0) 0;0 1.1467 (0.60) 1 1
test_sharing_azure-checkout-noop[main] 735.6845 (1.41) 735.6845 (1.41) 735.6845 (1.41) 0.0000 (1.0) 735.6845 (1.41) 0.0000 (1.0) 0;0 1.3593 (0.71) 1 1
test_sharing_azure-checkout-noop[main] 769.9244 (1.48) 769.9244 (1.48) 769.9244 (1.48) 0.0000 (1.0) 769.9244 (1.48) 0.0000 (1.0) 0;0 1.2988 (0.68) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull[2.11.0] 9.8177 (1.48) 9.8177 (1.48) 9.8177 (1.48) 0.0000 (1.0) 9.8177 (1.48) 0.0000 (1.0) 0;0 0.1019 (0.67) 1 1
test_sharing_azure-pull[2.11.0] 9.3722 (1.42) 9.3722 (1.42) 9.3722 (1.42) 0.0000 (1.0) 9.3722 (1.42) 0.0000 (1.0) 0;0 0.1067 (0.71) 1 1
test_sharing_azure-pull[2.40.0] 12.5987 (1.90) 12.5987 (1.90) 12.5987 (1.90) 0.0000 (1.0) 12.5987 (1.90) 0.0000 (1.0) 0;0 0.0794 (0.52) 1 1
test_sharing_azure-pull[2.40.0] 12.6522 (1.91) 12.6522 (1.91) 12.6522 (1.91) 0.0000 (1.0) 12.6522 (1.91) 0.0000 (1.0) 0;0 0.0790 (0.52) 1 1
test_sharing_azure-pull[2.58.2] 6.6141 (1.0) 6.6141 (1.0) 6.6141 (1.0) 0.0000 (1.0) 6.6141 (1.0) 0.0000 (1.0) 0;0 0.1512 (1.0) 1 1
test_sharing_azure-pull[2.58.2] 6.9182 (1.05) 6.9182 (1.05) 6.9182 (1.05) 0.0000 (1.0) 6.9182 (1.05) 0.0000 (1.0) 0;0 0.1445 (0.96) 1 1
test_sharing_azure-pull[3.0.0] 10.6443 (1.61) 10.6443 (1.61) 10.6443 (1.61) 0.0000 (1.0) 10.6443 (1.61) 0.0000 (1.0) 0;0 0.0939 (0.62) 1 1
test_sharing_azure-pull[3.0.0] 10.3062 (1.56) 10.3062 (1.56) 10.3062 (1.56) 0.0000 (1.0) 10.3062 (1.56) 0.0000 (1.0) 0;0 0.0970 (0.64) 1 1
test_sharing_azure-pull[main] 9.2669 (1.40) 9.2669 (1.40) 9.2669 (1.40) 0.0000 (1.0) 9.2669 (1.40) 0.0000 (1.0) 0;0 0.1079 (0.71) 1 1
test_sharing_azure-pull[main] 9.7101 (1.47) 9.7101 (1.47) 9.7101 (1.47) 0.0000 (1.0) 9.7101 (1.47) 0.0000 (1.0) 0;0 0.1030 (0.68) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests -------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull-noop[2.11.0] 554.2625 (1.01) 554.2625 (1.01) 554.2625 (1.01) 0.0000 (1.0) 554.2625 (1.01) 0.0000 (1.0) 0;0 1.8042 (0.99) 1 1
test_sharing_azure-pull-noop[2.11.0] 546.6643 (1.0) 546.6643 (1.0) 546.6643 (1.0) 0.0000 (1.0) 546.6643 (1.0) 0.0000 (1.0) 0;0 1.8293 (1.0) 1 1
test_sharing_azure-pull-noop[2.40.0] 880.2618 (1.61) 880.2618 (1.61) 880.2618 (1.61) 0.0000 (1.0) 880.2618 (1.61) 0.0000 (1.0) 0;0 1.1360 (0.62) 1 1
test_sharing_azure-pull-noop[2.40.0] 845.3312 (1.55) 845.3312 (1.55) 845.3312 (1.55) 0.0000 (1.0) 845.3312 (1.55) 0.0000 (1.0) 0;0 1.1830 (0.65) 1 1
test_sharing_azure-pull-noop[2.58.2] 807.7277 (1.48) 807.7277 (1.48) 807.7277 (1.48) 0.0000 (1.0) 807.7277 (1.48) 0.0000 (1.0) 0;0 1.2380 (0.68) 1 1
test_sharing_azure-pull-noop[2.58.2] 895.9707 (1.64) 895.9707 (1.64) 895.9707 (1.64) 0.0000 (1.0) 895.9707 (1.64) 0.0000 (1.0) 0;0 1.1161 (0.61) 1 1
test_sharing_azure-pull-noop[3.0.0] 1,015.9666 (1.86) 1,015.9666 (1.86) 1,015.9666 (1.86) 0.0000 (1.0) 1,015.9666 (1.86) 0.0000 (1.0) 0;0 0.9843 (0.54) 1 1
test_sharing_azure-pull-noop[3.0.0] 1,011.3069 (1.85) 1,011.3069 (1.85) 1,011.3069 (1.85) 0.0000 (1.0) 1,011.3069 (1.85) 0.0000 (1.0) 0;0 0.9888 (0.54) 1 1
test_sharing_azure-pull-noop[main] 975.0167 (1.78) 975.0167 (1.78) 975.0167 (1.78) 0.0000 (1.0) 975.0167 (1.78) 0.0000 (1.0) 0;0 1.0256 (0.56) 1 1
test_sharing_azure-pull-noop[main] 960.7684 (1.76) 960.7684 (1.76) 960.7684 (1.76) 0.0000 (1.0) 960.7684 (1.76) 0.0000 (1.0) 0;0 1.0408 (0.57) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.11.0] 6.0361 (2.65) 6.0361 (2.65) 6.0361 (2.65) 0.0000 (1.0) 6.0361 (2.65) 0.0000 (1.0) 0;0 0.1657 (0.38) 1 1
test_sharing_azure-push[2.11.0] 4.6822 (2.06) 4.6822 (2.06) 4.6822 (2.06) 0.0000 (1.0) 4.6822 (2.06) 0.0000 (1.0) 0;0 0.2136 (0.49) 1 1
test_sharing_azure-push[2.40.0] 7.5130 (3.30) 7.5130 (3.30) 7.5130 (3.30) 0.0000 (1.0) 7.5130 (3.30) 0.0000 (1.0) 0;0 0.1331 (0.30) 1 1
test_sharing_azure-push[2.40.0] 7.1219 (3.13) 7.1219 (3.13) 7.1219 (3.13) 0.0000 (1.0) 7.1219 (3.13) 0.0000 (1.0) 0;0 0.1404 (0.32) 1 1
test_sharing_azure-push[2.58.2] 4.3510 (1.91) 4.3510 (1.91) 4.3510 (1.91) 0.0000 (1.0) 4.3510 (1.91) 0.0000 (1.0) 0;0 0.2298 (0.52) 1 1
test_sharing_azure-push[2.58.2] 4.5648 (2.01) 4.5648 (2.01) 4.5648 (2.01) 0.0000 (1.0) 4.5648 (2.01) 0.0000 (1.0) 0;0 0.2191 (0.50) 1 1
test_sharing_azure-push[3.0.0] 2.4259 (1.07) 2.4259 (1.07) 2.4259 (1.07) 0.0000 (1.0) 2.4259 (1.07) 0.0000 (1.0) 0;0 0.4122 (0.94) 1 1
test_sharing_azure-push[3.0.0] 2.2747 (1.0) 2.2747 (1.0) 2.2747 (1.0) 0.0000 (1.0) 2.2747 (1.0) 0.0000 (1.0) 0;0 0.4396 (1.0) 1 1
test_sharing_azure-push[main] 4.0221 (1.77) 4.0221 (1.77) 4.0221 (1.77) 0.0000 (1.0) 4.0221 (1.77) 0.0000 (1.0) 0;0 0.2486 (0.57) 1 1
test_sharing_azure-push[main] 4.3541 (1.91) 4.3541 (1.91) 4.3541 (1.91) 0.0000 (1.0) 4.3541 (1.91) 0.0000 (1.0) 0;0 0.2297 (0.52) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.11.0] 580.8178 (1.24) 580.8178 (1.24) 580.8178 (1.24) 0.0000 (1.0) 580.8178 (1.24) 0.0000 (1.0) 0;0 1.7217 (0.80) 1 1
test_sharing_azure-push-noop[2.11.0] 466.6757 (1.0) 466.6757 (1.0) 466.6757 (1.0) 0.0000 (1.0) 466.6757 (1.0) 0.0000 (1.0) 0;0 2.1428 (1.0) 1 1
test_sharing_azure-push-noop[2.40.0] 638.7278 (1.37) 638.7278 (1.37) 638.7278 (1.37) 0.0000 (1.0) 638.7278 (1.37) 0.0000 (1.0) 0;0 1.5656 (0.73) 1 1
test_sharing_azure-push-noop[2.40.0] 637.0407 (1.37) 637.0407 (1.37) 637.0407 (1.37) 0.0000 (1.0) 637.0407 (1.37) 0.0000 (1.0) 0;0 1.5698 (0.73) 1 1
test_sharing_azure-push-noop[2.58.2] 583.4710 (1.25) 583.4710 (1.25) 583.4710 (1.25) 0.0000 (1.0) 583.4710 (1.25) 0.0000 (1.0) 0;0 1.7139 (0.80) 1 1
test_sharing_azure-push-noop[2.58.2] 610.5018 (1.31) 610.5018 (1.31) 610.5018 (1.31) 0.0000 (1.0) 610.5018 (1.31) 0.0000 (1.0) 0;0 1.6380 (0.76) 1 1
test_sharing_azure-push-noop[3.0.0] 657.7198 (1.41) 657.7198 (1.41) 657.7198 (1.41) 0.0000 (1.0) 657.7198 (1.41) 0.0000 (1.0) 0;0 1.5204 (0.71) 1 1
test_sharing_azure-push-noop[3.0.0] 604.9857 (1.30) 604.9857 (1.30) 604.9857 (1.30) 0.0000 (1.0) 604.9857 (1.30) 0.0000 (1.0) 0;0 1.6529 (0.77) 1 1
test_sharing_azure-push-noop[main] 569.4852 (1.22) 569.4852 (1.22) 569.4852 (1.22) 0.0000 (1.0) 569.4852 (1.22) 0.0000 (1.0) 0;0 1.7560 (0.82) 1 1
test_sharing_azure-push-noop[main] 563.4592 (1.21) 563.4592 (1.21) 563.4592 (1.21) 0.0000 (1.0) 563.4592 (1.21) 0.0000 (1.0) 0;0 1.7748 (0.83) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.9206 (1.07) 1.9206 (1.07) 1.9206 (1.07) 0.0000 (1.0) 1.9206 (1.07) 0.0000 (1.0) 0;0 0.5207 (0.93) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.8471 (1.03) 1.8471 (1.03) 1.8471 (1.03) 0.0000 (1.0) 1.8471 (1.03) 0.0000 (1.0) 0;0 0.5414 (0.97) 1 1
test_checkout_hardlink-checkout[2.58.2] 2.0361 (1.14) 2.0361 (1.14) 2.0361 (1.14) 0.0000 (1.0) 2.0361 (1.14) 0.0000 (1.0) 0;0 0.4911 (0.88) 1 1
test_checkout_hardlink-checkout[3.0.0] 1.7919 (1.0) 1.7919 (1.0) 1.7919 (1.0) 0.0000 (1.0) 1.7919 (1.0) 0.0000 (1.0) 0;0 0.5581 (1.0) 1 1
test_checkout_hardlink-checkout[main] 1.8026 (1.01) 1.8026 (1.01) 1.8026 (1.01) 0.0000 (1.0) 1.8026 (1.01) 0.0000 (1.0) 0;0 0.5548 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 707.2414 (1.0) 707.2414 (1.0) 707.2414 (1.0) 0.0000 (1.0) 707.2414 (1.0) 0.0000 (1.0) 0;0 1.4139 (1.0) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 889.3867 (1.26) 889.3867 (1.26) 889.3867 (1.26) 0.0000 (1.0) 889.3867 (1.26) 0.0000 (1.0) 0;0 1.1244 (0.80) 1 1
test_checkout_hardlink-checkout-noop[2.58.2] 973.2051 (1.38) 973.2051 (1.38) 973.2051 (1.38) 0.0000 (1.0) 973.2051 (1.38) 0.0000 (1.0) 0;0 1.0275 (0.73) 1 1
test_checkout_hardlink-checkout-noop[3.0.0] 1,036.0321 (1.46) 1,036.0321 (1.46) 1,036.0321 (1.46) 0.0000 (1.0) 1,036.0321 (1.46) 0.0000 (1.0) 0;0 0.9652 (0.68) 1 1
test_checkout_hardlink-checkout-noop[main] 1,011.6741 (1.43) 1,011.6741 (1.43) 1,011.6741 (1.43) 0.0000 (1.0) 1,011.6741 (1.43) 0.0000 (1.0) 0;0 0.9885 (0.70) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.8525 (1.88) 1.8525 (1.88) 1.8525 (1.88) 0.0000 (1.0) 1.8525 (1.88) 0.0000 (1.0) 0;0 0.5398 (0.53) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.9874 (1.0) 0.9874 (1.0) 0.9874 (1.0) 0.0000 (1.0) 0.9874 (1.0) 0.0000 (1.0) 0;0 1.0128 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.58.2] 1.2610 (1.28) 1.2610 (1.28) 1.2610 (1.28) 0.0000 (1.0) 1.2610 (1.28) 0.0000 (1.0) 0;0 0.7930 (0.78) 1 1
test_checkout_hardlink-checkout-update[3.0.0] 1.1315 (1.15) 1.1315 (1.15) 1.1315 (1.15) 0.0000 (1.0) 1.1315 (1.15) 0.0000 (1.0) 0;0 0.8838 (0.87) 1 1
test_checkout_hardlink-checkout-update[main] 1.1316 (1.15) 1.1316 (1.15) 1.1316 (1.15) 0.0000 (1.0) 1.1316 (1.15) 0.0000 (1.0) 0;0 0.8837 (0.87) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 5.4911 (1.29) 5.4911 (1.29) 5.4911 (1.29) 0.0000 (1.0) 5.4911 (1.29) 0.0000 (1.0) 0;0 0.1821 (0.77) 1 1
test_get-get[2.40.0] 4.2515 (1.0) 4.2515 (1.0) 4.2515 (1.0) 0.0000 (1.0) 4.2515 (1.0) 0.0000 (1.0) 0;0 0.2352 (1.0) 1 1
test_get-get[2.58.2] 6.7918 (1.60) 6.7918 (1.60) 6.7918 (1.60) 0.0000 (1.0) 6.7918 (1.60) 0.0000 (1.0) 0;0 0.1472 (0.63) 1 1
test_get-get[3.0.0] 6.7791 (1.59) 6.7791 (1.59) 6.7791 (1.59) 0.0000 (1.0) 6.7791 (1.59) 0.0000 (1.0) 0;0 0.1475 (0.63) 1 1
test_get-get[main] 7.9121 (1.86) 7.9121 (1.86) 7.9121 (1.86) 0.0000 (1.0) 7.9121 (1.86) 0.0000 (1.0) 0;0 0.1264 (0.54) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 5.5641 (2.29) 5.5641 (2.29) 5.5641 (2.29) 0.0000 (1.0) 5.5641 (2.29) 0.0000 (1.0) 0;0 0.1797 (0.44) 1 1
test_push-push[2.40.0] 6.7535 (2.78) 6.7535 (2.78) 6.7535 (2.78) 0.0000 (1.0) 6.7535 (2.78) 0.0000 (1.0) 0;0 0.1481 (0.36) 1 1
test_push-push[2.58.2] 4.5116 (1.86) 4.5116 (1.86) 4.5116 (1.86) 0.0000 (1.0) 4.5116 (1.86) 0.0000 (1.0) 0;0 0.2217 (0.54) 1 1
test_push-push[3.0.0] 2.4287 (1.0) 2.4287 (1.0) 2.4287 (1.0) 0.0000 (1.0) 2.4287 (1.0) 0.0000 (1.0) 0;0 0.4117 (1.0) 1 1
test_push-push[main] 4.6328 (1.91) 4.6328 (1.91) 4.6328 (1.91) 0.0000 (1.0) 4.6328 (1.91) 0.0000 (1.0) 0;0 0.2159 (0.52) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 3.2874 (1.51) 3.2874 (1.51) 3.2874 (1.51) 0.0000 (1.0) 3.2874 (1.51) 0.0000 (1.0) 0;0 0.3042 (0.66) 1 1
test_checkout_copy-checkout[2.40.0] 3.3543 (1.54) 3.3543 (1.54) 3.3543 (1.54) 0.0000 (1.0) 3.3543 (1.54) 0.0000 (1.0) 0;0 0.2981 (0.65) 1 1
test_checkout_copy-checkout[2.58.2] 2.1837 (1.0) 2.1837 (1.0) 2.1837 (1.0) 0.0000 (1.0) 2.1837 (1.0) 0.0000 (1.0) 0;0 0.4579 (1.0) 1 1
test_checkout_copy-checkout[3.0.0] 4.4250 (2.03) 4.4250 (2.03) 4.4250 (2.03) 0.0000 (1.0) 4.4250 (2.03) 0.0000 (1.0) 0;0 0.2260 (0.49) 1 1
test_checkout_copy-checkout[main] 3.9176 (1.79) 3.9176 (1.79) 3.9176 (1.79) 0.0000 (1.0) 3.9176 (1.79) 0.0000 (1.0) 0;0 0.2553 (0.56) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 543.5647 (1.0) 543.5647 (1.0) 543.5647 (1.0) 0.0000 (1.0) 543.5647 (1.0) 0.0000 (1.0) 0;0 1.8397 (1.0) 1 1
test_checkout_copy-checkout-noop[2.40.0] 634.0046 (1.17) 634.0046 (1.17) 634.0046 (1.17) 0.0000 (1.0) 634.0046 (1.17) 0.0000 (1.0) 0;0 1.5773 (0.86) 1 1
test_checkout_copy-checkout-noop[2.58.2] 675.6693 (1.24) 675.6693 (1.24) 675.6693 (1.24) 0.0000 (1.0) 675.6693 (1.24) 0.0000 (1.0) 0;0 1.4800 (0.80) 1 1
test_checkout_copy-checkout-noop[3.0.0] 703.2498 (1.29) 703.2498 (1.29) 703.2498 (1.29) 0.0000 (1.0) 703.2498 (1.29) 0.0000 (1.0) 0;0 1.4220 (0.77) 1 1
test_checkout_copy-checkout-noop[main] 679.8512 (1.25) 679.8512 (1.25) 679.8512 (1.25) 0.0000 (1.0) 679.8512 (1.25) 0.0000 (1.0) 0;0 1.4709 (0.80) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.3413 (1.88) 1.3413 (1.88) 1.3413 (1.88) 0.0000 (1.0) 1.3413 (1.88) 0.0000 (1.0) 0;0 0.7456 (0.53) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.7147 (1.0) 0.7147 (1.0) 0.7147 (1.0) 0.0000 (1.0) 0.7147 (1.0) 0.0000 (1.0) 0;0 1.3992 (1.0) 1 1
test_checkout_copy-checkout-update[2.58.2] 0.9146 (1.28) 0.9146 (1.28) 0.9146 (1.28) 0.0000 (1.0) 0.9146 (1.28) 0.0000 (1.0) 0;0 1.0934 (0.78) 1 1
test_checkout_copy-checkout-update[3.0.0] 0.7735 (1.08) 0.7735 (1.08) 0.7735 (1.08) 0.0000 (1.0) 0.7735 (1.08) 0.0000 (1.0) 0;0 1.2928 (0.92) 1 1
test_checkout_copy-checkout-update[main] 0.7852 (1.10) 0.7852 (1.10) 0.7852 (1.10) 0.0000 (1.0) 0.7852 (1.10) 0.0000 (1.0) 0;0 1.2736 (0.91) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_pull-pull': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 7.3077 (1.31) 7.3077 (1.31) 7.3077 (1.31) 0.0000 (1.0) 7.3077 (1.31) 0.0000 (1.0) 0;0 0.1368 (0.76) 1 1
test_pull-pull[2.40.0] 8.6668 (1.55) 8.6668 (1.55) 8.6668 (1.55) 0.0000 (1.0) 8.6668 (1.55) 0.0000 (1.0) 0;0 0.1154 (0.64) 1 1
test_pull-pull[2.58.2] 5.5883 (1.0) 5.5883 (1.0) 5.5883 (1.0) 0.0000 (1.0) 5.5883 (1.0) 0.0000 (1.0) 0;0 0.1789 (1.0) 1 1
test_pull-pull[3.0.0] 7.8813 (1.41) 7.8813 (1.41) 7.8813 (1.41) 0.0000 (1.0) 7.8813 (1.41) 0.0000 (1.0) 0;0 0.1269 (0.71) 1 1
test_pull-pull[main] 7.7755 (1.39) 7.7755 (1.39) 7.7755 (1.39) 0.0000 (1.0) 7.7755 (1.39) 0.0000 (1.0) 0;0 0.1286 (0.72) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 14.9676 (1.38) 14.9676 (1.38) 14.9676 (1.38) 0.0000 (1.0) 14.9676 (1.38) 0.0000 (1.0) 0;0 0.0668 (0.73) 1 1
test_import_url-import-url[2.40.0] 13.5001 (1.24) 13.5001 (1.24) 13.5001 (1.24) 0.0000 (1.0) 13.5001 (1.24) 0.0000 (1.0) 0;0 0.0741 (0.80) 1 1
test_import_url-import-url[2.58.2] 10.9974 (1.01) 10.9974 (1.01) 10.9974 (1.01) 0.0000 (1.0) 10.9974 (1.01) 0.0000 (1.0) 0;0 0.0909 (0.99) 1 1
test_import_url-import-url[3.0.0] 11.4508 (1.05) 11.4508 (1.05) 11.4508 (1.05) 0.0000 (1.0) 11.4508 (1.05) 0.0000 (1.0) 0;0 0.0873 (0.95) 1 1
test_import_url-import-url[main] 10.8661 (1.0) 10.8661 (1.0) 10.8661 (1.0) 0.0000 (1.0) 10.8661 (1.0) 0.0000 (1.0) 0;0 0.0920 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 341.8388 (1.0) 367.7697 (1.0) 350.0442 (1.0) 4.6164 (1.0) 349.4936 (1.0) 6.2241 (1.0) 33;1 2.8568 (1.0) 100 1
test_init-init[2.40.0] 403.9083 (1.18) 444.7704 (1.21) 412.3804 (1.18) 6.7027 (1.45) 410.4778 (1.17) 6.7878 (1.09) 23;4 2.4249 (0.85) 100 1
test_init-init[2.58.2] 461.8814 (1.35) 485.4345 (1.32) 471.3909 (1.35) 5.0265 (1.09) 470.7003 (1.35) 7.1881 (1.15) 31;0 2.1214 (0.74) 100 1
test_init-init[3.0.0] 453.0618 (1.33) 486.6491 (1.32) 464.5841 (1.33) 6.4667 (1.40) 464.6407 (1.33) 9.1346 (1.47) 33;1 2.1525 (0.75) 100 1
test_init-init[main] 475.1994 (1.39) 508.3360 (1.38) 490.5377 (1.40) 6.8777 (1.49) 490.3677 (1.40) 10.5651 (1.70) 34;0 2.0386 (0.71) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 175.8824 (1.0) 190.8779 (1.0) 179.4227 (1.0) 2.3986 (1.16) 178.5830 (1.0) 2.3218 (1.11) 22;8 5.5734 (1.0) 100 1
test_help---help[2.40.0] 230.1528 (1.31) 239.8254 (1.26) 233.2059 (1.30) 2.2998 (1.11) 232.4667 (1.30) 2.9173 (1.40) 33;2 4.2881 (0.77) 100 1
test_help---help[2.58.2] 183.8113 (1.05) 194.9112 (1.02) 186.4084 (1.04) 2.0752 (1.0) 185.9963 (1.04) 2.1628 (1.04) 23;5 5.3646 (0.96) 100 1
test_help---help[3.0.0] 179.0029 (1.02) 220.4331 (1.15) 184.7438 (1.03) 5.1655 (2.49) 183.3652 (1.03) 3.8209 (1.83) 13;6 5.4129 (0.97) 100 1
test_help---help[main] 177.6488 (1.01) 198.9050 (1.04) 181.4077 (1.01) 2.9823 (1.44) 180.5655 (1.01) 2.0868 (1.0) 12;9 5.5124 (0.99) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 405.1067 (1.02) 405.1067 (1.02) 405.1067 (1.02) 0.0000 (1.0) 405.1067 (1.02) 0.0000 (1.0) 0;0 2.4685 (0.98) 1 1
test_list-list[2.40.0] 396.6080 (1.0) 396.6080 (1.0) 396.6080 (1.0) 0.0000 (1.0) 396.6080 (1.0) 0.0000 (1.0) 0;0 2.5214 (1.0) 1 1
test_list-list[2.58.2] 477.5261 (1.20) 477.5261 (1.20) 477.5261 (1.20) 0.0000 (1.0) 477.5261 (1.20) 0.0000 (1.0) 0;0 2.0941 (0.83) 1 1
test_list-list[3.0.0] 470.7571 (1.19) 470.7571 (1.19) 470.7571 (1.19) 0.0000 (1.0) 470.7571 (1.19) 0.0000 (1.0) 0;0 2.1242 (0.84) 1 1
test_list-list[main] 455.8300 (1.15) 455.8300 (1.15) 455.8300 (1.15) 0.0000 (1.0) 455.8300 (1.15) 0.0000 (1.0) 0;0 2.1938 (0.87) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 396.4950 (1.03) 396.4950 (1.03) 396.4950 (1.03) 0.0000 (1.0) 396.4950 (1.03) 0.0000 (1.0) 0;0 2.5221 (0.97) 1 1
test_list-list-dvc-only[2.40.0] 385.9084 (1.0) 385.9084 (1.0) 385.9084 (1.0) 0.0000 (1.0) 385.9084 (1.0) 0.0000 (1.0) 0;0 2.5913 (1.0) 1 1
test_list-list-dvc-only[2.58.2] 463.1333 (1.20) 463.1333 (1.20) 463.1333 (1.20) 0.0000 (1.0) 463.1333 (1.20) 0.0000 (1.0) 0;0 2.1592 (0.83) 1 1
test_list-list-dvc-only[3.0.0] 498.6756 (1.29) 498.6756 (1.29) 498.6756 (1.29) 0.0000 (1.0) 498.6756 (1.29) 0.0000 (1.0) 0;0 2.0053 (0.77) 1 1
test_list-list-dvc-only[main] 453.5511 (1.18) 453.5511 (1.18) 453.5511 (1.18) 0.0000 (1.0) 453.5511 (1.18) 0.0000 (1.0) 0;0 2.2048 (0.85) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.6774 (3.68) 1.6774 (3.68) 1.6774 (3.68) 0.0000 (1.0) 1.6774 (3.68) 0.0000 (1.0) 0;0 0.5962 (0.27) 1 1
test_list-list-recursive[2.40.0] 0.4556 (1.0) 0.4556 (1.0) 0.4556 (1.0) 0.0000 (1.0) 0.4556 (1.0) 0.0000 (1.0) 0;0 2.1951 (1.0) 1 1
test_list-list-recursive[2.58.2] 0.5551 (1.22) 0.5551 (1.22) 0.5551 (1.22) 0.0000 (1.0) 0.5551 (1.22) 0.0000 (1.0) 0;0 1.8014 (0.82) 1 1
test_list-list-recursive[3.0.0] 0.5563 (1.22) 0.5563 (1.22) 0.5563 (1.22) 0.0000 (1.0) 0.5563 (1.22) 0.0000 (1.0) 0;0 1.7977 (0.82) 1 1
test_list-list-recursive[main] 0.5542 (1.22) 0.5542 (1.22) 0.5542 (1.22) 0.0000 (1.0) 0.5542 (1.22) 0.0000 (1.0) 0;0 1.8043 (0.82) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 397.5547 (1.0) 397.5547 (1.0) 397.5547 (1.0) 0.0000 (1.0) 397.5547 (1.0) 0.0000 (1.0) 0;0 2.5154 (1.0) 1 1
test_list-list-shallow[2.40.0] 416.1599 (1.05) 416.1599 (1.05) 416.1599 (1.05) 0.0000 (1.0) 416.1599 (1.05) 0.0000 (1.0) 0;0 2.4029 (0.96) 1 1
test_list-list-shallow[2.58.2] 468.9219 (1.18) 468.9219 (1.18) 468.9219 (1.18) 0.0000 (1.0) 468.9219 (1.18) 0.0000 (1.0) 0;0 2.1326 (0.85) 1 1
test_list-list-shallow[3.0.0] 454.5859 (1.14) 454.5859 (1.14) 454.5859 (1.14) 0.0000 (1.0) 454.5859 (1.14) 0.0000 (1.0) 0;0 2.1998 (0.87) 1 1
test_list-list-shallow[main] 450.0590 (1.13) 450.0590 (1.13) 450.0590 (1.13) 0.0000 (1.0) 450.0590 (1.13) 0.0000 (1.0) 0;0 2.2219 (0.88) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
Bumps pre-commit from 2.21.0 to 3.5.0.
Release notes
Sourced from pre-commit's releases.
... (truncated)
Changelog
Sourced from pre-commit's changelog.
... (truncated)
Commits
61cc55av3.5.0c9945b9Merge pull request #3029 from adamchainz/improve_duration_timingd988767Improve hook duration timing0d8b245Merge pull request #3023 from pre-commit/pre-commit-ci-update-config155c521[pre-commit.ci] pre-commit autoupdate676e51aMerge pull request #3024 from pre-commit/pick-shebang-path-without-spaces997ea0ause sys.executable instead of echo.exe in parse_shebang19aa121Merge pull request #3016 from pre-commit/pre-commit-ci-update-configa4ab977[pre-commit.ci] pre-commit autoupdate3f3760bMerge pull request #3011 from hack3ric/bump-node-and-go-versionYou can trigger a rebase of this PR by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show