Closed pmrowla closed 1 year ago
Mon May 22 06:15:36 UTC 2023 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.11.0] 2.7151 (1.0) 2.7151 (1.0) 2.7151 (1.0) 0.0000 (1.0) 2.7151 (1.0) 0.0000 (1.0) 0;0 0.3683 (1.0) 1 1 test_get_url-get-url[2.18.1] 2.7350 (1.01) 2.7350 (1.01) 2.7350 (1.01) 0.0000 (1.0) 2.7350 (1.01) 0.0000 (1.0) 0;0 0.3656 (0.99) 1 1 test_get_url-get-url[2.39.0] 2.8088 (1.03) 2.8088 (1.03) 2.8088 (1.03) 0.0000 (1.0) 2.8088 (1.03) 0.0000 (1.0) 0;0 0.3560 (0.97) 1 1 test_get_url-get-url[2.40.0] 2.7878 (1.03) 2.7878 (1.03) 2.7878 (1.03) 0.0000 (1.0) 2.7878 (1.03) 0.0000 (1.0) 0;0 0.3587 (0.97) 1 1 test_get_url-get-url[2.41.1] 2.8244 (1.04) 2.8244 (1.04) 2.8244 (1.04) 0.0000 (1.0) 2.8244 (1.04) 0.0000 (1.0) 0;0 0.3541 (0.96) 1 1 test_get_url-get-url[2.45.0] 2.8150 (1.04) 2.8150 (1.04) 2.8150 (1.04) 0.0000 (1.0) 2.8150 (1.04) 0.0000 (1.0) 0;0 0.3552 (0.96) 1 1 test_get_url-get-url[main] 2.9031 (1.07) 2.9031 (1.07) 2.9031 (1.07) 0.0000 (1.0) 2.9031 (1.07) 0.0000 (1.0) 0;0 0.3445 (0.94) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.11.0] 3.1820 (1.51) 3.1820 (1.51) 3.1820 (1.51) 0.0000 (1.0) 3.1820 (1.51) 0.0000 (1.0) 0;0 0.3143 (0.66) 1 1 test_checkout_copy-checkout[2.18.1] 3.1573 (1.50) 3.1573 (1.50) 3.1573 (1.50) 0.0000 (1.0) 3.1573 (1.50) 0.0000 (1.0) 0;0 0.3167 (0.67) 1 1 test_checkout_copy-checkout[2.39.0] 3.2157 (1.53) 3.2157 (1.53) 3.2157 (1.53) 0.0000 (1.0) 3.2157 (1.53) 0.0000 (1.0) 0;0 0.3110 (0.65) 1 1 test_checkout_copy-checkout[2.40.0] 3.2237 (1.53) 3.2237 (1.53) 3.2237 (1.53) 0.0000 (1.0) 3.2237 (1.53) 0.0000 (1.0) 0;0 0.3102 (0.65) 1 1 test_checkout_copy-checkout[2.41.1] 3.6530 (1.74) 3.6530 (1.74) 3.6530 (1.74) 0.0000 (1.0) 3.6530 (1.74) 0.0000 (1.0) 0;0 0.2737 (0.58) 1 1 test_checkout_copy-checkout[2.45.0] 3.9761 (1.89) 3.9761 (1.89) 3.9761 (1.89) 0.0000 (1.0) 3.9761 (1.89) 0.0000 (1.0) 0;0 0.2515 (0.53) 1 1 test_checkout_copy-checkout[main] 2.1028 (1.0) 2.1028 (1.0) 2.1028 (1.0) 0.0000 (1.0) 2.1028 (1.0) 0.0000 (1.0) 0;0 0.4756 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.11.0] 505.3017 (1.0) 505.3017 (1.0) 505.3017 (1.0) 0.0000 (1.0) 505.3017 (1.0) 0.0000 (1.0) 0;0 1.9790 (1.0) 1 1 test_checkout_copy-checkout-noop[2.18.1] 571.0550 (1.13) 571.0550 (1.13) 571.0550 (1.13) 0.0000 (1.0) 571.0550 (1.13) 0.0000 (1.0) 0;0 1.7511 (0.88) 1 1 test_checkout_copy-checkout-noop[2.39.0] 588.5650 (1.16) 588.5650 (1.16) 588.5650 (1.16) 0.0000 (1.0) 588.5650 (1.16) 0.0000 (1.0) 0;0 1.6990 (0.86) 1 1 test_checkout_copy-checkout-noop[2.40.0] 593.7272 (1.17) 593.7272 (1.17) 593.7272 (1.17) 0.0000 (1.0) 593.7272 (1.17) 0.0000 (1.0) 0;0 1.6843 (0.85) 1 1 test_checkout_copy-checkout-noop[2.41.1] 591.3692 (1.17) 591.3692 (1.17) 591.3692 (1.17) 0.0000 (1.0) 591.3692 (1.17) 0.0000 (1.0) 0;0 1.6910 (0.85) 1 1 test_checkout_copy-checkout-noop[2.45.0] 610.0089 (1.21) 610.0089 (1.21) 610.0089 (1.21) 0.0000 (1.0) 610.0089 (1.21) 0.0000 (1.0) 0;0 1.6393 (0.83) 1 1 test_checkout_copy-checkout-noop[main] 672.5688 (1.33) 672.5688 (1.33) 672.5688 (1.33) 0.0000 (1.0) 672.5688 (1.33) 0.0000 (1.0) 0;0 1.4868 (0.75) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.11.0] 1.2864 (1.94) 1.2864 (1.94) 1.2864 (1.94) 0.0000 (1.0) 1.2864 (1.94) 0.0000 (1.0) 0;0 0.7773 (0.52) 1 1 test_checkout_copy-checkout-update[2.18.1] 0.6681 (1.01) 0.6681 (1.01) 0.6681 (1.01) 0.0000 (1.0) 0.6681 (1.01) 0.0000 (1.0) 0;0 1.4967 (0.99) 1 1 test_checkout_copy-checkout-update[2.39.0] 0.6847 (1.03) 0.6847 (1.03) 0.6847 (1.03) 0.0000 (1.0) 0.6847 (1.03) 0.0000 (1.0) 0;0 1.4604 (0.97) 1 1 test_checkout_copy-checkout-update[2.40.0] 0.6716 (1.01) 0.6716 (1.01) 0.6716 (1.01) 0.0000 (1.0) 0.6716 (1.01) 0.0000 (1.0) 0;0 1.4889 (0.99) 1 1 test_checkout_copy-checkout-update[2.41.1] 0.6631 (1.0) 0.6631 (1.0) 0.6631 (1.0) 0.0000 (1.0) 0.6631 (1.0) 0.0000 (1.0) 0;0 1.5081 (1.0) 1 1 test_checkout_copy-checkout-update[2.45.0] 0.6805 (1.03) 0.6805 (1.03) 0.6805 (1.03) 0.0000 (1.0) 0.6805 (1.03) 0.0000 (1.0) 0;0 1.4696 (0.97) 1 1 test_checkout_copy-checkout-update[main] 0.8511 (1.28) 0.8511 (1.28) 0.8511 (1.28) 0.0000 (1.0) 0.8511 (1.28) 0.0000 (1.0) 0;0 1.1750 (0.78) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-add[2.11.0] 10.0443 (1.87) 10.0443 (1.87) 10.0443 (1.87) 0.0000 (1.0) 10.0443 (1.87) 0.0000 (1.0) 0;0 0.0996 (0.53) 1 1 test_sharing_gs-add[2.11.0] 10.5166 (1.96) 10.5166 (1.96) 10.5166 (1.96) 0.0000 (1.0) 10.5166 (1.96) 0.0000 (1.0) 0;0 0.0951 (0.51) 1 1 test_sharing_gs-add[2.39.0] 8.2341 (1.54) 8.2341 (1.54) 8.2341 (1.54) 0.0000 (1.0) 8.2341 (1.54) 0.0000 (1.0) 0;0 0.1214 (0.65) 1 1 test_sharing_gs-add[2.39.0] 8.1320 (1.52) 8.1320 (1.52) 8.1320 (1.52) 0.0000 (1.0) 8.1320 (1.52) 0.0000 (1.0) 0;0 0.1230 (0.66) 1 1 test_sharing_gs-add[2.40.0] 8.5442 (1.59) 8.5442 (1.59) 8.5442 (1.59) 0.0000 (1.0) 8.5442 (1.59) 0.0000 (1.0) 0;0 0.1170 (0.63) 1 1 test_sharing_gs-add[2.40.0] 8.4619 (1.58) 8.4619 (1.58) 8.4619 (1.58) 0.0000 (1.0) 8.4619 (1.58) 0.0000 (1.0) 0;0 0.1182 (0.63) 1 1 test_sharing_gs-add[2.41.1] 8.2467 (1.54) 8.2467 (1.54) 8.2467 (1.54) 0.0000 (1.0) 8.2467 (1.54) 0.0000 (1.0) 0;0 0.1213 (0.65) 1 1 test_sharing_gs-add[2.41.1] 8.2451 (1.54) 8.2451 (1.54) 8.2451 (1.54) 0.0000 (1.0) 8.2451 (1.54) 0.0000 (1.0) 0;0 0.1213 (0.65) 1 1 test_sharing_gs-add[main] 5.3625 (1.0) 5.3625 (1.0) 5.3625 (1.0) 0.0000 (1.0) 5.3625 (1.0) 0.0000 (1.0) 0;0 0.1865 (1.0) 1 1 test_sharing_gs-add[main] 5.6874 (1.06) 5.6874 (1.06) 5.6874 (1.06) 0.0000 (1.0) 5.6874 (1.06) 0.0000 (1.0) 0;0 0.1758 (0.94) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-add-noop[2.11.0] 4.6576 (1.40) 4.6576 (1.40) 4.6576 (1.40) 0.0000 (1.0) 4.6576 (1.40) 0.0000 (1.0) 0;0 0.2147 (0.71) 1 1 test_sharing_gs-add-noop[2.11.0] 4.6237 (1.39) 4.6237 (1.39) 4.6237 (1.39) 0.0000 (1.0) 4.6237 (1.39) 0.0000 (1.0) 0;0 0.2163 (0.72) 1 1 test_sharing_gs-add-noop[2.39.0] 3.3405 (1.01) 3.3405 (1.01) 3.3405 (1.01) 0.0000 (1.0) 3.3405 (1.01) 0.0000 (1.0) 0;0 0.2994 (0.99) 1 1 test_sharing_gs-add-noop[2.39.0] 3.3235 (1.0) 3.3235 (1.0) 3.3235 (1.0) 0.0000 (1.0) 3.3235 (1.0) 0.0000 (1.0) 0;0 0.3009 (1.0) 1 1 test_sharing_gs-add-noop[2.40.0] 3.3470 (1.01) 3.3470 (1.01) 3.3470 (1.01) 0.0000 (1.0) 3.3470 (1.01) 0.0000 (1.0) 0;0 0.2988 (0.99) 1 1 test_sharing_gs-add-noop[2.40.0] 3.3889 (1.02) 3.3889 (1.02) 3.3889 (1.02) 0.0000 (1.0) 3.3889 (1.02) 0.0000 (1.0) 0;0 0.2951 (0.98) 1 1 test_sharing_gs-add-noop[2.41.1] 3.3405 (1.01) 3.3405 (1.01) 3.3405 (1.01) 0.0000 (1.0) 3.3405 (1.01) 0.0000 (1.0) 0;0 0.2994 (0.99) 1 1 test_sharing_gs-add-noop[2.41.1] 3.5727 (1.07) 3.5727 (1.07) 3.5727 (1.07) 0.0000 (1.0) 3.5727 (1.07) 0.0000 (1.0) 0;0 0.2799 (0.93) 1 1 test_sharing_gs-add-noop[main] 3.7178 (1.12) 3.7178 (1.12) 3.7178 (1.12) 0.0000 (1.0) 3.7178 (1.12) 0.0000 (1.0) 0;0 0.2690 (0.89) 1 1 test_sharing_gs-add-noop[main] 3.8219 (1.15) 3.8219 (1.15) 3.8219 (1.15) 0.0000 (1.0) 3.8219 (1.15) 0.0000 (1.0) 0;0 0.2617 (0.87) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_gs-checkout-noop[2.11.0] 646.1822 (1.02) 646.1822 (1.02) 646.1822 (1.02) 0.0000 (1.0) 646.1822 (1.02) 0.0000 (1.0) 0;0 1.5476 (0.98) 1 1 test_sharing_gs-checkout-noop[2.11.0] 635.5997 (1.0) 635.5997 (1.0) 635.5997 (1.0) 0.0000 (1.0) 635.5997 (1.0) 0.0000 (1.0) 0;0 1.5733 (1.0) 1 1 test_sharing_gs-checkout-noop[2.39.0] 754.3309 (1.19) 754.3309 (1.19) 754.3309 (1.19) 0.0000 (1.0) 754.3309 (1.19) 0.0000 (1.0) 0;0 1.3257 (0.84) 1 1 test_sharing_gs-checkout-noop[2.39.0] 777.6640 (1.22) 777.6640 (1.22) 777.6640 (1.22) 0.0000 (1.0) 777.6640 (1.22) 0.0000 (1.0) 0;0 1.2859 (0.82) 1 1 test_sharing_gs-checkout-noop[2.40.0] 822.8846 (1.29) 822.8846 (1.29) 822.8846 (1.29) 0.0000 (1.0) 822.8846 (1.29) 0.0000 (1.0) 0;0 1.2152 (0.77) 1 1 test_sharing_gs-checkout-noop[2.40.0] 777.6369 (1.22) 777.6369 (1.22) 777.6369 (1.22) 0.0000 (1.0) 777.6369 (1.22) 0.0000 (1.0) 0;0 1.2859 (0.82) 1 1 test_sharing_gs-checkout-noop[2.41.1] 763.7590 (1.20) 763.7590 (1.20) 763.7590 (1.20) 0.0000 (1.0) 763.7590 (1.20) 0.0000 (1.0) 0;0 1.3093 (0.83) 1 1 test_sharing_gs-checkout-noop[2.41.1] 813.5408 (1.28) 813.5408 (1.28) 813.5408 (1.28) 0.0000 (1.0) 813.5408 (1.28) 0.0000 (1.0) 0;0 1.2292 (0.78) 1 1 test_sharing_gs-checkout-noop[main] 997.7760 (1.57) 997.7760 (1.57) 997.7760 (1.57) 0.0000 (1.0) 997.7760 (1.57) 0.0000 (1.0) 0;0 1.0022 (0.64) 1 1 test_sharing_gs-checkout-noop[main] 941.4028 (1.48) 941.4028 (1.48) 941.4028 (1.48) 0.0000 (1.0) 941.4028 (1.48) 0.0000 (1.0) 0;0 1.0622 (0.68) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-pull[2.11.0] 10.3766 (1.33) 10.3766 (1.33) 10.3766 (1.33) 0.0000 (1.0) 10.3766 (1.33) 0.0000 (1.0) 0;0 0.0964 (0.75) 1 1 test_sharing_gs-pull[2.11.0] 9.9545 (1.28) 9.9545 (1.28) 9.9545 (1.28) 0.0000 (1.0) 9.9545 (1.28) 0.0000 (1.0) 0;0 0.1005 (0.78) 1 1 test_sharing_gs-pull[2.39.0] 11.8164 (1.52) 11.8164 (1.52) 11.8164 (1.52) 0.0000 (1.0) 11.8164 (1.52) 0.0000 (1.0) 0;0 0.0846 (0.66) 1 1 test_sharing_gs-pull[2.39.0] 11.8183 (1.52) 11.8183 (1.52) 11.8183 (1.52) 0.0000 (1.0) 11.8183 (1.52) 0.0000 (1.0) 0;0 0.0846 (0.66) 1 1 test_sharing_gs-pull[2.40.0] 11.8878 (1.52) 11.8878 (1.52) 11.8878 (1.52) 0.0000 (1.0) 11.8878 (1.52) 0.0000 (1.0) 0;0 0.0841 (0.66) 1 1 test_sharing_gs-pull[2.40.0] 11.3255 (1.45) 11.3255 (1.45) 11.3255 (1.45) 0.0000 (1.0) 11.3255 (1.45) 0.0000 (1.0) 0;0 0.0883 (0.69) 1 1 test_sharing_gs-pull[2.41.1] 11.5616 (1.48) 11.5616 (1.48) 11.5616 (1.48) 0.0000 (1.0) 11.5616 (1.48) 0.0000 (1.0) 0;0 0.0865 (0.67) 1 1 test_sharing_gs-pull[2.41.1] 11.6413 (1.49) 11.6413 (1.49) 11.6413 (1.49) 0.0000 (1.0) 11.6413 (1.49) 0.0000 (1.0) 0;0 0.0859 (0.67) 1 1 test_sharing_gs-pull[main] 7.8265 (1.00) 7.8265 (1.00) 7.8265 (1.00) 0.0000 (1.0) 7.8265 (1.00) 0.0000 (1.0) 0;0 0.1278 (1.00) 1 1 test_sharing_gs-pull[main] 7.7994 (1.0) 7.7994 (1.0) 7.7994 (1.0) 0.0000 (1.0) 7.7994 (1.0) 0.0000 (1.0) 0;0 0.1282 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-pull-noop[2.11.0] 677.9398 (1.01) 677.9398 (1.01) 677.9398 (1.01) 0.0000 (1.0) 677.9398 (1.01) 0.0000 (1.0) 0;0 1.4751 (0.99) 1 1 test_sharing_gs-pull-noop[2.11.0] 669.3746 (1.0) 669.3746 (1.0) 669.3746 (1.0) 0.0000 (1.0) 669.3746 (1.0) 0.0000 (1.0) 0;0 1.4939 (1.0) 1 1 test_sharing_gs-pull-noop[2.39.0] 828.0591 (1.24) 828.0591 (1.24) 828.0591 (1.24) 0.0000 (1.0) 828.0591 (1.24) 0.0000 (1.0) 0;0 1.2076 (0.81) 1 1 test_sharing_gs-pull-noop[2.39.0] 849.2638 (1.27) 849.2638 (1.27) 849.2638 (1.27) 0.0000 (1.0) 849.2638 (1.27) 0.0000 (1.0) 0;0 1.1775 (0.79) 1 1 test_sharing_gs-pull-noop[2.40.0] 886.7156 (1.32) 886.7156 (1.32) 886.7156 (1.32) 0.0000 (1.0) 886.7156 (1.32) 0.0000 (1.0) 0;0 1.1278 (0.75) 1 1 test_sharing_gs-pull-noop[2.40.0] 853.0682 (1.27) 853.0682 (1.27) 853.0682 (1.27) 0.0000 (1.0) 853.0682 (1.27) 0.0000 (1.0) 0;0 1.1722 (0.78) 1 1 test_sharing_gs-pull-noop[2.41.1] 806.2511 (1.20) 806.2511 (1.20) 806.2511 (1.20) 0.0000 (1.0) 806.2511 (1.20) 0.0000 (1.0) 0;0 1.2403 (0.83) 1 1 test_sharing_gs-pull-noop[2.41.1] 862.1571 (1.29) 862.1571 (1.29) 862.1571 (1.29) 0.0000 (1.0) 862.1571 (1.29) 0.0000 (1.0) 0;0 1.1599 (0.78) 1 1 test_sharing_gs-pull-noop[main] 991.7878 (1.48) 991.7878 (1.48) 991.7878 (1.48) 0.0000 (1.0) 991.7878 (1.48) 0.0000 (1.0) 0;0 1.0083 (0.67) 1 1 test_sharing_gs-pull-noop[main] 1,041.1670 (1.56) 1,041.1670 (1.56) 1,041.1670 (1.56) 0.0000 (1.0) 1,041.1670 (1.56) 0.0000 (1.0) 0;0 0.9605 (0.64) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-push[2.11.0] 5.6620 (1.18) 5.6620 (1.18) 5.6620 (1.18) 0.0000 (1.0) 5.6620 (1.18) 0.0000 (1.0) 0;0 0.1766 (0.85) 1 1 test_sharing_gs-push[2.11.0] 5.5354 (1.16) 5.5354 (1.16) 5.5354 (1.16) 0.0000 (1.0) 5.5354 (1.16) 0.0000 (1.0) 0;0 0.1807 (0.86) 1 1 test_sharing_gs-push[2.39.0] 6.7556 (1.41) 6.7556 (1.41) 6.7556 (1.41) 0.0000 (1.0) 6.7556 (1.41) 0.0000 (1.0) 0;0 0.1480 (0.71) 1 1 test_sharing_gs-push[2.39.0] 6.7209 (1.40) 6.7209 (1.40) 6.7209 (1.40) 0.0000 (1.0) 6.7209 (1.40) 0.0000 (1.0) 0;0 0.1488 (0.71) 1 1 test_sharing_gs-push[2.40.0] 6.9941 (1.46) 6.9941 (1.46) 6.9941 (1.46) 0.0000 (1.0) 6.9941 (1.46) 0.0000 (1.0) 0;0 0.1430 (0.68) 1 1 test_sharing_gs-push[2.40.0] 6.6653 (1.39) 6.6653 (1.39) 6.6653 (1.39) 0.0000 (1.0) 6.6653 (1.39) 0.0000 (1.0) 0;0 0.1500 (0.72) 1 1 test_sharing_gs-push[2.41.1] 6.6813 (1.40) 6.6813 (1.40) 6.6813 (1.40) 0.0000 (1.0) 6.6813 (1.40) 0.0000 (1.0) 0;0 0.1497 (0.72) 1 1 test_sharing_gs-push[2.41.1] 6.7190 (1.40) 6.7190 (1.40) 6.7190 (1.40) 0.0000 (1.0) 6.7190 (1.40) 0.0000 (1.0) 0;0 0.1488 (0.71) 1 1 test_sharing_gs-push[main] 4.7869 (1.0) 4.7869 (1.0) 4.7869 (1.0) 0.0000 (1.0) 4.7869 (1.0) 0.0000 (1.0) 0;0 0.2089 (1.0) 1 1 test_sharing_gs-push[main] 5.3142 (1.11) 5.3142 (1.11) 5.3142 (1.11) 0.0000 (1.0) 5.3142 (1.11) 0.0000 (1.0) 0;0 0.1882 (0.90) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-push-noop[2.11.0] 677.0219 (1.20) 677.0219 (1.20) 677.0219 (1.20) 0.0000 (1.0) 677.0219 (1.20) 0.0000 (1.0) 0;0 1.4771 (0.83) 1 1 test_sharing_gs-push-noop[2.11.0] 580.4586 (1.03) 580.4586 (1.03) 580.4586 (1.03) 0.0000 (1.0) 580.4586 (1.03) 0.0000 (1.0) 0;0 1.7228 (0.97) 1 1 test_sharing_gs-push-noop[2.39.0] 562.7310 (1.0) 562.7310 (1.0) 562.7310 (1.0) 0.0000 (1.0) 562.7310 (1.0) 0.0000 (1.0) 0;0 1.7770 (1.0) 1 1 test_sharing_gs-push-noop[2.39.0] 596.5807 (1.06) 596.5807 (1.06) 596.5807 (1.06) 0.0000 (1.0) 596.5807 (1.06) 0.0000 (1.0) 0;0 1.6762 (0.94) 1 1 test_sharing_gs-push-noop[2.40.0] 634.4008 (1.13) 634.4008 (1.13) 634.4008 (1.13) 0.0000 (1.0) 634.4008 (1.13) 0.0000 (1.0) 0;0 1.5763 (0.89) 1 1 test_sharing_gs-push-noop[2.40.0] 581.9224 (1.03) 581.9224 (1.03) 581.9224 (1.03) 0.0000 (1.0) 581.9224 (1.03) 0.0000 (1.0) 0;0 1.7184 (0.97) 1 1 test_sharing_gs-push-noop[2.41.1] 597.6509 (1.06) 597.6509 (1.06) 597.6509 (1.06) 0.0000 (1.0) 597.6509 (1.06) 0.0000 (1.0) 0;0 1.6732 (0.94) 1 1 test_sharing_gs-push-noop[2.41.1] 601.4584 (1.07) 601.4584 (1.07) 601.4584 (1.07) 0.0000 (1.0) 601.4584 (1.07) 0.0000 (1.0) 0;0 1.6626 (0.94) 1 1 test_sharing_gs-push-noop[main] 665.0129 (1.18) 665.0129 (1.18) 665.0129 (1.18) 0.0000 (1.0) 665.0129 (1.18) 0.0000 (1.0) 0;0 1.5037 (0.85) 1 1 test_sharing_gs-push-noop[main] 733.3900 (1.30) 733.3900 (1.30) 733.3900 (1.30) 0.0000 (1.0) 733.3900 (1.30) 0.0000 (1.0) 0;0 1.3635 (0.77) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.11.0] 2.1784 (1.60) 2.1784 (1.60) 2.1784 (1.60) 0.0000 (1.0) 2.1784 (1.60) 0.0000 (1.0) 0;0 0.4591 (0.62) 1 1 test_status-status[2.18.1] 1.3610 (1.0) 1.3610 (1.0) 1.3610 (1.0) 0.0000 (1.0) 1.3610 (1.0) 0.0000 (1.0) 0;0 0.7348 (1.0) 1 1 test_status-status[2.39.0] 2.0830 (1.53) 2.0830 (1.53) 2.0830 (1.53) 0.0000 (1.0) 2.0830 (1.53) 0.0000 (1.0) 0;0 0.4801 (0.65) 1 1 test_status-status[2.40.0] 1.3948 (1.02) 1.3948 (1.02) 1.3948 (1.02) 0.0000 (1.0) 1.3948 (1.02) 0.0000 (1.0) 0;0 0.7169 (0.98) 1 1 test_status-status[2.41.1] 1.3865 (1.02) 1.3865 (1.02) 1.3865 (1.02) 0.0000 (1.0) 1.3865 (1.02) 0.0000 (1.0) 0;0 0.7213 (0.98) 1 1 test_status-status[2.45.0] 1.3657 (1.00) 1.3657 (1.00) 1.3657 (1.00) 0.0000 (1.0) 1.3657 (1.00) 0.0000 (1.0) 0;0 0.7322 (1.00) 1 1 test_status-status[main] 1.4371 (1.06) 1.4371 (1.06) 1.4371 (1.06) 0.0000 (1.0) 1.4371 (1.06) 0.0000 (1.0) 0;0 0.6959 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_status-status-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.11.0] 1.5728 (3.10) 1.5728 (3.10) 1.5728 (3.10) 0.0000 (1.0) 1.5728 (3.10) 0.0000 (1.0) 0;0 0.6358 (0.32) 1 1 test_status-status-changed[2.18.1] 0.5072 (1.0) 0.5072 (1.0) 0.5072 (1.0) 0.0000 (1.0) 0.5072 (1.0) 0.0000 (1.0) 0;0 1.9715 (1.0) 1 1 test_status-status-changed[2.39.0] 0.5327 (1.05) 0.5327 (1.05) 0.5327 (1.05) 0.0000 (1.0) 0.5327 (1.05) 0.0000 (1.0) 0;0 1.8774 (0.95) 1 1 test_status-status-changed[2.40.0] 0.5332 (1.05) 0.5332 (1.05) 0.5332 (1.05) 0.0000 (1.0) 0.5332 (1.05) 0.0000 (1.0) 0;0 1.8753 (0.95) 1 1 test_status-status-changed[2.41.1] 0.5409 (1.07) 0.5409 (1.07) 0.5409 (1.07) 0.0000 (1.0) 0.5409 (1.07) 0.0000 (1.0) 0;0 1.8489 (0.94) 1 1 test_status-status-changed[2.45.0] 0.5626 (1.11) 0.5626 (1.11) 0.5626 (1.11) 0.0000 (1.0) 0.5626 (1.11) 0.0000 (1.0) 0;0 1.7774 (0.90) 1 1 test_status-status-changed[main] 0.6282 (1.24) 0.6282 (1.24) 0.6282 (1.24) 0.0000 (1.0) 0.6282 (1.24) 0.0000 (1.0) 0;0 1.5920 (0.81) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.11.0] 668.5264 (1.31) 668.5264 (1.31) 668.5264 (1.31) 0.0000 (1.0) 668.5264 (1.31) 0.0000 (1.0) 0;0 1.4958 (0.76) 1 1 test_status-status-changed-noop[2.18.1] 509.7172 (1.0) 509.7172 (1.0) 509.7172 (1.0) 0.0000 (1.0) 509.7172 (1.0) 0.0000 (1.0) 0;0 1.9619 (1.0) 1 1 test_status-status-changed-noop[2.39.0] 535.3027 (1.05) 535.3027 (1.05) 535.3027 (1.05) 0.0000 (1.0) 535.3027 (1.05) 0.0000 (1.0) 0;0 1.8681 (0.95) 1 1 test_status-status-changed-noop[2.40.0] 534.7897 (1.05) 534.7897 (1.05) 534.7897 (1.05) 0.0000 (1.0) 534.7897 (1.05) 0.0000 (1.0) 0;0 1.8699 (0.95) 1 1 test_status-status-changed-noop[2.41.1] 535.6727 (1.05) 535.6727 (1.05) 535.6727 (1.05) 0.0000 (1.0) 535.6727 (1.05) 0.0000 (1.0) 0;0 1.8668 (0.95) 1 1 test_status-status-changed-noop[2.45.0] 562.4674 (1.10) 562.4674 (1.10) 562.4674 (1.10) 0.0000 (1.0) 562.4674 (1.10) 0.0000 (1.0) 0;0 1.7779 (0.91) 1 1 test_status-status-changed-noop[main] 627.5970 (1.23) 627.5970 (1.23) 627.5970 (1.23) 0.0000 (1.0) 627.5970 (1.23) 0.0000 (1.0) 0;0 1.5934 (0.81) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.11.0] 424.5598 (1.0) 424.5598 (1.0) 424.5598 (1.0) 0.0000 (1.0) 424.5598 (1.0) 0.0000 (1.0) 0;0 2.3554 (1.0) 1 1 test_status-status-noop[2.18.1] 504.6245 (1.19) 504.6245 (1.19) 504.6245 (1.19) 0.0000 (1.0) 504.6245 (1.19) 0.0000 (1.0) 0;0 1.9817 (0.84) 1 1 test_status-status-noop[2.39.0] 532.1422 (1.25) 532.1422 (1.25) 532.1422 (1.25) 0.0000 (1.0) 532.1422 (1.25) 0.0000 (1.0) 0;0 1.8792 (0.80) 1 1 test_status-status-noop[2.40.0] 537.1699 (1.27) 537.1699 (1.27) 537.1699 (1.27) 0.0000 (1.0) 537.1699 (1.27) 0.0000 (1.0) 0;0 1.8616 (0.79) 1 1 test_status-status-noop[2.41.1] 538.3474 (1.27) 538.3474 (1.27) 538.3474 (1.27) 0.0000 (1.0) 538.3474 (1.27) 0.0000 (1.0) 0;0 1.8575 (0.79) 1 1 test_status-status-noop[2.45.0] 558.3375 (1.32) 558.3375 (1.32) 558.3375 (1.32) 0.0000 (1.0) 558.3375 (1.32) 0.0000 (1.0) 0;0 1.7910 (0.76) 1 1 test_status-status-noop[main] 626.8606 (1.48) 626.8606 (1.48) 626.8606 (1.48) 0.0000 (1.0) 626.8606 (1.48) 0.0000 (1.0) 0;0 1.5953 (0.68) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.11.0] 166.3937 (1.0) 202.7055 (1.13) 171.7606 (1.0) 6.2124 (4.17) 169.7992 (1.0) 2.9017 (1.18) 14;17 5.8221 (1.0) 100 1 test_help---help[2.18.1] 171.5126 (1.03) 198.6025 (1.11) 175.3736 (1.02) 3.2894 (2.21) 174.6242 (1.03) 3.3985 (1.38) 13;2 5.7021 (0.98) 100 1 test_help---help[2.39.0] 219.6082 (1.32) 256.4380 (1.43) 225.2504 (1.31) 5.1431 (3.45) 224.1017 (1.32) 5.0197 (2.04) 11;5 4.4395 (0.76) 100 1 test_help---help[2.40.0] 219.2601 (1.32) 242.4532 (1.35) 224.6014 (1.31) 4.5350 (3.04) 223.8921 (1.32) 4.8845 (1.98) 18;5 4.4523 (0.76) 100 1 test_help---help[2.41.1] 219.1288 (1.32) 253.0126 (1.41) 225.7881 (1.31) 5.4333 (3.65) 224.6454 (1.32) 4.3957 (1.79) 15;6 4.4289 (0.76) 100 1 test_help---help[2.45.0] 173.4955 (1.04) 182.5713 (1.02) 177.6174 (1.03) 2.2354 (1.50) 178.1316 (1.05) 2.9640 (1.20) 33;0 5.6301 (0.97) 100 1 test_help---help[main] 172.3337 (1.04) 179.0733 (1.0) 175.8226 (1.02) 1.4902 (1.0) 175.8775 (1.04) 2.4625 (1.0) 35;0 5.6875 (0.98) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.11.0] 1.6999 (1.07) 1.6999 (1.07) 1.6999 (1.07) 0.0000 (1.0) 1.6999 (1.07) 0.0000 (1.0) 0;0 0.5883 (0.94) 1 1 test_checkout_symlink-checkout[2.18.1] 1.6040 (1.01) 1.6040 (1.01) 1.6040 (1.01) 0.0000 (1.0) 1.6040 (1.01) 0.0000 (1.0) 0;0 0.6235 (0.99) 1 1 test_checkout_symlink-checkout[2.39.0] 1.6311 (1.02) 1.6311 (1.02) 1.6311 (1.02) 0.0000 (1.0) 1.6311 (1.02) 0.0000 (1.0) 0;0 0.6131 (0.98) 1 1 test_checkout_symlink-checkout[2.40.0] 1.5920 (1.0) 1.5920 (1.0) 1.5920 (1.0) 0.0000 (1.0) 1.5920 (1.0) 0.0000 (1.0) 0;0 0.6281 (1.0) 1 1 test_checkout_symlink-checkout[2.41.1] 1.7025 (1.07) 1.7025 (1.07) 1.7025 (1.07) 0.0000 (1.0) 1.7025 (1.07) 0.0000 (1.0) 0;0 0.5874 (0.94) 1 1 test_checkout_symlink-checkout[2.45.0] 2.0606 (1.29) 2.0606 (1.29) 2.0606 (1.29) 0.0000 (1.0) 2.0606 (1.29) 0.0000 (1.0) 0;0 0.4853 (0.77) 1 1 test_checkout_symlink-checkout[main] 1.7957 (1.13) 1.7957 (1.13) 1.7957 (1.13) 0.0000 (1.0) 1.7957 (1.13) 0.0000 (1.0) 0;0 0.5569 (0.89) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.11.0] 601.7891 (1.0) 601.7891 (1.0) 601.7891 (1.0) 0.0000 (1.0) 601.7891 (1.0) 0.0000 (1.0) 0;0 1.6617 (1.0) 1 1 test_checkout_symlink-checkout-noop[2.18.1] 649.6259 (1.08) 649.6259 (1.08) 649.6259 (1.08) 0.0000 (1.0) 649.6259 (1.08) 0.0000 (1.0) 0;0 1.5393 (0.93) 1 1 test_checkout_symlink-checkout-noop[2.39.0] 703.2973 (1.17) 703.2973 (1.17) 703.2973 (1.17) 0.0000 (1.0) 703.2973 (1.17) 0.0000 (1.0) 0;0 1.4219 (0.86) 1 1 test_checkout_symlink-checkout-noop[2.40.0] 668.7142 (1.11) 668.7142 (1.11) 668.7142 (1.11) 0.0000 (1.0) 668.7142 (1.11) 0.0000 (1.0) 0;0 1.4954 (0.90) 1 1 test_checkout_symlink-checkout-noop[2.41.1] 722.7021 (1.20) 722.7021 (1.20) 722.7021 (1.20) 0.0000 (1.0) 722.7021 (1.20) 0.0000 (1.0) 0;0 1.3837 (0.83) 1 1 test_checkout_symlink-checkout-noop[2.45.0] 757.6629 (1.26) 757.6629 (1.26) 757.6629 (1.26) 0.0000 (1.0) 757.6629 (1.26) 0.0000 (1.0) 0;0 1.3198 (0.79) 1 1 test_checkout_symlink-checkout-noop[main] 819.4755 (1.36) 819.4755 (1.36) 819.4755 (1.36) 0.0000 (1.0) 819.4755 (1.36) 0.0000 (1.0) 0;0 1.2203 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-update[2.11.0] 1.7005 (2.20) 1.7005 (2.20) 1.7005 (2.20) 0.0000 (1.0) 1.7005 (2.20) 0.0000 (1.0) 0;0 0.5881 (0.45) 1 1 test_checkout_symlink-checkout-update[2.18.1] 0.7736 (1.0) 0.7736 (1.0) 0.7736 (1.0) 0.0000 (1.0) 0.7736 (1.0) 0.0000 (1.0) 0;0 1.2927 (1.0) 1 1 test_checkout_symlink-checkout-update[2.39.0] 0.8019 (1.04) 0.8019 (1.04) 0.8019 (1.04) 0.0000 (1.0) 0.8019 (1.04) 0.0000 (1.0) 0;0 1.2470 (0.96) 1 1 test_checkout_symlink-checkout-update[2.40.0] 0.7841 (1.01) 0.7841 (1.01) 0.7841 (1.01) 0.0000 (1.0) 0.7841 (1.01) 0.0000 (1.0) 0;0 1.2754 (0.99) 1 1 test_checkout_symlink-checkout-update[2.41.1] 0.8142 (1.05) 0.8142 (1.05) 0.8142 (1.05) 0.0000 (1.0) 0.8142 (1.05) 0.0000 (1.0) 0;0 1.2281 (0.95) 1 1 test_checkout_symlink-checkout-update[2.45.0] 0.8985 (1.16) 0.8985 (1.16) 0.8985 (1.16) 0.0000 (1.0) 0.8985 (1.16) 0.0000 (1.0) 0;0 1.1129 (0.86) 1 1 test_checkout_symlink-checkout-update[main] 1.0664 (1.38) 1.0664 (1.38) 1.0664 (1.38) 0.0000 (1.0) 1.0664 (1.38) 0.0000 (1.0) 0;0 0.9378 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.11.0] 15.5167 (1.41) 15.5167 (1.41) 15.5167 (1.41) 0.0000 (1.0) 15.5167 (1.41) 0.0000 (1.0) 0;0 0.0644 (0.71) 1 1 test_import_url-import-url[2.18.1] 14.0220 (1.28) 14.0220 (1.28) 14.0220 (1.28) 0.0000 (1.0) 14.0220 (1.28) 0.0000 (1.0) 0;0 0.0713 (0.78) 1 1 test_import_url-import-url[2.39.0] 13.2911 (1.21) 13.2911 (1.21) 13.2911 (1.21) 0.0000 (1.0) 13.2911 (1.21) 0.0000 (1.0) 0;0 0.0752 (0.83) 1 1 test_import_url-import-url[2.40.0] 13.8364 (1.26) 13.8364 (1.26) 13.8364 (1.26) 0.0000 (1.0) 13.8364 (1.26) 0.0000 (1.0) 0;0 0.0723 (0.79) 1 1 test_import_url-import-url[2.41.1] 13.6445 (1.24) 13.6445 (1.24) 13.6445 (1.24) 0.0000 (1.0) 13.6445 (1.24) 0.0000 (1.0) 0;0 0.0733 (0.80) 1 1 test_import_url-import-url[2.45.0] 10.9680 (1.0) 10.9680 (1.0) 10.9680 (1.0) 0.0000 (1.0) 10.9680 (1.0) 0.0000 (1.0) 0;0 0.0912 (1.0) 1 1 test_import_url-import-url[main] 11.1988 (1.02) 11.1988 (1.02) 11.1988 (1.02) 0.0000 (1.0) 11.1988 (1.02) 0.0000 (1.0) 0;0 0.0893 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.11.0] 10.9785 (1.51) 10.9785 (1.51) 10.9785 (1.51) 0.0000 (1.0) 10.9785 (1.51) 0.0000 (1.0) 0;0 0.0911 (0.66) 1 1 test_import-import[2.18.1] 10.5001 (1.45) 10.5001 (1.45) 10.5001 (1.45) 0.0000 (1.0) 10.5001 (1.45) 0.0000 (1.0) 0;0 0.0952 (0.69) 1 1 test_import-import[2.39.0] 9.1515 (1.26) 9.1515 (1.26) 9.1515 (1.26) 0.0000 (1.0) 9.1515 (1.26) 0.0000 (1.0) 0;0 0.1093 (0.79) 1 1 test_import-import[2.40.0] 8.7585 (1.21) 8.7585 (1.21) 8.7585 (1.21) 0.0000 (1.0) 8.7585 (1.21) 0.0000 (1.0) 0;0 0.1142 (0.83) 1 1 test_import-import[2.41.1] 8.7544 (1.21) 8.7544 (1.21) 8.7544 (1.21) 0.0000 (1.0) 8.7544 (1.21) 0.0000 (1.0) 0;0 0.1142 (0.83) 1 1 test_import-import[2.45.0] 7.2584 (1.0) 7.2584 (1.0) 7.2584 (1.0) 0.0000 (1.0) 7.2584 (1.0) 0.0000 (1.0) 0;0 0.1378 (1.0) 1 1 test_import-import[main] 9.4613 (1.30) 9.4613 (1.30) 9.4613 (1.30) 0.0000 (1.0) 9.4613 (1.30) 0.0000 (1.0) 0;0 0.1057 (0.77) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.11.0] 1.6841 (1.20) 1.6841 (1.20) 1.6841 (1.20) 0.0000 (1.0) 1.6841 (1.20) 0.0000 (1.0) 0;0 0.5938 (0.84) 1 1 test_diff-diff[2.18.1] 1.4082 (1.00) 1.4082 (1.00) 1.4082 (1.00) 0.0000 (1.0) 1.4082 (1.00) 0.0000 (1.0) 0;0 0.7102 (1.00) 1 1 test_diff-diff[2.39.0] 1.4290 (1.02) 1.4290 (1.02) 1.4290 (1.02) 0.0000 (1.0) 1.4290 (1.02) 0.0000 (1.0) 0;0 0.6998 (0.98) 1 1 test_diff-diff[2.40.0] 1.4304 (1.02) 1.4304 (1.02) 1.4304 (1.02) 0.0000 (1.0) 1.4304 (1.02) 0.0000 (1.0) 0;0 0.6991 (0.98) 1 1 test_diff-diff[2.41.1] 1.4285 (1.01) 1.4285 (1.01) 1.4285 (1.01) 0.0000 (1.0) 1.4285 (1.01) 0.0000 (1.0) 0;0 0.7000 (0.99) 1 1 test_diff-diff[2.45.0] 1.4146 (1.01) 1.4146 (1.01) 1.4146 (1.01) 0.0000 (1.0) 1.4146 (1.01) 0.0000 (1.0) 0;0 0.7069 (0.99) 1 1 test_diff-diff[main] 1.4075 (1.0) 1.4075 (1.0) 1.4075 (1.0) 0.0000 (1.0) 1.4075 (1.0) 0.0000 (1.0) 0;0 0.7105 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.11.0] 1.1268 (1.69) 1.1268 (1.69) 1.1268 (1.69) 0.0000 (1.0) 1.1268 (1.69) 0.0000 (1.0) 0;0 0.8875 (0.59) 1 1 test_diff-diff-changed[2.18.1] 0.6667 (1.0) 0.6667 (1.0) 0.6667 (1.0) 0.0000 (1.0) 0.6667 (1.0) 0.0000 (1.0) 0;0 1.4999 (1.0) 1 1 test_diff-diff-changed[2.39.0] 0.6884 (1.03) 0.6884 (1.03) 0.6884 (1.03) 0.0000 (1.0) 0.6884 (1.03) 0.0000 (1.0) 0;0 1.4527 (0.97) 1 1 test_diff-diff-changed[2.40.0] 0.6841 (1.03) 0.6841 (1.03) 0.6841 (1.03) 0.0000 (1.0) 0.6841 (1.03) 0.0000 (1.0) 0;0 1.4617 (0.97) 1 1 test_diff-diff-changed[2.41.1] 0.6867 (1.03) 0.6867 (1.03) 0.6867 (1.03) 0.0000 (1.0) 0.6867 (1.03) 0.0000 (1.0) 0;0 1.4562 (0.97) 1 1 test_diff-diff-changed[2.45.0] 0.7076 (1.06) 0.7076 (1.06) 0.7076 (1.06) 0.0000 (1.0) 0.7076 (1.06) 0.0000 (1.0) 0;0 1.4133 (0.94) 1 1 test_diff-diff-changed[main] 0.7838 (1.18) 0.7838 (1.18) 0.7838 (1.18) 0.0000 (1.0) 0.7838 (1.18) 0.0000 (1.0) 0;0 1.2759 (0.85) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.11.0] 506.5383 (1.0) 506.5383 (1.0) 506.5383 (1.0) 0.0000 (1.0) 506.5383 (1.0) 0.0000 (1.0) 0;0 1.9742 (1.0) 1 1 test_diff-diff-changed-noop[2.18.1] 660.4385 (1.30) 660.4385 (1.30) 660.4385 (1.30) 0.0000 (1.0) 660.4385 (1.30) 0.0000 (1.0) 0;0 1.5141 (0.77) 1 1 test_diff-diff-changed-noop[2.39.0] 690.4282 (1.36) 690.4282 (1.36) 690.4282 (1.36) 0.0000 (1.0) 690.4282 (1.36) 0.0000 (1.0) 0;0 1.4484 (0.73) 1 1 test_diff-diff-changed-noop[2.40.0] 680.1899 (1.34) 680.1899 (1.34) 680.1899 (1.34) 0.0000 (1.0) 680.1899 (1.34) 0.0000 (1.0) 0;0 1.4702 (0.74) 1 1 test_diff-diff-changed-noop[2.41.1] 687.1435 (1.36) 687.1435 (1.36) 687.1435 (1.36) 0.0000 (1.0) 687.1435 (1.36) 0.0000 (1.0) 0;0 1.4553 (0.74) 1 1 test_diff-diff-changed-noop[2.45.0] 707.4151 (1.40) 707.4151 (1.40) 707.4151 (1.40) 0.0000 (1.0) 707.4151 (1.40) 0.0000 (1.0) 0;0 1.4136 (0.72) 1 1 test_diff-diff-changed-noop[main] 752.4136 (1.49) 752.4136 (1.49) 752.4136 (1.49) 0.0000 (1.0) 752.4136 (1.49) 0.0000 (1.0) 0;0 1.3291 (0.67) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.11.0] 468.1493 (1.0) 468.1493 (1.0) 468.1493 (1.0) 0.0000 (1.0) 468.1493 (1.0) 0.0000 (1.0) 0;0 2.1361 (1.0) 1 1 test_diff-diff-noop[2.18.1] 611.5601 (1.31) 611.5601 (1.31) 611.5601 (1.31) 0.0000 (1.0) 611.5601 (1.31) 0.0000 (1.0) 0;0 1.6352 (0.77) 1 1 test_diff-diff-noop[2.39.0] 644.5596 (1.38) 644.5596 (1.38) 644.5596 (1.38) 0.0000 (1.0) 644.5596 (1.38) 0.0000 (1.0) 0;0 1.5514 (0.73) 1 1 test_diff-diff-noop[2.40.0] 638.6653 (1.36) 638.6653 (1.36) 638.6653 (1.36) 0.0000 (1.0) 638.6653 (1.36) 0.0000 (1.0) 0;0 1.5658 (0.73) 1 1 test_diff-diff-noop[2.41.1] 648.8624 (1.39) 648.8624 (1.39) 648.8624 (1.39) 0.0000 (1.0) 648.8624 (1.39) 0.0000 (1.0) 0;0 1.5412 (0.72) 1 1 test_diff-diff-noop[2.45.0] 664.5104 (1.42) 664.5104 (1.42) 664.5104 (1.42) 0.0000 (1.0) 664.5104 (1.42) 0.0000 (1.0) 0;0 1.5049 (0.70) 1 1 test_diff-diff-noop[main] 692.3997 (1.48) 692.3997 (1.48) 692.3997 (1.48) 0.0000 (1.0) 692.3997 (1.48) 0.0000 (1.0) 0;0 1.4443 (0.68) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.11.0] 412.3915 (1.10) 412.3915 (1.10) 412.3915 (1.10) 0.0000 (1.0) 412.3915 (1.10) 0.0000 (1.0) 0;0 2.4249 (0.91) 1 1 test_list-list[2.18.1] 375.6353 (1.0) 375.6353 (1.0) 375.6353 (1.0) 0.0000 (1.0) 375.6353 (1.0) 0.0000 (1.0) 0;0 2.6622 (1.0) 1 1 test_list-list[2.39.0] 415.9678 (1.11) 415.9678 (1.11) 415.9678 (1.11) 0.0000 (1.0) 415.9678 (1.11) 0.0000 (1.0) 0;0 2.4040 (0.90) 1 1 test_list-list[2.40.0] 409.8062 (1.09) 409.8062 (1.09) 409.8062 (1.09) 0.0000 (1.0) 409.8062 (1.09) 0.0000 (1.0) 0;0 2.4402 (0.92) 1 1 test_list-list[2.41.1] 424.7203 (1.13) 424.7203 (1.13) 424.7203 (1.13) 0.0000 (1.0) 424.7203 (1.13) 0.0000 (1.0) 0;0 2.3545 (0.88) 1 1 test_list-list[2.45.0] 414.4253 (1.10) 414.4253 (1.10) 414.4253 (1.10) 0.0000 (1.0) 414.4253 (1.10) 0.0000 (1.0) 0;0 2.4130 (0.91) 1 1 test_list-list[main] 503.6370 (1.34) 503.6370 (1.34) 503.6370 (1.34) 0.0000 (1.0) 503.6370 (1.34) 0.0000 (1.0) 0;0 1.9856 (0.75) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.11.0] 395.9234 (1.09) 395.9234 (1.09) 395.9234 (1.09) 0.0000 (1.0) 395.9234 (1.09) 0.0000 (1.0) 0;0 2.5257 (0.92) 1 1 test_list-list-dvc-only[2.18.1] 363.7509 (1.0) 363.7509 (1.0) 363.7509 (1.0) 0.0000 (1.0) 363.7509 (1.0) 0.0000 (1.0) 0;0 2.7491 (1.0) 1 1 test_list-list-dvc-only[2.39.0] 396.7412 (1.09) 396.7412 (1.09) 396.7412 (1.09) 0.0000 (1.0) 396.7412 (1.09) 0.0000 (1.0) 0;0 2.5205 (0.92) 1 1 test_list-list-dvc-only[2.40.0] 400.2165 (1.10) 400.2165 (1.10) 400.2165 (1.10) 0.0000 (1.0) 400.2165 (1.10) 0.0000 (1.0) 0;0 2.4986 (0.91) 1 1 test_list-list-dvc-only[2.41.1] 409.8058 (1.13) 409.8058 (1.13) 409.8058 (1.13) 0.0000 (1.0) 409.8058 (1.13) 0.0000 (1.0) 0;0 2.4402 (0.89) 1 1 test_list-list-dvc-only[2.45.0] 407.5046 (1.12) 407.5046 (1.12) 407.5046 (1.12) 0.0000 (1.0) 407.5046 (1.12) 0.0000 (1.0) 0;0 2.4540 (0.89) 1 1 test_list-list-dvc-only[main] 493.5786 (1.36) 493.5786 (1.36) 493.5786 (1.36) 0.0000 (1.0) 493.5786 (1.36) 0.0000 (1.0) 0;0 2.0260 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.11.0] 1.6596 (3.53) 1.6596 (3.53) 1.6596 (3.53) 0.0000 (1.0) 1.6596 (3.53) 0.0000 (1.0) 0;0 0.6026 (0.28) 1 1 test_list-list-recursive[2.18.1] 2.3384 (4.97) 2.3384 (4.97) 2.3384 (4.97) 0.0000 (1.0) 2.3384 (4.97) 0.0000 (1.0) 0;0 0.4276 (0.20) 1 1 test_list-list-recursive[2.39.0] 0.7824 (1.66) 0.7824 (1.66) 0.7824 (1.66) 0.0000 (1.0) 0.7824 (1.66) 0.0000 (1.0) 0;0 1.2782 (0.60) 1 1 test_list-list-recursive[2.40.0] 0.4704 (1.0) 0.4704 (1.0) 0.4704 (1.0) 0.0000 (1.0) 0.4704 (1.0) 0.0000 (1.0) 0;0 2.1260 (1.0) 1 1 test_list-list-recursive[2.41.1] 0.4812 (1.02) 0.4812 (1.02) 0.4812 (1.02) 0.0000 (1.0) 0.4812 (1.02) 0.0000 (1.0) 0;0 2.0780 (0.98) 1 1 test_list-list-recursive[2.45.0] 0.4710 (1.00) 0.4710 (1.00) 0.4710 (1.00) 0.0000 (1.0) 0.4710 (1.00) 0.0000 (1.0) 0;0 2.1234 (1.00) 1 1 test_list-list-recursive[main] 0.5902 (1.25) 0.5902 (1.25) 0.5902 (1.25) 0.0000 (1.0) 0.5902 (1.25) 0.0000 (1.0) 0;0 1.6942 (0.80) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.11.0] 406.0852 (1.04) 406.0852 (1.04) 406.0852 (1.04) 0.0000 (1.0) 406.0852 (1.04) 0.0000 (1.0) 0;0 2.4625 (0.96) 1 1 test_list-list-shallow[2.18.1] 389.5163 (1.0) 389.5163 (1.0) 389.5163 (1.0) 0.0000 (1.0) 389.5163 (1.0) 0.0000 (1.0) 0;0 2.5673 (1.0) 1 1 test_list-list-shallow[2.39.0] 436.9378 (1.12) 436.9378 (1.12) 436.9378 (1.12) 0.0000 (1.0) 436.9378 (1.12) 0.0000 (1.0) 0;0 2.2887 (0.89) 1 1 test_list-list-shallow[2.40.0] 430.4966 (1.11) 430.4966 (1.11) 430.4966 (1.11) 0.0000 (1.0) 430.4966 (1.11) 0.0000 (1.0) 0;0 2.3229 (0.90) 1 1 test_list-list-shallow[2.41.1] 438.4918 (1.13) 438.4918 (1.13) 438.4918 (1.13) 0.0000 (1.0) 438.4918 (1.13) 0.0000 (1.0) 0;0 2.2805 (0.89) 1 1 test_list-list-shallow[2.45.0] 435.4487 (1.12) 435.4487 (1.12) 435.4487 (1.12) 0.0000 (1.0) 435.4487 (1.12) 0.0000 (1.0) 0;0 2.2965 (0.89) 1 1 test_list-list-shallow[main] 488.9409 (1.26) 488.9409 (1.26) 488.9409 (1.26) 0.0000 (1.0) 488.9409 (1.26) 0.0000 (1.0) 0;0 2.0452 (0.80) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.11.0] 1.1773 (1.02) 1.1773 (1.02) 1.1773 (1.02) 0.0000 (1.0) 1.1773 (1.02) 0.0000 (1.0) 0;0 0.8494 (0.98) 1 1 test_checkout_hardlink-checkout[2.18.1] 1.1563 (1.01) 1.1563 (1.01) 1.1563 (1.01) 0.0000 (1.0) 1.1563 (1.01) 0.0000 (1.0) 0;0 0.8648 (0.99) 1 1 test_checkout_hardlink-checkout[2.39.0] 1.5366 (1.34) 1.5366 (1.34) 1.5366 (1.34) 0.0000 (1.0) 1.5366 (1.34) 0.0000 (1.0) 0;0 0.6508 (0.75) 1 1 test_checkout_hardlink-checkout[2.40.0] 1.1491 (1.0) 1.1491 (1.0) 1.1491 (1.0) 0.0000 (1.0) 1.1491 (1.0) 0.0000 (1.0) 0;0 0.8702 (1.0) 1 1 test_checkout_hardlink-checkout[2.41.1] 1.1563 (1.01) 1.1563 (1.01) 1.1563 (1.01) 0.0000 (1.0) 1.1563 (1.01) 0.0000 (1.0) 0;0 0.8648 (0.99) 1 1 test_checkout_hardlink-checkout[2.45.0] 1.4029 (1.22) 1.4029 (1.22) 1.4029 (1.22) 0.0000 (1.0) 1.4029 (1.22) 0.0000 (1.0) 0;0 0.7128 (0.82) 1 1 test_checkout_hardlink-checkout[main] 1.3070 (1.14) 1.3070 (1.14) 1.3070 (1.14) 0.0000 (1.0) 1.3070 (1.14) 0.0000 (1.0) 0;0 0.7651 (0.88) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.11.0] 484.0905 (1.0) 484.0905 (1.0) 484.0905 (1.0) 0.0000 (1.0) 484.0905 (1.0) 0.0000 (1.0) 0;0 2.0657 (1.0) 1 1 test_checkout_hardlink-checkout-noop[2.18.1] 550.0707 (1.14) 550.0707 (1.14) 550.0707 (1.14) 0.0000 (1.0) 550.0707 (1.14) 0.0000 (1.0) 0;0 1.8179 (0.88) 1 1 test_checkout_hardlink-checkout-noop[2.39.0] 572.7518 (1.18) 572.7518 (1.18) 572.7518 (1.18) 0.0000 (1.0) 572.7518 (1.18) 0.0000 (1.0) 0;0 1.7460 (0.85) 1 1 test_checkout_hardlink-checkout-noop[2.40.0] 574.1961 (1.19) 574.1961 (1.19) 574.1961 (1.19) 0.0000 (1.0) 574.1961 (1.19) 0.0000 (1.0) 0;0 1.7416 (0.84) 1 1 test_checkout_hardlink-checkout-noop[2.41.1] 574.5647 (1.19) 574.5647 (1.19) 574.5647 (1.19) 0.0000 (1.0) 574.5647 (1.19) 0.0000 (1.0) 0;0 1.7404 (0.84) 1 1 test_checkout_hardlink-checkout-noop[2.45.0] 594.7202 (1.23) 594.7202 (1.23) 594.7202 (1.23) 0.0000 (1.0) 594.7202 (1.23) 0.0000 (1.0) 0;0 1.6815 (0.81) 1 1 test_checkout_hardlink-checkout-noop[main] 669.0464 (1.38) 669.0464 (1.38) 669.0464 (1.38) 0.0000 (1.0) 669.0464 (1.38) 0.0000 (1.0) 0;0 1.4947 (0.72) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.11.0] 1.2111 (1.92) 1.2111 (1.92) 1.2111 (1.92) 0.0000 (1.0) 1.2111 (1.92) 0.0000 (1.0) 0;0 0.8257 (0.52) 1 1 test_checkout_hardlink-checkout-update[2.18.1] 0.6304 (1.0) 0.6304 (1.0) 0.6304 (1.0) 0.0000 (1.0) 0.6304 (1.0) 0.0000 (1.0) 0;0 1.5864 (1.0) 1 1 test_checkout_hardlink-checkout-update[2.39.0] 0.6418 (1.02) 0.6418 (1.02) 0.6418 (1.02) 0.0000 (1.0) 0.6418 (1.02) 0.0000 (1.0) 0;0 1.5582 (0.98) 1 1 test_checkout_hardlink-checkout-update[2.40.0] 0.6453 (1.02) 0.6453 (1.02) 0.6453 (1.02) 0.0000 (1.0) 0.6453 (1.02) 0.0000 (1.0) 0;0 1.5497 (0.98) 1 1 test_checkout_hardlink-checkout-update[2.41.1] 0.6423 (1.02) 0.6423 (1.02) 0.6423 (1.02) 0.0000 (1.0) 0.6423 (1.02) 0.0000 (1.0) 0;0 1.5569 (0.98) 1 1 test_checkout_hardlink-checkout-update[2.45.0] 0.6682 (1.06) 0.6682 (1.06) 0.6682 (1.06) 0.0000 (1.0) 0.6682 (1.06) 0.0000 (1.0) 0;0 1.4967 (0.94) 1 1 test_checkout_hardlink-checkout-update[main] 0.8572 (1.36) 0.8572 (1.36) 0.8572 (1.36) 0.0000 (1.0) 0.8572 (1.36) 0.0000 (1.0) 0;0 1.1666 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.11.0] 3.7534 (1.19) 3.7534 (1.19) 3.7534 (1.19) 0.0000 (1.0) 3.7534 (1.19) 0.0000 (1.0) 0;0 0.2664 (0.84) 1 1 test_push-push[2.18.1] 3.7197 (1.17) 3.7197 (1.17) 3.7197 (1.17) 0.0000 (1.0) 3.7197 (1.17) 0.0000 (1.0) 0;0 0.2688 (0.85) 1 1 test_push-push[2.39.0] 4.7067 (1.49) 4.7067 (1.49) 4.7067 (1.49) 0.0000 (1.0) 4.7067 (1.49) 0.0000 (1.0) 0;0 0.2125 (0.67) 1 1 test_push-push[2.40.0] 5.0641 (1.60) 5.0641 (1.60) 5.0641 (1.60) 0.0000 (1.0) 5.0641 (1.60) 0.0000 (1.0) 0;0 0.1975 (0.63) 1 1 test_push-push[2.41.1] 4.6373 (1.46) 4.6373 (1.46) 4.6373 (1.46) 0.0000 (1.0) 4.6373 (1.46) 0.0000 (1.0) 0;0 0.2156 (0.68) 1 1 test_push-push[2.45.0] 3.1658 (1.0) 3.1658 (1.0) 3.1658 (1.0) 0.0000 (1.0) 3.1658 (1.0) 0.0000 (1.0) 0;0 0.3159 (1.0) 1 1 test_push-push[main] 3.2268 (1.02) 3.2268 (1.02) 3.2268 (1.02) 0.0000 (1.0) 3.2268 (1.02) 0.0000 (1.0) 0;0 0.3099 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial-add[2.11.0] 7.9266 (1.91) 7.9266 (1.91) 7.9266 (1.91) 0.0000 (1.0) 7.9266 (1.91) 0.0000 (1.0) 0;0 0.1262 (0.52) 1 1 test_partial_add-add-partial-add[2.18.1] 6.7996 (1.64) 6.7996 (1.64) 6.7996 (1.64) 0.0000 (1.0) 6.7996 (1.64) 0.0000 (1.0) 0;0 0.1471 (0.61) 1 1 test_partial_add-add-partial-add[2.39.0] 5.8419 (1.41) 5.8419 (1.41) 5.8419 (1.41) 0.0000 (1.0) 5.8419 (1.41) 0.0000 (1.0) 0;0 0.1712 (0.71) 1 1 test_partial_add-add-partial-add[2.40.0] 5.9492 (1.43) 5.9492 (1.43) 5.9492 (1.43) 0.0000 (1.0) 5.9492 (1.43) 0.0000 (1.0) 0;0 0.1681 (0.70) 1 1 test_partial_add-add-partial-add[2.41.1] 5.8351 (1.40) 5.8351 (1.40) 5.8351 (1.40) 0.0000 (1.0) 5.8351 (1.40) 0.0000 (1.0) 0;0 0.1714 (0.71) 1 1 test_partial_add-add-partial-add[2.45.0] 4.5803 (1.10) 4.5803 (1.10) 4.5803 (1.10) 0.0000 (1.0) 4.5803 (1.10) 0.0000 (1.0) 0;0 0.2183 (0.91) 1 1 test_partial_add-add-partial-add[main] 4.1534 (1.0) 4.1534 (1.0) 4.1534 (1.0) 0.0000 (1.0) 4.1534 (1.0) 0.0000 (1.0) 0;0 0.2408 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.11.0] 534.7270 (1.0) 534.7270 (1.0) 534.7270 (1.0) 0.0000 (1.0) 534.7270 (1.0) 0.0000 (1.0) 0;0 1.8701 (1.0) 1 1 test_partial_add-gc-cloud-noop[2.18.1] 578.5472 (1.08) 578.5472 (1.08) 578.5472 (1.08) 0.0000 (1.0) 578.5472 (1.08) 0.0000 (1.0) 0;0 1.7285 (0.92) 1 1 test_partial_add-gc-cloud-noop[2.39.0] 675.6527 (1.26) 675.6527 (1.26) 675.6527 (1.26) 0.0000 (1.0) 675.6527 (1.26) 0.0000 (1.0) 0;0 1.4801 (0.79) 1 1 test_partial_add-gc-cloud-noop[2.40.0] 629.5888 (1.18) 629.5888 (1.18) 629.5888 (1.18) 0.0000 (1.0) 629.5888 (1.18) 0.0000 (1.0) 0;0 1.5883 (0.85) 1 1 test_partial_add-gc-cloud-noop[2.41.1] 627.9148 (1.17) 627.9148 (1.17) 627.9148 (1.17) 0.0000 (1.0) 627.9148 (1.17) 0.0000 (1.0) 0;0 1.5926 (0.85) 1 1 test_partial_add-gc-cloud-noop[2.45.0] 610.3261 (1.14) 610.3261 (1.14) 610.3261 (1.14) 0.0000 (1.0) 610.3261 (1.14) 0.0000 (1.0) 0;0 1.6385 (0.88) 1 1 test_partial_add-gc-cloud-noop[main] 753.5073 (1.41) 753.5073 (1.41) 753.5073 (1.41) 0.0000 (1.0) 753.5073 (1.41) 0.0000 (1.0) 0;0 1.3271 (0.71) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.11.0] 461.1666 (1.0) 461.1666 (1.0) 461.1666 (1.0) 0.0000 (1.0) 461.1666 (1.0) 0.0000 (1.0) 0;0 2.1684 (1.0) 1 1 test_partial_add-gc-noop[2.18.1] 518.8899 (1.13) 518.8899 (1.13) 518.8899 (1.13) 0.0000 (1.0) 518.8899 (1.13) 0.0000 (1.0) 0;0 1.9272 (0.89) 1 1 test_partial_add-gc-noop[2.39.0] 557.4420 (1.21) 557.4420 (1.21) 557.4420 (1.21) 0.0000 (1.0) 557.4420 (1.21) 0.0000 (1.0) 0;0 1.7939 (0.83) 1 1 test_partial_add-gc-noop[2.40.0] 540.0473 (1.17) 540.0473 (1.17) 540.0473 (1.17) 0.0000 (1.0) 540.0473 (1.17) 0.0000 (1.0) 0;0 1.8517 (0.85) 1 1 test_partial_add-gc-noop[2.41.1] 551.2763 (1.20) 551.2763 (1.20) 551.2763 (1.20) 0.0000 (1.0) 551.2763 (1.20) 0.0000 (1.0) 0;0 1.8140 (0.84) 1 1 test_partial_add-gc-noop[2.45.0] 540.1677 (1.17) 540.1677 (1.17) 540.1677 (1.17) 0.0000 (1.0) 540.1677 (1.17) 0.0000 (1.0) 0;0 1.8513 (0.85) 1 1 test_partial_add-gc-noop[main] 627.6887 (1.36) 627.6887 (1.36) 627.6887 (1.36) 0.0000 (1.0) 627.6887 (1.36) 0.0000 (1.0) 0;0 1.5931 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial-add[2.11.0] 2.8212 (1.13) 2.8212 (1.13) 2.8212 (1.13) 0.0000 (1.0) 2.8212 (1.13) 0.0000 (1.0) 0;0 0.3545 (0.88) 1 1 test_partial_add-push-partial-add[2.18.1] 2.8022 (1.13) 2.8022 (1.13) 2.8022 (1.13) 0.0000 (1.0) 2.8022 (1.13) 0.0000 (1.0) 0;0 0.3569 (0.89) 1 1 test_partial_add-push-partial-add[2.39.0] 3.4184 (1.37) 3.4184 (1.37) 3.4184 (1.37) 0.0000 (1.0) 3.4184 (1.37) 0.0000 (1.0) 0;0 0.2925 (0.73) 1 1 test_partial_add-push-partial-add[2.40.0] 3.4468 (1.39) 3.4468 (1.39) 3.4468 (1.39) 0.0000 (1.0) 3.4468 (1.39) 0.0000 (1.0) 0;0 0.2901 (0.72) 1 1 test_partial_add-push-partial-add[2.41.1] 3.4054 (1.37) 3.4054 (1.37) 3.4054 (1.37) 0.0000 (1.0) 3.4054 (1.37) 0.0000 (1.0) 0;0 0.2937 (0.73) 1 1 test_partial_add-push-partial-add[2.45.0] 2.4886 (1.0) 2.4886 (1.0) 2.4886 (1.0) 0.0000 (1.0) 2.4886 (1.0) 0.0000 (1.0) 0;0 0.4018 (1.0) 1 1 test_partial_add-push-partial-add[main] 2.6178 (1.05) 2.6178 (1.05) 2.6178 (1.05) 0.0000 (1.0) 2.6178 (1.05) 0.0000 (1.0) 0;0 0.3820 (0.95) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.11.0] 426.5602 (1.0) 426.5602 (1.0) 426.5602 (1.0) 0.0000 (1.0) 426.5602 (1.0) 0.0000 (1.0) 0;0 2.3443 (1.0) 1 1 test_gc-gc[2.18.1] 443.0841 (1.04) 443.0841 (1.04) 443.0841 (1.04) 0.0000 (1.0) 443.0841 (1.04) 0.0000 (1.0) 0;0 2.2569 (0.96) 1 1 test_gc-gc[2.39.0] 475.7527 (1.12) 475.7527 (1.12) 475.7527 (1.12) 0.0000 (1.0) 475.7527 (1.12) 0.0000 (1.0) 0;0 2.1019 (0.90) 1 1 test_gc-gc[2.40.0] 478.2598 (1.12) 478.2598 (1.12) 478.2598 (1.12) 0.0000 (1.0) 478.2598 (1.12) 0.0000 (1.0) 0;0 2.0909 (0.89) 1 1 test_gc-gc[2.41.1] 479.2830 (1.12) 479.2830 (1.12) 479.2830 (1.12) 0.0000 (1.0) 479.2830 (1.12) 0.0000 (1.0) 0;0 2.0865 (0.89) 1 1 test_gc-gc[2.45.0] 473.9455 (1.11) 473.9455 (1.11) 473.9455 (1.11) 0.0000 (1.0) 473.9455 (1.11) 0.0000 (1.0) 0;0 2.1099 (0.90) 1 1 test_gc-gc[main] 532.1369 (1.25) 532.1369 (1.25) 532.1369 (1.25) 0.0000 (1.0) 532.1369 (1.25) 0.0000 (1.0) 0;0 1.8792 (0.80) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_pull-pull': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_pull-pull[2.11.0] 10.8930 (1.34) 10.8930 (1.34) 10.8930 (1.34) 0.0000 (1.0) 10.8930 (1.34) 0.0000 (1.0) 0;0 0.0918 (0.75) 1 1 test_pull-pull[2.18.1] 10.8162 (1.33) 10.8162 (1.33) 10.8162 (1.33) 0.0000 (1.0) 10.8162 (1.33) 0.0000 (1.0) 0;0 0.0925 (0.75) 1 1 test_pull-pull[2.39.0] 12.9413 (1.59) 12.9413 (1.59) 12.9413 (1.59) 0.0000 (1.0) 12.9413 (1.59) 0.0000 (1.0) 0;0 0.0773 (0.63) 1 1 test_pull-pull[2.40.0] 12.7503 (1.57) 12.7503 (1.57) 12.7503 (1.57) 0.0000 (1.0) 12.7503 (1.57) 0.0000 (1.0) 0;0 0.0784 (0.64) 1 1 test_pull-pull[2.41.1] 12.6332 (1.55) 12.6332 (1.55) 12.6332 (1.55) 0.0000 (1.0) 12.6332 (1.55) 0.0000 (1.0) 0;0 0.0792 (0.64) 1 1 test_pull-pull[2.45.0] 10.3528 (1.27) 10.3528 (1.27) 10.3528 (1.27) 0.0000 (1.0) 10.3528 (1.27) 0.0000 (1.0) 0;0 0.0966 (0.79) 1 1 test_pull-pull[main] 8.1306 (1.0) 8.1306 (1.0) 8.1306 (1.0) 0.0000 (1.0) 8.1306 (1.0) 0.0000 (1.0) 0;0 0.1230 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.11.0] 8.4243 (1.30) 8.4243 (1.30) 8.4243 (1.30) 0.0000 (1.0) 8.4243 (1.30) 0.0000 (1.0) 0;0 0.1187 (0.77) 1 1 test_update-update[2.18.1] 7.5083 (1.16) 7.5083 (1.16) 7.5083 (1.16) 0.0000 (1.0) 7.5083 (1.16) 0.0000 (1.0) 0;0 0.1332 (0.86) 1 1 test_update-update[2.39.0] 6.7245 (1.04) 6.7245 (1.04) 6.7245 (1.04) 0.0000 (1.0) 6.7245 (1.04) 0.0000 (1.0) 0;0 0.1487 (0.96) 1 1 test_update-update[2.40.0] 6.6944 (1.04) 6.6944 (1.04) 6.6944 (1.04) 0.0000 (1.0) 6.6944 (1.04) 0.0000 (1.0) 0;0 0.1494 (0.97) 1 1 test_update-update[2.41.1] 6.6924 (1.04) 6.6924 (1.04) 6.6924 (1.04) 0.0000 (1.0) 6.6924 (1.04) 0.0000 (1.0) 0;0 0.1494 (0.97) 1 1 test_update-update[2.45.0] 6.8292 (1.06) 6.8292 (1.06) 6.8292 (1.06) 0.0000 (1.0) 6.8292 (1.06) 0.0000 (1.0) 0;0 0.1464 (0.95) 1 1 test_update-update[main] 6.4640 (1.0) 6.4640 (1.0) 6.4640 (1.0) 0.0000 (1.0) 6.4640 (1.0) 0.0000 (1.0) 0;0 0.1547 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update-noop[2.11.0] 473.9848 (1.0) 473.9848 (1.0) 473.9848 (1.0) 0.0000 (1.0) 473.9848 (1.0) 0.0000 (1.0) 0;0 2.1098 (1.0) 1 1 test_update-update-noop[2.18.1] 608.0824 (1.28) 608.0824 (1.28) 608.0824 (1.28) 0.0000 (1.0) 608.0824 (1.28) 0.0000 (1.0) 0;0 1.6445 (0.78) 1 1 test_update-update-noop[2.39.0] 882.3391 (1.86) 882.3391 (1.86) 882.3391 (1.86) 0.0000 (1.0) 882.3391 (1.86) 0.0000 (1.0) 0;0 1.1334 (0.54) 1 1 test_update-update-noop[2.40.0] 890.0140 (1.88) 890.0140 (1.88) 890.0140 (1.88) 0.0000 (1.0) 890.0140 (1.88) 0.0000 (1.0) 0;0 1.1236 (0.53) 1 1 test_update-update-noop[2.41.1] 888.9932 (1.88) 888.9932 (1.88) 888.9932 (1.88) 0.0000 (1.0) 888.9932 (1.88) 0.0000 (1.0) 0;0 1.1249 (0.53) 1 1 test_update-update-noop[2.45.0] 993.5974 (2.10) 993.5974 (2.10) 993.5974 (2.10) 0.0000 (1.0) 993.5974 (2.10) 0.0000 (1.0) 0;0 1.0064 (0.48) 1 1 test_update-update-noop[main] 1,067.2471 (2.25) 1,067.2471 (2.25) 1,067.2471 (2.25) 0.0000 (1.0) 1,067.2471 (2.25) 0.0000 (1.0) 0;0 0.9370 (0.44) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed[2.18.1] 917.2110 (1.0) 917.2110 (1.0) 917.2110 (1.0) 0.0000 (1.0) 917.2110 (1.0) 0.0000 (1.0) 0;0 1.0903 (1.0) 1 1 test_data_status-data-changed[2.39.0] 979.4402 (1.07) 979.4402 (1.07) 979.4402 (1.07) 0.0000 (1.0) 979.4402 (1.07) 0.0000 (1.0) 0;0 1.0210 (0.94) 1 1 test_data_status-data-changed[2.40.0] 973.9766 (1.06) 973.9766 (1.06) 973.9766 (1.06) 0.0000 (1.0) 973.9766 (1.06) 0.0000 (1.0) 0;0 1.0267 (0.94) 1 1 test_data_status-data-changed[2.41.1] 971.2048 (1.06) 971.2048 (1.06) 971.2048 (1.06) 0.0000 (1.0) 971.2048 (1.06) 0.0000 (1.0) 0;0 1.0296 (0.94) 1 1 test_data_status-data-changed[2.45.0] 956.1046 (1.04) 956.1046 (1.04) 956.1046 (1.04) 0.0000 (1.0) 956.1046 (1.04) 0.0000 (1.0) 0;0 1.0459 (0.96) 1 1 test_data_status-data-changed[main] 1,014.3297 (1.11) 1,014.3297 (1.11) 1,014.3297 (1.11) 0.0000 (1.0) 1,014.3297 (1.11) 0.0000 (1.0) 0;0 0.9859 (0.90) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.18.1] 934.3623 (1.02) 934.3623 (1.02) 934.3623 (1.02) 0.0000 (1.0) 934.3623 (1.02) 0.0000 (1.0) 0;0 1.0702 (0.98) 1 1 test_data_status-data-changed-noop[2.39.0] 999.3950 (1.09) 999.3950 (1.09) 999.3950 (1.09) 0.0000 (1.0) 999.3950 (1.09) 0.0000 (1.0) 0;0 1.0006 (0.92) 1 1 test_data_status-data-changed-noop[2.40.0] 980.5604 (1.07) 980.5604 (1.07) 980.5604 (1.07) 0.0000 (1.0) 980.5604 (1.07) 0.0000 (1.0) 0;0 1.0198 (0.94) 1 1 test_data_status-data-changed-noop[2.41.1] 981.6018 (1.07) 981.6018 (1.07) 981.6018 (1.07) 0.0000 (1.0) 981.6018 (1.07) 0.0000 (1.0) 0;0 1.0187 (0.93) 1 1 test_data_status-data-changed-noop[2.45.0] 917.7082 (1.0) 917.7082 (1.0) 917.7082 (1.0) 0.0000 (1.0) 917.7082 (1.0) 0.0000 (1.0) 0;0 1.0897 (1.0) 1 1 test_data_status-data-changed-noop[main] 1,000.2328 (1.09) 1,000.2328 (1.09) 1,000.2328 (1.09) 0.0000 (1.0) 1,000.2328 (1.09) 0.0000 (1.0) 0;0 0.9998 (0.92) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.18.1] 2.1349 (1.03) 2.1349 (1.03) 2.1349 (1.03) 0.0000 (1.0) 2.1349 (1.03) 0.0000 (1.0) 0;0 0.4684 (0.97) 1 1 test_data_status-data-new[2.39.0] 2.1229 (1.03) 2.1229 (1.03) 2.1229 (1.03) 0.0000 (1.0) 2.1229 (1.03) 0.0000 (1.0) 0;0 0.4710 (0.97) 1 1 test_data_status-data-new[2.40.0] 2.1438 (1.04) 2.1438 (1.04) 2.1438 (1.04) 0.0000 (1.0) 2.1438 (1.04) 0.0000 (1.0) 0;0 0.4665 (0.96) 1 1 test_data_status-data-new[2.41.1] 2.2035 (1.07) 2.2035 (1.07) 2.2035 (1.07) 0.0000 (1.0) 2.2035 (1.07) 0.0000 (1.0) 0;0 0.4538 (0.94) 1 1 test_data_status-data-new[2.45.0] 2.0675 (1.0) 2.0675 (1.0) 2.0675 (1.0) 0.0000 (1.0) 2.0675 (1.0) 0.0000 (1.0) 0;0 0.4837 (1.0) 1 1 test_data_status-data-new[main] 2.1492 (1.04) 2.1492 (1.04) 2.1492 (1.04) 0.0000 (1.0) 2.1492 (1.04) 0.0000 (1.0) 0;0 0.4653 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.18.1] 920.5139 (1.0) 920.5139 (1.0) 920.5139 (1.0) 0.0000 (1.0) 920.5139 (1.0) 0.0000 (1.0) 0;0 1.0863 (1.0) 1 1 test_data_status-data-noop[2.39.0] 971.4129 (1.06) 971.4129 (1.06) 971.4129 (1.06) 0.0000 (1.0) 971.4129 (1.06) 0.0000 (1.0) 0;0 1.0294 (0.95) 1 1 test_data_status-data-noop[2.40.0] 994.0961 (1.08) 994.0961 (1.08) 994.0961 (1.08) 0.0000 (1.0) 994.0961 (1.08) 0.0000 (1.0) 0;0 1.0059 (0.93) 1 1 test_data_status-data-noop[2.41.1] 942.2631 (1.02) 942.2631 (1.02) 942.2631 (1.02) 0.0000 (1.0) 942.2631 (1.02) 0.0000 (1.0) 0;0 1.0613 (0.98) 1 1 test_data_status-data-noop[2.45.0] 972.0707 (1.06) 972.0707 (1.06) 972.0707 (1.06) 0.0000 (1.0) 972.0707 (1.06) 0.0000 (1.0) 0;0 1.0287 (0.95) 1 1 test_data_status-data-noop[main] 1,044.7109 (1.13) 1,044.7109 (1.13) 1,044.7109 (1.13) 0.0000 (1.0) 1,044.7109 (1.13) 0.0000 (1.0) 0;0 0.9572 (0.88) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_init-init': 7 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.11.0] 324.1176 (1.01) 415.7142 (1.16) 339.1561 (1.00) 10.1576 (1.42) 338.6667 (1.0) 8.5008 (1.49) 17;2 2.9485 (1.00) 100 1 test_init-init[2.18.1] 321.7034 (1.0) 359.9210 (1.0) 338.6807 (1.0) 7.5790 (1.06) 339.5465 (1.00) 9.2880 (1.63) 32;1 2.9526 (1.0) 100 1 test_init-init[2.39.0] 385.8530 (1.20) 421.6218 (1.17) 398.8483 (1.18) 7.1571 (1.0) 397.8800 (1.17) 9.0439 (1.59) 27;3 2.5072 (0.85) 100 1 test_init-init[2.40.0] 368.9713 (1.15) 440.1100 (1.22) 403.4643 (1.19) 21.8513 (3.05) 413.6419 (1.22) 43.9478 (7.71) 44;0 2.4785 (0.84) 100 1 test_init-init[2.41.1] 368.0809 (1.14) 439.5043 (1.22) 375.3284 (1.11) 7.9830 (1.12) 374.1631 (1.10) 5.6972 (1.0) 5;4 2.6643 (0.90) 100 1 test_init-init[2.45.0] 385.8672 (1.20) 420.6653 (1.17) 398.7059 (1.18) 7.4958 (1.05) 397.3696 (1.17) 9.2118 (1.62) 29;2 2.5081 (0.85) 100 1 test_init-init[main] 460.4860 (1.43) 504.0245 (1.40) 485.2068 (1.43) 7.3712 (1.03) 485.7851 (1.43) 8.9540 (1.57) 26;3 2.0610 (0.70) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.11.0] 6.5966 (1.80) 6.5966 (1.80) 6.5966 (1.80) 0.0000 (1.0) 6.5966 (1.80) 0.0000 (1.0) 0;0 0.1516 (0.56) 1 1 test_sharing_s3-add[2.11.0] 6.6509 (1.82) 6.6509 (1.82) 6.6509 (1.82) 0.0000 (1.0) 6.6509 (1.82) 0.0000 (1.0) 0;0 0.1504 (0.55) 1 1 test_sharing_s3-add[2.39.0] 5.4796 (1.50) 5.4796 (1.50) 5.4796 (1.50) 0.0000 (1.0) 5.4796 (1.50) 0.0000 (1.0) 0;0 0.1825 (0.67) 1 1 test_sharing_s3-add[2.39.0] 5.3567 (1.46) 5.3567 (1.46) 5.3567 (1.46) 0.0000 (1.0) 5.3567 (1.46) 0.0000 (1.0) 0;0 0.1867 (0.68) 1 1 test_sharing_s3-add[2.40.0] 5.5598 (1.52) 5.5598 (1.52) 5.5598 (1.52) 0.0000 (1.0) 5.5598 (1.52) 0.0000 (1.0) 0;0 0.1799 (0.66) 1 1 test_sharing_s3-add[2.40.0] 5.3995 (1.47) 5.3995 (1.47) 5.3995 (1.47) 0.0000 (1.0) 5.3995 (1.47) 0.0000 (1.0) 0;0 0.1852 (0.68) 1 1 test_sharing_s3-add[2.41.1] 5.5129 (1.50) 5.5129 (1.50) 5.5129 (1.50) 0.0000 (1.0) 5.5129 (1.50) 0.0000 (1.0) 0;0 0.1814 (0.66) 1 1 test_sharing_s3-add[2.41.1] 5.3763 (1.47) 5.3763 (1.47) 5.3763 (1.47) 0.0000 (1.0) 5.3763 (1.47) 0.0000 (1.0) 0;0 0.1860 (0.68) 1 1 test_sharing_s3-add[main] 3.6632 (1.0) 3.6632 (1.0) 3.6632 (1.0) 0.0000 (1.0) 3.6632 (1.0) 0.0000 (1.0) 0;0 0.2730 (1.0) 1 1 test_sharing_s3-add[main] 3.7708 (1.03) 3.7708 (1.03) 3.7708 (1.03) 0.0000 (1.0) 3.7708 (1.03) 0.0000 (1.0) 0;0 0.2652 (0.97) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.11.0] 3.2182 (1.47) 3.2182 (1.47) 3.2182 (1.47) 0.0000 (1.0) 3.2182 (1.47) 0.0000 (1.0) 0;0 0.3107 (0.68) 1 1 test_sharing_s3-add-noop[2.11.0] 3.2117 (1.46) 3.2117 (1.46) 3.2117 (1.46) 0.0000 (1.0) 3.2117 (1.46) 0.0000 (1.0) 0;0 0.3114 (0.68) 1 1 test_sharing_s3-add-noop[2.39.0] 2.2434 (1.02) 2.2434 (1.02) 2.2434 (1.02) 0.0000 (1.0) 2.2434 (1.02) 0.0000 (1.0) 0;0 0.4458 (0.98) 1 1 test_sharing_s3-add-noop[2.39.0] 2.1956 (1.00) 2.1956 (1.00) 2.1956 (1.00) 0.0000 (1.0) 2.1956 (1.00) 0.0000 (1.0) 0;0 0.4554 (1.00) 1 1 test_sharing_s3-add-noop[2.40.0] 2.2229 (1.01) 2.2229 (1.01) 2.2229 (1.01) 0.0000 (1.0) 2.2229 (1.01) 0.0000 (1.0) 0;0 0.4499 (0.99) 1 1 test_sharing_s3-add-noop[2.40.0] 2.1959 (1.00) 2.1959 (1.00) 2.1959 (1.00) 0.0000 (1.0) 2.1959 (1.00) 0.0000 (1.0) 0;0 0.4554 (1.00) 1 1 test_sharing_s3-add-noop[2.41.1] 2.2038 (1.01) 2.2038 (1.01) 2.2038 (1.01) 0.0000 (1.0) 2.2038 (1.01) 0.0000 (1.0) 0;0 0.4538 (1.00) 1 1 test_sharing_s3-add-noop[2.41.1] 2.1928 (1.0) 2.1928 (1.0) 2.1928 (1.0) 0.0000 (1.0) 2.1928 (1.0) 0.0000 (1.0) 0;0 0.4560 (1.0) 1 1 test_sharing_s3-add-noop[main] 2.4553 (1.12) 2.4553 (1.12) 2.4553 (1.12) 0.0000 (1.0) 2.4553 (1.12) 0.0000 (1.0) 0;0 0.4073 (0.89) 1 1 test_sharing_s3-add-noop[main] 2.4265 (1.11) 2.4265 (1.11) 2.4265 (1.11) 0.0000 (1.0) 2.4265 (1.11) 0.0000 (1.0) 0;0 0.4121 (0.90) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.11.0] 481.9058 (1.0) 481.9058 (1.0) 481.9058 (1.0) 0.0000 (1.0) 481.9058 (1.0) 0.0000 (1.0) 0;0 2.0751 (1.0) 1 1 test_sharing_s3-checkout-noop[2.11.0] 482.3181 (1.00) 482.3181 (1.00) 482.3181 (1.00) 0.0000 (1.0) 482.3181 (1.00) 0.0000 (1.0) 0;0 2.0733 (1.00) 1 1 test_sharing_s3-checkout-noop[2.39.0] 559.0312 (1.16) 559.0312 (1.16) 559.0312 (1.16) 0.0000 (1.0) 559.0312 (1.16) 0.0000 (1.0) 0;0 1.7888 (0.86) 1 1 test_sharing_s3-checkout-noop[2.39.0] 561.1058 (1.16) 561.1058 (1.16) 561.1058 (1.16) 0.0000 (1.0) 561.1058 (1.16) 0.0000 (1.0) 0;0 1.7822 (0.86) 1 1 test_sharing_s3-checkout-noop[2.40.0] 561.9384 (1.17) 561.9384 (1.17) 561.9384 (1.17) 0.0000 (1.0) 561.9384 (1.17) 0.0000 (1.0) 0;0 1.7796 (0.86) 1 1 test_sharing_s3-checkout-noop[2.40.0] 559.3296 (1.16) 559.3296 (1.16) 559.3296 (1.16) 0.0000 (1.0) 559.3296 (1.16) 0.0000 (1.0) 0;0 1.7879 (0.86) 1 1 test_sharing_s3-checkout-noop[2.41.1] 557.0112 (1.16) 557.0112 (1.16) 557.0112 (1.16) 0.0000 (1.0) 557.0112 (1.16) 0.0000 (1.0) 0;0 1.7953 (0.87) 1 1 test_sharing_s3-checkout-noop[2.41.1] 556.2265 (1.15) 556.2265 (1.15) 556.2265 (1.15) 0.0000 (1.0) 556.2265 (1.15) 0.0000 (1.0) 0;0 1.7978 (0.87) 1 1 test_sharing_s3-checkout-noop[main] 645.1881 (1.34) 645.1881 (1.34) 645.1881 (1.34) 0.0000 (1.0) 645.1881 (1.34) 0.0000 (1.0) 0;0 1.5499 (0.75) 1 1 test_sharing_s3-checkout-noop[main] 661.2785 (1.37) 661.2785 (1.37) 661.2785 (1.37) 0.0000 (1.0) 661.2785 (1.37) 0.0000 (1.0) 0;0 1.5122 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.11.0] 14.4852 (1.32) 14.4852 (1.32) 14.4852 (1.32) 0.0000 (1.0) 14.4852 (1.32) 0.0000 (1.0) 0;0 0.0690 (0.76) 1 1 test_sharing_s3-pull[2.11.0] 14.3071 (1.30) 14.3071 (1.30) 14.3071 (1.30) 0.0000 (1.0) 14.3071 (1.30) 0.0000 (1.0) 0;0 0.0699 (0.77) 1 1 test_sharing_s3-pull[2.39.0] 14.5644 (1.33) 14.5644 (1.33) 14.5644 (1.33) 0.0000 (1.0) 14.5644 (1.33) 0.0000 (1.0) 0;0 0.0687 (0.75) 1 1 test_sharing_s3-pull[2.39.0] 14.6964 (1.34) 14.6964 (1.34) 14.6964 (1.34) 0.0000 (1.0) 14.6964 (1.34) 0.0000 (1.0) 0;0 0.0680 (0.75) 1 1 test_sharing_s3-pull[2.40.0] 14.6263 (1.33) 14.6263 (1.33) 14.6263 (1.33) 0.0000 (1.0) 14.6263 (1.33) 0.0000 (1.0) 0;0 0.0684 (0.75) 1 1 test_sharing_s3-pull[2.40.0] 14.5080 (1.32) 14.5080 (1.32) 14.5080 (1.32) 0.0000 (1.0) 14.5080 (1.32) 0.0000 (1.0) 0;0 0.0689 (0.76) 1 1 test_sharing_s3-pull[2.41.1] 14.7289 (1.34) 14.7289 (1.34) 14.7289 (1.34) 0.0000 (1.0) 14.7289 (1.34) 0.0000 (1.0) 0;0 0.0679 (0.75) 1 1 test_sharing_s3-pull[2.41.1] 14.4526 (1.32) 14.4526 (1.32) 14.4526 (1.32) 0.0000 (1.0) 14.4526 (1.32) 0.0000 (1.0) 0;0 0.0692 (0.76) 1 1 test_sharing_s3-pull[main] 10.9827 (1.0) 10.9827 (1.0) 10.9827 (1.0) 0.0000 (1.0) 10.9827 (1.0) 0.0000 (1.0) 0;0 0.0911 (1.0) 1 1 test_sharing_s3-pull[main] 11.0182 (1.00) 11.0182 (1.00) 11.0182 (1.00) 0.0000 (1.0) 11.0182 (1.00) 0.0000 (1.0) 0;0 0.0908 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.11.0] 703.8275 (1.0) 703.8275 (1.0) 703.8275 (1.0) 0.0000 (1.0) 703.8275 (1.0) 0.0000 (1.0) 0;0 1.4208 (1.0) 1 1 test_sharing_s3-pull-noop[2.11.0] 709.5394 (1.01) 709.5394 (1.01) 709.5394 (1.01) 0.0000 (1.0) 709.5394 (1.01) 0.0000 (1.0) 0;0 1.4094 (0.99) 1 1 test_sharing_s3-pull-noop[2.39.0] 766.6834 (1.09) 766.6834 (1.09) 766.6834 (1.09) 0.0000 (1.0) 766.6834 (1.09) 0.0000 (1.0) 0;0 1.3043 (0.92) 1 1 test_sharing_s3-pull-noop[2.39.0] 769.4961 (1.09) 769.4961 (1.09) 769.4961 (1.09) 0.0000 (1.0) 769.4961 (1.09) 0.0000 (1.0) 0;0 1.2996 (0.91) 1 1 test_sharing_s3-pull-noop[2.40.0] 769.3470 (1.09) 769.3470 (1.09) 769.3470 (1.09) 0.0000 (1.0) 769.3470 (1.09) 0.0000 (1.0) 0;0 1.2998 (0.91) 1 1 test_sharing_s3-pull-noop[2.40.0] 781.0049 (1.11) 781.0049 (1.11) 781.0049 (1.11) 0.0000 (1.0) 781.0049 (1.11) 0.0000 (1.0) 0;0 1.2804 (0.90) 1 1 test_sharing_s3-pull-noop[2.41.1] 769.6384 (1.09) 769.6384 (1.09) 769.6384 (1.09) 0.0000 (1.0) 769.6384 (1.09) 0.0000 (1.0) 0;0 1.2993 (0.91) 1 1 test_sharing_s3-pull-noop[2.41.1] 766.4404 (1.09) 766.4404 (1.09) 766.4404 (1.09) 0.0000 (1.0) 766.4404 (1.09) 0.0000 (1.0) 0;0 1.3047 (0.92) 1 1 test_sharing_s3-pull-noop[main] 869.8994 (1.24) 869.8994 (1.24) 869.8994 (1.24) 0.0000 (1.0) 869.8994 (1.24) 0.0000 (1.0) 0;0 1.1496 (0.81) 1 1 test_sharing_s3-pull-noop[main] 870.8863 (1.24) 870.8863 (1.24) 870.8863 (1.24) 0.0000 (1.0) 870.8863 (1.24) 0.0000 (1.0) 0;0 1.1483 (0.81) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.11.0] 21.0077 (2.32) 21.0077 (2.32) 21.0077 (2.32) 0.0000 (1.0) 21.0077 (2.32) 0.0000 (1.0) 0;0 0.0476 (0.43) 1 1 test_sharing_s3-push[2.11.0] 20.4544 (2.26) 20.4544 (2.26) 20.4544 (2.26) 0.0000 (1.0) 20.4544 (2.26) 0.0000 (1.0) 0;0 0.0489 (0.44) 1 1 test_sharing_s3-push[2.39.0] 22.1830 (2.45) 22.1830 (2.45) 22.1830 (2.45) 0.0000 (1.0) 22.1830 (2.45) 0.0000 (1.0) 0;0 0.0451 (0.41) 1 1 test_sharing_s3-push[2.39.0] 22.7665 (2.52) 22.7665 (2.52) 22.7665 (2.52) 0.0000 (1.0) 22.7665 (2.52) 0.0000 (1.0) 0;0 0.0439 (0.40) 1 1 test_sharing_s3-push[2.40.0] 22.1969 (2.45) 22.1969 (2.45) 22.1969 (2.45) 0.0000 (1.0) 22.1969 (2.45) 0.0000 (1.0) 0;0 0.0451 (0.41) 1 1 test_sharing_s3-push[2.40.0] 22.4433 (2.48) 22.4433 (2.48) 22.4433 (2.48) 0.0000 (1.0) 22.4433 (2.48) 0.0000 (1.0) 0;0 0.0446 (0.40) 1 1 test_sharing_s3-push[2.41.1] 11.8357 (1.31) 11.8357 (1.31) 11.8357 (1.31) 0.0000 (1.0) 11.8357 (1.31) 0.0000 (1.0) 0;0 0.0845 (0.76) 1 1 test_sharing_s3-push[2.41.1] 11.9008 (1.32) 11.9008 (1.32) 11.9008 (1.32) 0.0000 (1.0) 11.9008 (1.32) 0.0000 (1.0) 0;0 0.0840 (0.76) 1 1 test_sharing_s3-push[main] 9.0471 (1.0) 9.0471 (1.0) 9.0471 (1.0) 0.0000 (1.0) 9.0471 (1.0) 0.0000 (1.0) 0;0 0.1105 (1.0) 1 1 test_sharing_s3-push[main] 9.1800 (1.01) 9.1800 (1.01) 9.1800 (1.01) 0.0000 (1.0) 9.1800 (1.01) 0.0000 (1.0) 0;0 0.1089 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push-noop[2.11.0] 949.5831 (1.0) 949.5831 (1.0) 949.5831 (1.0) 0.0000 (1.0) 949.5831 (1.0) 0.0000 (1.0) 0;0 1.0531 (1.0) 1 1 test_sharing_s3-push-noop[2.11.0] 1,047.5155 (1.10) 1,047.5155 (1.10) 1,047.5155 (1.10) 0.0000 (1.0) 1,047.5155 (1.10) 0.0000 (1.0) 0;0 0.9546 (0.91) 1 1 test_sharing_s3-push-noop[2.39.0] 987.1922 (1.04) 987.1922 (1.04) 987.1922 (1.04) 0.0000 (1.0) 987.1922 (1.04) 0.0000 (1.0) 0;0 1.0130 (0.96) 1 1 test_sharing_s3-push-noop[2.39.0] 1,060.3496 (1.12) 1,060.3496 (1.12) 1,060.3496 (1.12) 0.0000 (1.0) 1,060.3496 (1.12) 0.0000 (1.0) 0;0 0.9431 (0.90) 1 1 test_sharing_s3-push-noop[2.40.0] 967.8819 (1.02) 967.8819 (1.02) 967.8819 (1.02) 0.0000 (1.0) 967.8819 (1.02) 0.0000 (1.0) 0;0 1.0332 (0.98) 1 1 test_sharing_s3-push-noop[2.40.0] 971.9110 (1.02) 971.9110 (1.02) 971.9110 (1.02) 0.0000 (1.0) 971.9110 (1.02) 0.0000 (1.0) 0;0 1.0289 (0.98) 1 1 test_sharing_s3-push-noop[2.41.1] 966.5964 (1.02) 966.5964 (1.02) 966.5964 (1.02) 0.0000 (1.0) 966.5964 (1.02) 0.0000 (1.0) 0;0 1.0346 (0.98) 1 1 test_sharing_s3-push-noop[2.41.1] 994.0996 (1.05) 994.0996 (1.05) 994.0996 (1.05) 0.0000 (1.0) 994.0996 (1.05) 0.0000 (1.0) 0;0 1.0059 (0.96) 1 1 test_sharing_s3-push-noop[main] 1,053.0319 (1.11) 1,053.0319 (1.11) 1,053.0319 (1.11) 0.0000 (1.0) 1,053.0319 (1.11) 0.0000 (1.0) 0;0 0.9496 (0.90) 1 1 test_sharing_s3-push-noop[main] 1,056.7971 (1.11) 1,056.7971 (1.11) 1,056.7971 (1.11) 0.0000 (1.0) 1,056.7971 (1.11) 0.0000 (1.0) 0;0 0.9463 (0.90) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.11.0] 7.0547 (1.81) 7.0547 (1.81) 7.0547 (1.81) 0.0000 (1.0) 7.0547 (1.81) 0.0000 (1.0) 0;0 0.1417 (0.55) 1 1 test_sharing-add[2.18.1] 6.1276 (1.57) 6.1276 (1.57) 6.1276 (1.57) 0.0000 (1.0) 6.1276 (1.57) 0.0000 (1.0) 0;0 0.1632 (0.64) 1 1 test_sharing-add[2.39.0] 6.1603 (1.58) 6.1603 (1.58) 6.1603 (1.58) 0.0000 (1.0) 6.1603 (1.58) 0.0000 (1.0) 0;0 0.1623 (0.63) 1 1 test_sharing-add[2.40.0] 5.8710 (1.50) 5.8710 (1.50) 5.8710 (1.50) 0.0000 (1.0) 5.8710 (1.50) 0.0000 (1.0) 0;0 0.1703 (0.66) 1 1 test_sharing-add[2.41.1] 6.1367 (1.57) 6.1367 (1.57) 6.1367 (1.57) 0.0000 (1.0) 6.1367 (1.57) 0.0000 (1.0) 0;0 0.1630 (0.64) 1 1 test_sharing-add[2.45.0] 3.9023 (1.0) 3.9023 (1.0) 3.9023 (1.0) 0.0000 (1.0) 3.9023 (1.0) 0.0000 (1.0) 0;0 0.2563 (1.0) 1 1 test_sharing-add[main] 4.0003 (1.03) 4.0003 (1.03) 4.0003 (1.03) 0.0000 (1.0) 4.0003 (1.03) 0.0000 (1.0) 0;0 0.2500 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.11.0] 3.4094 (1.39) 3.4094 (1.39) 3.4094 (1.39) 0.0000 (1.0) 3.4094 (1.39) 0.0000 (1.0) 0;0 0.2933 (0.72) 1 1 test_sharing-add-noop[2.18.1] 3.6676 (1.49) 3.6676 (1.49) 3.6676 (1.49) 0.0000 (1.0) 3.6676 (1.49) 0.0000 (1.0) 0;0 0.2727 (0.67) 1 1 test_sharing-add-noop[2.39.0] 2.4759 (1.01) 2.4759 (1.01) 2.4759 (1.01) 0.0000 (1.0) 2.4759 (1.01) 0.0000 (1.0) 0;0 0.4039 (0.99) 1 1 test_sharing-add-noop[2.40.0] 2.4533 (1.0) 2.4533 (1.0) 2.4533 (1.0) 0.0000 (1.0) 2.4533 (1.0) 0.0000 (1.0) 0;0 0.4076 (1.0) 1 1 test_sharing-add-noop[2.41.1] 2.4751 (1.01) 2.4751 (1.01) 2.4751 (1.01) 0.0000 (1.0) 2.4751 (1.01) 0.0000 (1.0) 0;0 0.4040 (0.99) 1 1 test_sharing-add-noop[2.45.0] 2.6754 (1.09) 2.6754 (1.09) 2.6754 (1.09) 0.0000 (1.0) 2.6754 (1.09) 0.0000 (1.0) 0;0 0.3738 (0.92) 1 1 test_sharing-add-noop[main] 2.6721 (1.09) 2.6721 (1.09) 2.6721 (1.09) 0.0000 (1.0) 2.6721 (1.09) 0.0000 (1.0) 0;0 0.3742 (0.92) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.11.0] 492.4965 (1.0) 492.4965 (1.0) 492.4965 (1.0) 0.0000 (1.0) 492.4965 (1.0) 0.0000 (1.0) 0;0 2.0305 (1.0) 1 1 test_sharing-checkout-noop[2.18.1] 569.3057 (1.16) 569.3057 (1.16) 569.3057 (1.16) 0.0000 (1.0) 569.3057 (1.16) 0.0000 (1.0) 0;0 1.7565 (0.87) 1 1 test_sharing-checkout-noop[2.39.0] 599.6822 (1.22) 599.6822 (1.22) 599.6822 (1.22) 0.0000 (1.0) 599.6822 (1.22) 0.0000 (1.0) 0;0 1.6675 (0.82) 1 1 test_sharing-checkout-noop[2.40.0] 596.4006 (1.21) 596.4006 (1.21) 596.4006 (1.21) 0.0000 (1.0) 596.4006 (1.21) 0.0000 (1.0) 0;0 1.6767 (0.83) 1 1 test_sharing-checkout-noop[2.41.1] 592.8600 (1.20) 592.8600 (1.20) 592.8600 (1.20) 0.0000 (1.0) 592.8600 (1.20) 0.0000 (1.0) 0;0 1.6867 (0.83) 1 1 test_sharing-checkout-noop[2.45.0] 598.4427 (1.22) 598.4427 (1.22) 598.4427 (1.22) 0.0000 (1.0) 598.4427 (1.22) 0.0000 (1.0) 0;0 1.6710 (0.82) 1 1 test_sharing-checkout-noop[main] 669.4928 (1.36) 669.4928 (1.36) 669.4928 (1.36) 0.0000 (1.0) 669.4928 (1.36) 0.0000 (1.0) 0;0 1.4937 (0.74) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-pull': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[2.11.0] 7.0629 (1.30) 7.0629 (1.30) 7.0629 (1.30) 0.0000 (1.0) 7.0629 (1.30) 0.0000 (1.0) 0;0 0.1416 (0.77) 1 1 test_sharing-pull[2.18.1] 7.1905 (1.33) 7.1905 (1.33) 7.1905 (1.33) 0.0000 (1.0) 7.1905 (1.33) 0.0000 (1.0) 0;0 0.1391 (0.75) 1 1 test_sharing-pull[2.39.0] 8.4428 (1.56) 8.4428 (1.56) 8.4428 (1.56) 0.0000 (1.0) 8.4428 (1.56) 0.0000 (1.0) 0;0 0.1184 (0.64) 1 1 test_sharing-pull[2.40.0] 8.4671 (1.56) 8.4671 (1.56) 8.4671 (1.56) 0.0000 (1.0) 8.4671 (1.56) 0.0000 (1.0) 0;0 0.1181 (0.64) 1 1 test_sharing-pull[2.41.1] 8.4146 (1.55) 8.4146 (1.55) 8.4146 (1.55) 0.0000 (1.0) 8.4146 (1.55) 0.0000 (1.0) 0;0 0.1188 (0.64) 1 1 test_sharing-pull[2.45.0] 6.7085 (1.24) 6.7085 (1.24) 6.7085 (1.24) 0.0000 (1.0) 6.7085 (1.24) 0.0000 (1.0) 0;0 0.1491 (0.81) 1 1 test_sharing-pull[main] 5.4263 (1.0) 5.4263 (1.0) 5.4263 (1.0) 0.0000 (1.0) 5.4263 (1.0) 0.0000 (1.0) 0;0 0.1843 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[2.11.0] 508.8420 (1.0) 508.8420 (1.0) 508.8420 (1.0) 0.0000 (1.0) 508.8420 (1.0) 0.0000 (1.0) 0;0 1.9652 (1.0) 1 1 test_sharing-pull-noop[2.18.1] 598.5796 (1.18) 598.5796 (1.18) 598.5796 (1.18) 0.0000 (1.0) 598.5796 (1.18) 0.0000 (1.0) 0;0 1.6706 (0.85) 1 1 test_sharing-pull-noop[2.39.0] 627.2635 (1.23) 627.2635 (1.23) 627.2635 (1.23) 0.0000 (1.0) 627.2635 (1.23) 0.0000 (1.0) 0;0 1.5942 (0.81) 1 1 test_sharing-pull-noop[2.40.0] 623.8505 (1.23) 623.8505 (1.23) 623.8505 (1.23) 0.0000 (1.0) 623.8505 (1.23) 0.0000 (1.0) 0;0 1.6029 (0.82) 1 1 test_sharing-pull-noop[2.41.1] 620.5662 (1.22) 620.5662 (1.22) 620.5662 (1.22) 0.0000 (1.0) 620.5662 (1.22) 0.0000 (1.0) 0;0 1.6114 (0.82) 1 1 test_sharing-pull-noop[2.45.0] 644.7393 (1.27) 644.7393 (1.27) 644.7393 (1.27) 0.0000 (1.0) 644.7393 (1.27) 0.0000 (1.0) 0;0 1.5510 (0.79) 1 1 test_sharing-pull-noop[main] 724.7441 (1.42) 724.7441 (1.42) 724.7441 (1.42) 0.0000 (1.0) 724.7441 (1.42) 0.0000 (1.0) 0;0 1.3798 (0.70) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.11.0] 3.9134 (1.16) 3.9134 (1.16) 3.9134 (1.16) 0.0000 (1.0) 3.9134 (1.16) 0.0000 (1.0) 0;0 0.2555 (0.87) 1 1 test_sharing-push[2.18.1] 3.9294 (1.16) 3.9294 (1.16) 3.9294 (1.16) 0.0000 (1.0) 3.9294 (1.16) 0.0000 (1.0) 0;0 0.2545 (0.86) 1 1 test_sharing-push[2.39.0] 4.9693 (1.47) 4.9693 (1.47) 4.9693 (1.47) 0.0000 (1.0) 4.9693 (1.47) 0.0000 (1.0) 0;0 0.2012 (0.68) 1 1 test_sharing-push[2.40.0] 5.0089 (1.48) 5.0089 (1.48) 5.0089 (1.48) 0.0000 (1.0) 5.0089 (1.48) 0.0000 (1.0) 0;0 0.1996 (0.68) 1 1 test_sharing-push[2.41.1] 4.9367 (1.46) 4.9367 (1.46) 4.9367 (1.46) 0.0000 (1.0) 4.9367 (1.46) 0.0000 (1.0) 0;0 0.2026 (0.69) 1 1 test_sharing-push[2.45.0] 3.3853 (1.0) 3.3853 (1.0) 3.3853 (1.0) 0.0000 (1.0) 3.3853 (1.0) 0.0000 (1.0) 0;0 0.2954 (1.0) 1 1 test_sharing-push[main] 3.4835 (1.03) 3.4835 (1.03) 3.4835 (1.03) 0.0000 (1.0) 3.4835 (1.03) 0.0000 (1.0) 0;0 0.2871 (0.97) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.11.0] 425.0547 (1.0) 425.0547 (1.0) 425.0547 (1.0) 0.0000 (1.0) 425.0547 (1.0) 0.0000 (1.0) 0;0 2.3526 (1.0) 1 1 test_sharing-push-noop[2.18.1] 454.0097 (1.07) 454.0097 (1.07) 454.0097 (1.07) 0.0000 (1.0) 454.0097 (1.07) 0.0000 (1.0) 0;0 2.2026 (0.94) 1 1 test_sharing-push-noop[2.39.0] 470.9470 (1.11) 470.9470 (1.11) 470.9470 (1.11) 0.0000 (1.0) 470.9470 (1.11) 0.0000 (1.0) 0;0 2.1234 (0.90) 1 1 test_sharing-push-noop[2.40.0] 482.9300 (1.14) 482.9300 (1.14) 482.9300 (1.14) 0.0000 (1.0) 482.9300 (1.14) 0.0000 (1.0) 0;0 2.0707 (0.88) 1 1 test_sharing-push-noop[2.41.1] 475.2454 (1.12) 475.2454 (1.12) 475.2454 (1.12) 0.0000 (1.0) 475.2454 (1.12) 0.0000 (1.0) 0;0 2.1042 (0.89) 1 1 test_sharing-push-noop[2.45.0] 476.6941 (1.12) 476.6941 (1.12) 476.6941 (1.12) 0.0000 (1.0) 476.6941 (1.12) 0.0000 (1.0) 0;0 2.0978 (0.89) 1 1 test_sharing-push-noop[main] 558.5774 (1.31) 558.5774 (1.31) 558.5774 (1.31) 0.0000 (1.0) 558.5774 (1.31) 0.0000 (1.0) 0;0 1.7903 (0.76) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.11.0] 6.8561 (1.42) 6.8561 (1.42) 6.8561 (1.42) 0.0000 (1.0) 6.8561 (1.42) 0.0000 (1.0) 0;0 0.1459 (0.71) 1 1 test_get-get[2.18.1] 6.4180 (1.33) 6.4180 (1.33) 6.4180 (1.33) 0.0000 (1.0) 6.4180 (1.33) 0.0000 (1.0) 0;0 0.1558 (0.75) 1 1 test_get-get[2.39.0] 5.4103 (1.12) 5.4103 (1.12) 5.4103 (1.12) 0.0000 (1.0) 5.4103 (1.12) 0.0000 (1.0) 0;0 0.1848 (0.89) 1 1 test_get-get[2.40.0] 5.0093 (1.04) 5.0093 (1.04) 5.0093 (1.04) 0.0000 (1.0) 5.0093 (1.04) 0.0000 (1.0) 0;0 0.1996 (0.97) 1 1 test_get-get[2.41.1] 4.8384 (1.0) 4.8384 (1.0) 4.8384 (1.0) 0.0000 (1.0) 4.8384 (1.0) 0.0000 (1.0) 0;0 0.2067 (1.0) 1 1 test_get-get[2.45.0] 5.1127 (1.06) 5.1127 (1.06) 5.1127 (1.06) 0.0000 (1.0) 5.1127 (1.06) 0.0000 (1.0) 0;0 0.1956 (0.95) 1 1 test_get-get[main] 8.1261 (1.68) 8.1261 (1.68) 8.1261 (1.68) 0.0000 (1.0) 8.1261 (1.68) 0.0000 (1.0) 0;0 0.1231 (0.60) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add[2.11.0] 6.3364 (1.75) 6.3364 (1.75) 6.3364 (1.75) 0.0000 (1.0) 6.3364 (1.75) 0.0000 (1.0) 0;0 0.1578 (0.57) 1 1 test_sharing_azure-add[2.11.0] 6.3763 (1.76) 6.3763 (1.76) 6.3763 (1.76) 0.0000 (1.0) 6.3763 (1.76) 0.0000 (1.0) 0;0 0.1568 (0.57) 1 1 test_sharing_azure-add[2.39.0] 5.3699 (1.48) 5.3699 (1.48) 5.3699 (1.48) 0.0000 (1.0) 5.3699 (1.48) 0.0000 (1.0) 0;0 0.1862 (0.68) 1 1 test_sharing_azure-add[2.39.0] 5.4259 (1.50) 5.4259 (1.50) 5.4259 (1.50) 0.0000 (1.0) 5.4259 (1.50) 0.0000 (1.0) 0;0 0.1843 (0.67) 1 1 test_sharing_azure-add[2.40.0] 5.4866 (1.51) 5.4866 (1.51) 5.4866 (1.51) 0.0000 (1.0) 5.4866 (1.51) 0.0000 (1.0) 0;0 0.1823 (0.66) 1 1 test_sharing_azure-add[2.40.0] 5.4454 (1.50) 5.4454 (1.50) 5.4454 (1.50) 0.0000 (1.0) 5.4454 (1.50) 0.0000 (1.0) 0;0 0.1836 (0.67) 1 1 test_sharing_azure-add[2.41.1] 5.3266 (1.47) 5.3266 (1.47) 5.3266 (1.47) 0.0000 (1.0) 5.3266 (1.47) 0.0000 (1.0) 0;0 0.1877 (0.68) 1 1 test_sharing_azure-add[2.41.1] 5.3434 (1.47) 5.3434 (1.47) 5.3434 (1.47) 0.0000 (1.0) 5.3434 (1.47) 0.0000 (1.0) 0;0 0.1871 (0.68) 1 1 test_sharing_azure-add[main] 3.6282 (1.0) 3.6282 (1.0) 3.6282 (1.0) 0.0000 (1.0) 3.6282 (1.0) 0.0000 (1.0) 0;0 0.2756 (1.0) 1 1 test_sharing_azure-add[main] 4.1146 (1.13) 4.1146 (1.13) 4.1146 (1.13) 0.0000 (1.0) 4.1146 (1.13) 0.0000 (1.0) 0;0 0.2430 (0.88) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add-noop[2.11.0] 3.1740 (1.46) 3.1740 (1.46) 3.1740 (1.46) 0.0000 (1.0) 3.1740 (1.46) 0.0000 (1.0) 0;0 0.3151 (0.69) 1 1 test_sharing_azure-add-noop[2.11.0] 3.1685 (1.46) 3.1685 (1.46) 3.1685 (1.46) 0.0000 (1.0) 3.1685 (1.46) 0.0000 (1.0) 0;0 0.3156 (0.69) 1 1 test_sharing_azure-add-noop[2.39.0] 2.1827 (1.00) 2.1827 (1.00) 2.1827 (1.00) 0.0000 (1.0) 2.1827 (1.00) 0.0000 (1.0) 0;0 0.4581 (1.00) 1 1 test_sharing_azure-add-noop[2.39.0] 2.1778 (1.00) 2.1778 (1.00) 2.1778 (1.00) 0.0000 (1.0) 2.1778 (1.00) 0.0000 (1.0) 0;0 0.4592 (1.00) 1 1 test_sharing_azure-add-noop[2.40.0] 2.2154 (1.02) 2.2154 (1.02) 2.2154 (1.02) 0.0000 (1.0) 2.2154 (1.02) 0.0000 (1.0) 0;0 0.4514 (0.98) 1 1 test_sharing_azure-add-noop[2.40.0] 2.1907 (1.01) 2.1907 (1.01) 2.1907 (1.01) 0.0000 (1.0) 2.1907 (1.01) 0.0000 (1.0) 0;0 0.4565 (0.99) 1 1 test_sharing_azure-add-noop[2.41.1] 2.2063 (1.01) 2.2063 (1.01) 2.2063 (1.01) 0.0000 (1.0) 2.2063 (1.01) 0.0000 (1.0) 0;0 0.4532 (0.99) 1 1 test_sharing_azure-add-noop[2.41.1] 2.1762 (1.0) 2.1762 (1.0) 2.1762 (1.0) 0.0000 (1.0) 2.1762 (1.0) 0.0000 (1.0) 0;0 0.4595 (1.0) 1 1 test_sharing_azure-add-noop[main] 2.4223 (1.11) 2.4223 (1.11) 2.4223 (1.11) 0.0000 (1.0) 2.4223 (1.11) 0.0000 (1.0) 0;0 0.4128 (0.90) 1 1 test_sharing_azure-add-noop[main] 2.6153 (1.20) 2.6153 (1.20) 2.6153 (1.20) 0.0000 (1.0) 2.6153 (1.20) 0.0000 (1.0) 0;0 0.3824 (0.83) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-checkout-noop[2.11.0] 480.8730 (1.01) 480.8730 (1.01) 480.8730 (1.01) 0.0000 (1.0) 480.8730 (1.01) 0.0000 (1.0) 0;0 2.0796 (0.99) 1 1 test_sharing_azure-checkout-noop[2.11.0] 474.5764 (1.0) 474.5764 (1.0) 474.5764 (1.0) 0.0000 (1.0) 474.5764 (1.0) 0.0000 (1.0) 0;0 2.1071 (1.0) 1 1 test_sharing_azure-checkout-noop[2.39.0] 564.1475 (1.19) 564.1475 (1.19) 564.1475 (1.19) 0.0000 (1.0) 564.1475 (1.19) 0.0000 (1.0) 0;0 1.7726 (0.84) 1 1 test_sharing_azure-checkout-noop[2.39.0] 561.6745 (1.18) 561.6745 (1.18) 561.6745 (1.18) 0.0000 (1.0) 561.6745 (1.18) 0.0000 (1.0) 0;0 1.7804 (0.84) 1 1 test_sharing_azure-checkout-noop[2.40.0] 564.5982 (1.19) 564.5982 (1.19) 564.5982 (1.19) 0.0000 (1.0) 564.5982 (1.19) 0.0000 (1.0) 0;0 1.7712 (0.84) 1 1 test_sharing_azure-checkout-noop[2.40.0] 556.7122 (1.17) 556.7122 (1.17) 556.7122 (1.17) 0.0000 (1.0) 556.7122 (1.17) 0.0000 (1.0) 0;0 1.7963 (0.85) 1 1 test_sharing_azure-checkout-noop[2.41.1] 557.1290 (1.17) 557.1290 (1.17) 557.1290 (1.17) 0.0000 (1.0) 557.1290 (1.17) 0.0000 (1.0) 0;0 1.7949 (0.85) 1 1 test_sharing_azure-checkout-noop[2.41.1] 560.7060 (1.18) 560.7060 (1.18) 560.7060 (1.18) 0.0000 (1.0) 560.7060 (1.18) 0.0000 (1.0) 0;0 1.7835 (0.85) 1 1 test_sharing_azure-checkout-noop[main] 647.0438 (1.36) 647.0438 (1.36) 647.0438 (1.36) 0.0000 (1.0) 647.0438 (1.36) 0.0000 (1.0) 0;0 1.5455 (0.73) 1 1 test_sharing_azure-checkout-noop[main] 655.6870 (1.38) 655.6870 (1.38) 655.6870 (1.38) 0.0000 (1.0) 655.6870 (1.38) 0.0000 (1.0) 0;0 1.5251 (0.72) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull[2.11.0] 6.9296 (1.41) 6.9296 (1.41) 6.9296 (1.41) 0.0000 (1.0) 6.9296 (1.41) 0.0000 (1.0) 0;0 0.1443 (0.71) 1 1 test_sharing_azure-pull[2.11.0] 6.5061 (1.32) 6.5061 (1.32) 6.5061 (1.32) 0.0000 (1.0) 6.5061 (1.32) 0.0000 (1.0) 0;0 0.1537 (0.76) 1 1 test_sharing_azure-pull[2.39.0] 7.6731 (1.56) 7.6731 (1.56) 7.6731 (1.56) 0.0000 (1.0) 7.6731 (1.56) 0.0000 (1.0) 0;0 0.1303 (0.64) 1 1 test_sharing_azure-pull[2.39.0] 7.6966 (1.56) 7.6966 (1.56) 7.6966 (1.56) 0.0000 (1.0) 7.6966 (1.56) 0.0000 (1.0) 0;0 0.1299 (0.64) 1 1 test_sharing_azure-pull[2.40.0] 7.7167 (1.57) 7.7167 (1.57) 7.7167 (1.57) 0.0000 (1.0) 7.7167 (1.57) 0.0000 (1.0) 0;0 0.1296 (0.64) 1 1 test_sharing_azure-pull[2.40.0] 8.0202 (1.63) 8.0202 (1.63) 8.0202 (1.63) 0.0000 (1.0) 8.0202 (1.63) 0.0000 (1.0) 0;0 0.1247 (0.61) 1 1 test_sharing_azure-pull[2.41.1] 7.6541 (1.55) 7.6541 (1.55) 7.6541 (1.55) 0.0000 (1.0) 7.6541 (1.55) 0.0000 (1.0) 0;0 0.1306 (0.64) 1 1 test_sharing_azure-pull[2.41.1] 7.6014 (1.54) 7.6014 (1.54) 7.6014 (1.54) 0.0000 (1.0) 7.6014 (1.54) 0.0000 (1.0) 0;0 0.1316 (0.65) 1 1 test_sharing_azure-pull[main] 4.9307 (1.0) 4.9307 (1.0) 4.9307 (1.0) 0.0000 (1.0) 4.9307 (1.0) 0.0000 (1.0) 0;0 0.2028 (1.0) 1 1 test_sharing_azure-pull[main] 4.9460 (1.00) 4.9460 (1.00) 4.9460 (1.00) 0.0000 (1.0) 4.9460 (1.00) 0.0000 (1.0) 0;0 0.2022 (1.00) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing_azure-pull-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull-noop[2.11.0] 1.2385 (2.47) 1.2385 (2.47) 1.2385 (2.47) 0.0000 (1.0) 1.2385 (2.47) 0.0000 (1.0) 0;0 0.8075 (0.41) 1 1 test_sharing_azure-pull-noop[2.11.0] 0.5021 (1.0) 0.5021 (1.0) 0.5021 (1.0) 0.0000 (1.0) 0.5021 (1.0) 0.0000 (1.0) 0;0 1.9918 (1.0) 1 1 test_sharing_azure-pull-noop[2.39.0] 0.5901 (1.18) 0.5901 (1.18) 0.5901 (1.18) 0.0000 (1.0) 0.5901 (1.18) 0.0000 (1.0) 0;0 1.6946 (0.85) 1 1 test_sharing_azure-pull-noop[2.39.0] 0.5930 (1.18) 0.5930 (1.18) 0.5930 (1.18) 0.0000 (1.0) 0.5930 (1.18) 0.0000 (1.0) 0;0 1.6865 (0.85) 1 1 test_sharing_azure-pull-noop[2.40.0] 0.5978 (1.19) 0.5978 (1.19) 0.5978 (1.19) 0.0000 (1.0) 0.5978 (1.19) 0.0000 (1.0) 0;0 1.6727 (0.84) 1 1 test_sharing_azure-pull-noop[2.40.0] 0.5903 (1.18) 0.5903 (1.18) 0.5903 (1.18) 0.0000 (1.0) 0.5903 (1.18) 0.0000 (1.0) 0;0 1.6940 (0.85) 1 1 test_sharing_azure-pull-noop[2.41.1] 0.5853 (1.17) 0.5853 (1.17) 0.5853 (1.17) 0.0000 (1.0) 0.5853 (1.17) 0.0000 (1.0) 0;0 1.7085 (0.86) 1 1 test_sharing_azure-pull-noop[2.41.1] 0.5927 (1.18) 0.5927 (1.18) 0.5927 (1.18) 0.0000 (1.0) 0.5927 (1.18) 0.0000 (1.0) 0;0 1.6872 (0.85) 1 1 test_sharing_azure-pull-noop[main] 0.7018 (1.40) 0.7018 (1.40) 0.7018 (1.40) 0.0000 (1.0) 0.7018 (1.40) 0.0000 (1.0) 0;0 1.4249 (0.72) 1 1 test_sharing_azure-pull-noop[main] 0.6999 (1.39) 0.6999 (1.39) 0.6999 (1.39) 0.0000 (1.0) 0.6999 (1.39) 0.0000 (1.0) 0;0 1.4289 (0.72) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push[2.11.0] 3.6528 (1.13) 3.6528 (1.13) 3.6528 (1.13) 0.0000 (1.0) 3.6528 (1.13) 0.0000 (1.0) 0;0 0.2738 (0.88) 1 1 test_sharing_azure-push[2.11.0] 3.6375 (1.13) 3.6375 (1.13) 3.6375 (1.13) 0.0000 (1.0) 3.6375 (1.13) 0.0000 (1.0) 0;0 0.2749 (0.89) 1 1 test_sharing_azure-push[2.39.0] 4.6896 (1.45) 4.6896 (1.45) 4.6896 (1.45) 0.0000 (1.0) 4.6896 (1.45) 0.0000 (1.0) 0;0 0.2132 (0.69) 1 1 test_sharing_azure-push[2.39.0] 4.7763 (1.48) 4.7763 (1.48) 4.7763 (1.48) 0.0000 (1.0) 4.7763 (1.48) 0.0000 (1.0) 0;0 0.2094 (0.68) 1 1 test_sharing_azure-push[2.40.0] 4.6829 (1.45) 4.6829 (1.45) 4.6829 (1.45) 0.0000 (1.0) 4.6829 (1.45) 0.0000 (1.0) 0;0 0.2135 (0.69) 1 1 test_sharing_azure-push[2.40.0] 4.6430 (1.44) 4.6430 (1.44) 4.6430 (1.44) 0.0000 (1.0) 4.6430 (1.44) 0.0000 (1.0) 0;0 0.2154 (0.70) 1 1 test_sharing_azure-push[2.41.1] 4.6432 (1.44) 4.6432 (1.44) 4.6432 (1.44) 0.0000 (1.0) 4.6432 (1.44) 0.0000 (1.0) 0;0 0.2154 (0.70) 1 1 test_sharing_azure-push[2.41.1] 4.7168 (1.46) 4.7168 (1.46) 4.7168 (1.46) 0.0000 (1.0) 4.7168 (1.46) 0.0000 (1.0) 0;0 0.2120 (0.68) 1 1 test_sharing_azure-push[main] 3.2491 (1.01) 3.2491 (1.01) 3.2491 (1.01) 0.0000 (1.0) 3.2491 (1.01) 0.0000 (1.0) 0;0 0.3078 (0.99) 1 1 test_sharing_azure-push[main] 3.2282 (1.0) 3.2282 (1.0) 3.2282 (1.0) 0.0000 (1.0) 3.2282 (1.0) 0.0000 (1.0) 0;0 0.3098 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push-noop[2.11.0] 468.5034 (1.12) 468.5034 (1.12) 468.5034 (1.12) 0.0000 (1.0) 468.5034 (1.12) 0.0000 (1.0) 0;0 2.1345 (0.89) 1 1 test_sharing_azure-push-noop[2.11.0] 418.9125 (1.0) 418.9125 (1.0) 418.9125 (1.0) 0.0000 (1.0) 418.9125 (1.0) 0.0000 (1.0) 0;0 2.3871 (1.0) 1 1 test_sharing_azure-push-noop[2.39.0] 466.8319 (1.11) 466.8319 (1.11) 466.8319 (1.11) 0.0000 (1.0) 466.8319 (1.11) 0.0000 (1.0) 0;0 2.1421 (0.90) 1 1 test_sharing_azure-push-noop[2.39.0] 462.8539 (1.10) 462.8539 (1.10) 462.8539 (1.10) 0.0000 (1.0) 462.8539 (1.10) 0.0000 (1.0) 0;0 2.1605 (0.91) 1 1 test_sharing_azure-push-noop[2.40.0] 463.7113 (1.11) 463.7113 (1.11) 463.7113 (1.11) 0.0000 (1.0) 463.7113 (1.11) 0.0000 (1.0) 0;0 2.1565 (0.90) 1 1 test_sharing_azure-push-noop[2.40.0] 458.4779 (1.09) 458.4779 (1.09) 458.4779 (1.09) 0.0000 (1.0) 458.4779 (1.09) 0.0000 (1.0) 0;0 2.1811 (0.91) 1 1 test_sharing_azure-push-noop[2.41.1] 471.1644 (1.12) 471.1644 (1.12) 471.1644 (1.12) 0.0000 (1.0) 471.1644 (1.12) 0.0000 (1.0) 0;0 2.1224 (0.89) 1 1 test_sharing_azure-push-noop[2.41.1] 461.5231 (1.10) 461.5231 (1.10) 461.5231 (1.10) 0.0000 (1.0) 461.5231 (1.10) 0.0000 (1.0) 0;0 2.1667 (0.91) 1 1 test_sharing_azure-push-noop[main] 546.2941 (1.30) 546.2941 (1.30) 546.2941 (1.30) 0.0000 (1.0) 546.2941 (1.30) 0.0000 (1.0) 0;0 1.8305 (0.77) 1 1 test_sharing_azure-push-noop[main] 545.1689 (1.30) 545.1689 (1.30) 545.1689 (1.30) 0.0000 (1.0) 545.1689 (1.30) 0.0000 (1.0) 0;0 1.8343 (0.77) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.11.0] 2.8204 (1.81) 2.8204 (1.81) 2.8204 (1.81) 0.0000 (1.0) 2.8204 (1.81) 0.0000 (1.0) 0;0 0.3546 (0.55) 1 1 test_partial_remove-add[2.18.1] 2.4026 (1.54) 2.4026 (1.54) 2.4026 (1.54) 0.0000 (1.0) 2.4026 (1.54) 0.0000 (1.0) 0;0 0.4162 (0.65) 1 1 test_partial_remove-add[2.39.0] 1.7761 (1.14) 1.7761 (1.14) 1.7761 (1.14) 0.0000 (1.0) 1.7761 (1.14) 0.0000 (1.0) 0;0 0.5630 (0.88) 1 1 test_partial_remove-add[2.40.0] 1.8305 (1.17) 1.8305 (1.17) 1.8305 (1.17) 0.0000 (1.0) 1.8305 (1.17) 0.0000 (1.0) 0;0 0.5463 (0.85) 1 1 test_partial_remove-add[2.41.1] 1.7737 (1.14) 1.7737 (1.14) 1.7737 (1.14) 0.0000 (1.0) 1.7737 (1.14) 0.0000 (1.0) 0;0 0.5638 (0.88) 1 1 test_partial_remove-add[2.45.0] 1.7813 (1.14) 1.7813 (1.14) 1.7813 (1.14) 0.0000 (1.0) 1.7813 (1.14) 0.0000 (1.0) 0;0 0.5614 (0.88) 1 1 test_partial_remove-add[main] 1.5594 (1.0) 1.5594 (1.0) 1.5594 (1.0) 0.0000 (1.0) 1.5594 (1.0) 0.0000 (1.0) 0;0 0.6413 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.11.0] 450.7184 (1.0) 450.7184 (1.0) 450.7184 (1.0) 0.0000 (1.0) 450.7184 (1.0) 0.0000 (1.0) 0;0 2.2187 (1.0) 1 1 test_partial_remove-gc[2.18.1] 503.6321 (1.12) 503.6321 (1.12) 503.6321 (1.12) 0.0000 (1.0) 503.6321 (1.12) 0.0000 (1.0) 0;0 1.9856 (0.89) 1 1 test_partial_remove-gc[2.39.0] 526.5748 (1.17) 526.5748 (1.17) 526.5748 (1.17) 0.0000 (1.0) 526.5748 (1.17) 0.0000 (1.0) 0;0 1.8991 (0.86) 1 1 test_partial_remove-gc[2.40.0] 519.8161 (1.15) 519.8161 (1.15) 519.8161 (1.15) 0.0000 (1.0) 519.8161 (1.15) 0.0000 (1.0) 0;0 1.9238 (0.87) 1 1 test_partial_remove-gc[2.41.1] 508.1312 (1.13) 508.1312 (1.13) 508.1312 (1.13) 0.0000 (1.0) 508.1312 (1.13) 0.0000 (1.0) 0;0 1.9680 (0.89) 1 1 test_partial_remove-gc[2.45.0] 496.6527 (1.10) 496.6527 (1.10) 496.6527 (1.10) 0.0000 (1.0) 496.6527 (1.10) 0.0000 (1.0) 0;0 2.0135 (0.91) 1 1 test_partial_remove-gc[main] 580.0026 (1.29) 580.0026 (1.29) 580.0026 (1.29) 0.0000 (1.0) 580.0026 (1.29) 0.0000 (1.0) 0;0 1.7241 (0.78) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.11.0] 489.6219 (1.0) 489.6219 (1.0) 489.6219 (1.0) 0.0000 (1.0) 489.6219 (1.0) 0.0000 (1.0) 0;0 2.0424 (1.0) 1 1 test_partial_remove-gc-cloud[2.18.1] 534.8484 (1.09) 534.8484 (1.09) 534.8484 (1.09) 0.0000 (1.0) 534.8484 (1.09) 0.0000 (1.0) 0;0 1.8697 (0.92) 1 1 test_partial_remove-gc-cloud[2.39.0] 549.4298 (1.12) 549.4298 (1.12) 549.4298 (1.12) 0.0000 (1.0) 549.4298 (1.12) 0.0000 (1.0) 0;0 1.8201 (0.89) 1 1 test_partial_remove-gc-cloud[2.40.0] 541.7944 (1.11) 541.7944 (1.11) 541.7944 (1.11) 0.0000 (1.0) 541.7944 (1.11) 0.0000 (1.0) 0;0 1.8457 (0.90) 1 1 test_partial_remove-gc-cloud[2.41.1] 553.5874 (1.13) 553.5874 (1.13) 553.5874 (1.13) 0.0000 (1.0) 553.5874 (1.13) 0.0000 (1.0) 0;0 1.8064 (0.88) 1 1 test_partial_remove-gc-cloud[2.45.0] 531.2875 (1.09) 531.2875 (1.09) 531.2875 (1.09) 0.0000 (1.0) 531.2875 (1.09) 0.0000 (1.0) 0;0 1.8822 (0.92) 1 1 test_partial_remove-gc-cloud[main] 632.9660 (1.29) 632.9660 (1.29) 632.9660 (1.29) 0.0000 (1.0) 632.9660 (1.29) 0.0000 (1.0) 0;0 1.5799 (0.77) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.11.0] 441.3093 (1.0) 441.3093 (1.0) 441.3093 (1.0) 0.0000 (1.0) 441.3093 (1.0) 0.0000 (1.0) 0;0 2.2660 (1.0) 1 1 test_partial_remove-push[2.18.1] 492.8331 (1.12) 492.8331 (1.12) 492.8331 (1.12) 0.0000 (1.0) 492.8331 (1.12) 0.0000 (1.0) 0;0 2.0291 (0.90) 1 1 test_partial_remove-push[2.39.0] 488.9926 (1.11) 488.9926 (1.11) 488.9926 (1.11) 0.0000 (1.0) 488.9926 (1.11) 0.0000 (1.0) 0;0 2.0450 (0.90) 1 1 test_partial_remove-push[2.40.0] 502.7896 (1.14) 502.7896 (1.14) 502.7896 (1.14) 0.0000 (1.0) 502.7896 (1.14) 0.0000 (1.0) 0;0 1.9889 (0.88) 1 1 test_partial_remove-push[2.41.1] 488.0965 (1.11) 488.0965 (1.11) 488.0965 (1.11) 0.0000 (1.0) 488.0965 (1.11) 0.0000 (1.0) 0;0 2.0488 (0.90) 1 1 test_partial_remove-push[2.45.0] 483.3316 (1.10) 483.3316 (1.10) 483.3316 (1.10) 0.0000 (1.0) 483.3316 (1.10) 0.0000 (1.0) 0;0 2.0690 (0.91) 1 1 test_partial_remove-push[main] 604.8756 (1.37) 604.8756 (1.37) 604.8756 (1.37) 0.0000 (1.0) 604.8756 (1.37) 0.0000 (1.0) 0;0 1.6532 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.39.0] 1.1804 (1.13) 1.1919 (1.11) 1.1845 (1.12) 0.0046 (1.0) 1.1847 (1.13) 0.0060 (1.0) 1;0 0.8442 (0.89) 5 3 test_plots-plots-diff[2.40.0] 1.1829 (1.13) 1.2071 (1.12) 1.1946 (1.13) 0.0110 (2.37) 1.1909 (1.13) 0.0200 (3.32) 2;0 0.8371 (0.88) 5 3 test_plots-plots-diff[2.41.1] 1.2150 (1.17) 1.2391 (1.15) 1.2318 (1.17) 0.0098 (2.12) 1.2366 (1.17) 0.0103 (1.71) 1;0 0.8118 (0.86) 5 3 test_plots-plots-diff[2.45.0] 1.1167 (1.07) 1.1487 (1.07) 1.1278 (1.07) 0.0126 (2.72) 1.1231 (1.07) 0.0145 (2.41) 1;0 0.8867 (0.93) 5 3 test_plots-plots-diff[main] 1.0424 (1.0) 1.0763 (1.0) 1.0542 (1.0) 0.0134 (2.90) 1.0528 (1.0) 0.0159 (2.63) 1;0 0.9486 (1.0) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.39.0] 2.1372 (1.57) 2.1606 (1.54) 2.1488 (1.55) 0.0102 (1.42) 2.1470 (1.56) 0.0183 (2.16) 2;0 0.4654 (0.64) 5 3 test_plots-plots-diff-json[2.40.0] 2.1451 (1.58) 2.1632 (1.54) 2.1513 (1.56) 0.0072 (1.0) 2.1482 (1.56) 0.0084 (1.0) 1;0 0.4648 (0.64) 5 3 test_plots-plots-diff-json[2.41.1] 2.2274 (1.64) 2.2664 (1.61) 2.2433 (1.62) 0.0186 (2.60) 2.2321 (1.62) 0.0327 (3.87) 1;0 0.4458 (0.62) 5 3 test_plots-plots-diff-json[2.45.0] 1.9492 (1.43) 1.9832 (1.41) 1.9703 (1.43) 0.0139 (1.95) 1.9724 (1.43) 0.0211 (2.49) 1;0 0.5075 (0.70) 5 3 test_plots-plots-diff-json[main] 1.3597 (1.0) 1.4043 (1.0) 1.3824 (1.0) 0.0198 (2.76) 1.3781 (1.0) 0.0357 (4.23) 2;0 0.7234 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_plots-plots-show[2.39.0] 792.6623 (1.05) 809.9191 (1.03) 800.9045 (1.04) 6.2754 (1.03) 801.4182 (1.04) 7.1671 (1.0) 2;0 1.2486 (0.96) 5 3 test_plots-plots-show[2.40.0] 824.1613 (1.09) 842.3766 (1.07) 836.2469 (1.09) 7.3903 (1.21) 836.8029 (1.09) 9.2902 (1.30) 1;0 1.1958 (0.92) 5 3 test_plots-plots-show[2.41.1] 804.4589 (1.07) 838.9005 (1.07) 819.3660 (1.07) 13.9550 (2.29) 821.1749 (1.07) 21.6509 (3.02) 2;0 1.2205 (0.94) 5 3 test_plots-plots-show[2.45.0] 754.9777 (1.0) 787.5247 (1.0) 768.6367 (1.0) 12.2095 (2.00) 767.0382 (1.0) 15.1580 (2.11) 2;0 1.3010 (1.0) 5 3 test_plots-plots-show[main] 843.6583 (1.12) 859.2841 (1.09) 850.7789 (1.11) 6.0987 (1.0) 850.0004 (1.11) 9.2040 (1.28) 2;0 1.1754 (0.90) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.39.0] 1.3217 (1.29) 1.3588 (1.27) 1.3350 (1.27) 0.0161 (3.54) 1.3254 (1.26) 0.0242 (2.77) 1;0 0.7490 (0.79) 5 3 test_plots-plots-show-json[2.40.0] 1.3463 (1.31) 1.3557 (1.27) 1.3510 (1.29) 0.0045 (1.0) 1.3499 (1.29) 0.0087 (1.0) 3;0 0.7402 (0.78) 5 3 test_plots-plots-show-json[2.41.1] 1.3344 (1.30) 1.3524 (1.26) 1.3435 (1.28) 0.0069 (1.51) 1.3422 (1.28) 0.0095 (1.09) 2;0 0.7443 (0.78) 5 3 test_plots-plots-show-json[2.45.0] 1.2547 (1.22) 1.2828 (1.20) 1.2690 (1.21) 0.0123 (2.71) 1.2637 (1.21) 0.0206 (2.36) 2;0 0.7880 (0.83) 5 3 test_plots-plots-show-json[main] 1.0276 (1.0) 1.0709 (1.0) 1.0483 (1.0) 0.0160 (3.53) 1.0482 (1.0) 0.0208 (2.38) 2;0 0.9539 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.18.1] 1.1501 (1.0) 1.1501 (1.0) 1.1501 (1.0) 0.0000 (1.0) 1.1501 (1.0) 0.0000 (1.0) 0;0 0.8695 (1.0) 1 1 test_data_status_all_flags-data-changed[2.39.0] 1.1792 (1.03) 1.1792 (1.03) 1.1792 (1.03) 0.0000 (1.0) 1.1792 (1.03) 0.0000 (1.0) 0;0 0.8481 (0.98) 1 1 test_data_status_all_flags-data-changed[2.40.0] 1.1920 (1.04) 1.1920 (1.04) 1.1920 (1.04) 0.0000 (1.0) 1.1920 (1.04) 0.0000 (1.0) 0;0 0.8390 (0.96) 1 1 test_data_status_all_flags-data-changed[2.41.1] 1.1717 (1.02) 1.1717 (1.02) 1.1717 (1.02) 0.0000 (1.0) 1.1717 (1.02) 0.0000 (1.0) 0;0 0.8534 (0.98) 1 1 test_data_status_all_flags-data-changed[2.45.0] 1.1732 (1.02) 1.1732 (1.02) 1.1732 (1.02) 0.0000 (1.0) 1.1732 (1.02) 0.0000 (1.0) 0;0 0.8524 (0.98) 1 1 test_data_status_all_flags-data-changed[main] 1.2070 (1.05) 1.2070 (1.05) 1.2070 (1.05) 0.0000 (1.0) 1.2070 (1.05) 0.0000 (1.0) 0;0 0.8285 (0.95) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.18.1] 1.1500 (1.0) 1.1500 (1.0) 1.1500 (1.0) 0.0000 (1.0) 1.1500 (1.0) 0.0000 (1.0) 0;0 0.8696 (1.0) 1 1 test_data_status_all_flags-data-changed-noop[2.39.0] 1.1823 (1.03) 1.1823 (1.03) 1.1823 (1.03) 0.0000 (1.0) 1.1823 (1.03) 0.0000 (1.0) 0;0 0.8458 (0.97) 1 1 test_data_status_all_flags-data-changed-noop[2.40.0] 1.2120 (1.05) 1.2120 (1.05) 1.2120 (1.05) 0.0000 (1.0) 1.2120 (1.05) 0.0000 (1.0) 0;0 0.8251 (0.95) 1 1 test_data_status_all_flags-data-changed-noop[2.41.1] 1.1868 (1.03) 1.1868 (1.03) 1.1868 (1.03) 0.0000 (1.0) 1.1868 (1.03) 0.0000 (1.0) 0;0 0.8426 (0.97) 1 1 test_data_status_all_flags-data-changed-noop[2.45.0] 1.1788 (1.03) 1.1788 (1.03) 1.1788 (1.03) 0.0000 (1.0) 1.1788 (1.03) 0.0000 (1.0) 0;0 0.8483 (0.98) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.2089 (1.05) 1.2089 (1.05) 1.2089 (1.05) 0.0000 (1.0) 1.2089 (1.05) 0.0000 (1.0) 0;0 0.8272 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.18.1] 1.9092 (1.03) 1.9092 (1.03) 1.9092 (1.03) 0.0000 (1.0) 1.9092 (1.03) 0.0000 (1.0) 0;0 0.5238 (0.97) 1 1 test_data_status_all_flags-data-new[2.39.0] 1.9843 (1.07) 1.9843 (1.07) 1.9843 (1.07) 0.0000 (1.0) 1.9843 (1.07) 0.0000 (1.0) 0;0 0.5039 (0.93) 1 1 test_data_status_all_flags-data-new[2.40.0] 1.8975 (1.03) 1.8975 (1.03) 1.8975 (1.03) 0.0000 (1.0) 1.8975 (1.03) 0.0000 (1.0) 0;0 0.5270 (0.98) 1 1 test_data_status_all_flags-data-new[2.41.1] 1.9057 (1.03) 1.9057 (1.03) 1.9057 (1.03) 0.0000 (1.0) 1.9057 (1.03) 0.0000 (1.0) 0;0 0.5247 (0.97) 1 1 test_data_status_all_flags-data-new[2.45.0] 1.8503 (1.0) 1.8503 (1.0) 1.8503 (1.0) 0.0000 (1.0) 1.8503 (1.0) 0.0000 (1.0) 0;0 0.5404 (1.0) 1 1 test_data_status_all_flags-data-new[main] 1.9227 (1.04) 1.9227 (1.04) 1.9227 (1.04) 0.0000 (1.0) 1.9227 (1.04) 0.0000 (1.0) 0;0 0.5201 (0.96) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.18.1] 1.1082 (1.0) 1.1082 (1.0) 1.1082 (1.0) 0.0000 (1.0) 1.1082 (1.0) 0.0000 (1.0) 0;0 0.9023 (1.0) 1 1 test_data_status_all_flags-data-noop[2.39.0] 1.1243 (1.01) 1.1243 (1.01) 1.1243 (1.01) 0.0000 (1.0) 1.1243 (1.01) 0.0000 (1.0) 0;0 0.8894 (0.99) 1 1 test_data_status_all_flags-data-noop[2.40.0] 1.1280 (1.02) 1.1280 (1.02) 1.1280 (1.02) 0.0000 (1.0) 1.1280 (1.02) 0.0000 (1.0) 0;0 0.8865 (0.98) 1 1 test_data_status_all_flags-data-noop[2.41.1] 1.1231 (1.01) 1.1231 (1.01) 1.1231 (1.01) 0.0000 (1.0) 1.1231 (1.01) 0.0000 (1.0) 0;0 0.8904 (0.99) 1 1 test_data_status_all_flags-data-noop[2.45.0] 1.4174 (1.28) 1.4174 (1.28) 1.4174 (1.28) 0.0000 (1.0) 1.4174 (1.28) 0.0000 (1.0) 0;0 0.7055 (0.78) 1 1 test_data_status_all_flags-data-noop[main] 1.1701 (1.06) 1.1701 (1.06) 1.1701 (1.06) 0.0000 (1.0) 1.1701 (1.06) 0.0000 (1.0) 0;0 0.8546 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.11.0] 3.8604 (1.11) 3.8604 (1.11) 3.8604 (1.11) 0.0000 (1.0) 3.8604 (1.11) 0.0000 (1.0) 0;0 0.2590 (0.90) 1 1 test_exp_show-exp[2.18.1] 3.9091 (1.13) 3.9091 (1.13) 3.9091 (1.13) 0.0000 (1.0) 3.9091 (1.13) 0.0000 (1.0) 0;0 0.2558 (0.89) 1 1 test_exp_show-exp[2.39.0] 3.4727 (1.00) 3.4727 (1.00) 3.4727 (1.00) 0.0000 (1.0) 3.4727 (1.00) 0.0000 (1.0) 0;0 0.2880 (1.00) 1 1 test_exp_show-exp[2.40.0] 3.4738 (1.00) 3.4738 (1.00) 3.4738 (1.00) 0.0000 (1.0) 3.4738 (1.00) 0.0000 (1.0) 0;0 0.2879 (1.00) 1 1 test_exp_show-exp[2.41.1] 3.5147 (1.01) 3.5147 (1.01) 3.5147 (1.01) 0.0000 (1.0) 3.5147 (1.01) 0.0000 (1.0) 0;0 0.2845 (0.99) 1 1 test_exp_show-exp[2.45.0] 3.4678 (1.0) 3.4678 (1.0) 3.4678 (1.0) 0.0000 (1.0) 3.4678 (1.0) 0.0000 (1.0) 0;0 0.2884 (1.0) 1 1 test_exp_show-exp[main] 4.4306 (1.28) 4.4306 (1.28) 4.4306 (1.28) 0.0000 (1.0) 4.4306 (1.28) 0.0000 (1.0) 0;0 0.2257 (0.78) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[2.11.0] 8.2520 (1.83) 8.2520 (1.83) 8.2520 (1.83) 0.0000 (1.0) 8.2520 (1.83) 0.0000 (1.0) 0;0 0.1212 (0.55) 1 1 test_add-add[2.18.1] 7.2564 (1.61) 7.2564 (1.61) 7.2564 (1.61) 0.0000 (1.0) 7.2564 (1.61) 0.0000 (1.0) 0;0 0.1378 (0.62) 1 1 test_add-add[2.39.0] 6.5988 (1.46) 6.5988 (1.46) 6.5988 (1.46) 0.0000 (1.0) 6.5988 (1.46) 0.0000 (1.0) 0;0 0.1515 (0.68) 1 1 test_add-add[2.40.0] 6.7148 (1.49) 6.7148 (1.49) 6.7148 (1.49) 0.0000 (1.0) 6.7148 (1.49) 0.0000 (1.0) 0;0 0.1489 (0.67) 1 1 test_add-add[2.41.1] 7.0429 (1.56) 7.0429 (1.56) 7.0429 (1.56) 0.0000 (1.0) 7.0429 (1.56) 0.0000 (1.0) 0;0 0.1420 (0.64) 1 1 test_add-add[2.45.0] 4.5107 (1.0) 4.5107 (1.0) 4.5107 (1.0) 0.0000 (1.0) 4.5107 (1.0) 0.0000 (1.0) 0;0 0.2217 (1.0) 1 1 test_add-add[main] 4.5970 (1.02) 4.5970 (1.02) 4.5970 (1.02) 0.0000 (1.0) 4.5970 (1.02) 0.0000 (1.0) 0;0 0.2175 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 year ago 
github-actions[bot]
commented
1 year ago