Closed pmrowla closed 1 year ago
Thu May 18 09:18:27 UTC 2023 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.11.0] 2.9767 (1.0) 2.9767 (1.0) 2.9767 (1.0) 0.0000 (1.0) 2.9767 (1.0) 0.0000 (1.0) 0;0 0.3359 (1.0) 1 1 test_get_url-get-url[2.18.1] 2.9914 (1.00) 2.9914 (1.00) 2.9914 (1.00) 0.0000 (1.0) 2.9914 (1.00) 0.0000 (1.0) 0;0 0.3343 (1.00) 1 1 test_get_url-get-url[2.39.0] 3.0750 (1.03) 3.0750 (1.03) 3.0750 (1.03) 0.0000 (1.0) 3.0750 (1.03) 0.0000 (1.0) 0;0 0.3252 (0.97) 1 1 test_get_url-get-url[2.40.0] 3.0539 (1.03) 3.0539 (1.03) 3.0539 (1.03) 0.0000 (1.0) 3.0539 (1.03) 0.0000 (1.0) 0;0 0.3275 (0.97) 1 1 test_get_url-get-url[2.41.1] 3.1398 (1.05) 3.1398 (1.05) 3.1398 (1.05) 0.0000 (1.0) 3.1398 (1.05) 0.0000 (1.0) 0;0 0.3185 (0.95) 1 1 test_get_url-get-url[2.45.0] 3.0267 (1.02) 3.0267 (1.02) 3.0267 (1.02) 0.0000 (1.0) 3.0267 (1.02) 0.0000 (1.0) 0;0 0.3304 (0.98) 1 1 test_get_url-get-url[main] 3.1329 (1.05) 3.1329 (1.05) 3.1329 (1.05) 0.0000 (1.0) 3.1329 (1.05) 0.0000 (1.0) 0;0 0.3192 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.11.0] 3.1424 (1.52) 3.1424 (1.52) 3.1424 (1.52) 0.0000 (1.0) 3.1424 (1.52) 0.0000 (1.0) 0;0 0.3182 (0.66) 1 1 test_checkout_copy-checkout[2.18.1] 3.1904 (1.54) 3.1904 (1.54) 3.1904 (1.54) 0.0000 (1.0) 3.1904 (1.54) 0.0000 (1.0) 0;0 0.3134 (0.65) 1 1 test_checkout_copy-checkout[2.39.0] 3.5503 (1.72) 3.5503 (1.72) 3.5503 (1.72) 0.0000 (1.0) 3.5503 (1.72) 0.0000 (1.0) 0;0 0.2817 (0.58) 1 1 test_checkout_copy-checkout[2.40.0] 3.6019 (1.74) 3.6019 (1.74) 3.6019 (1.74) 0.0000 (1.0) 3.6019 (1.74) 0.0000 (1.0) 0;0 0.2776 (0.57) 1 1 test_checkout_copy-checkout[2.41.1] 3.2230 (1.56) 3.2230 (1.56) 3.2230 (1.56) 0.0000 (1.0) 3.2230 (1.56) 0.0000 (1.0) 0;0 0.3103 (0.64) 1 1 test_checkout_copy-checkout[2.45.0] 3.4700 (1.68) 3.4700 (1.68) 3.4700 (1.68) 0.0000 (1.0) 3.4700 (1.68) 0.0000 (1.0) 0;0 0.2882 (0.60) 1 1 test_checkout_copy-checkout[main] 2.0681 (1.0) 2.0681 (1.0) 2.0681 (1.0) 0.0000 (1.0) 2.0681 (1.0) 0.0000 (1.0) 0;0 0.4835 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.11.0] 478.3261 (1.0) 478.3261 (1.0) 478.3261 (1.0) 0.0000 (1.0) 478.3261 (1.0) 0.0000 (1.0) 0;0 2.0906 (1.0) 1 1 test_checkout_copy-checkout-noop[2.18.1] 552.8296 (1.16) 552.8296 (1.16) 552.8296 (1.16) 0.0000 (1.0) 552.8296 (1.16) 0.0000 (1.0) 0;0 1.8089 (0.87) 1 1 test_checkout_copy-checkout-noop[2.39.0] 578.1679 (1.21) 578.1679 (1.21) 578.1679 (1.21) 0.0000 (1.0) 578.1679 (1.21) 0.0000 (1.0) 0;0 1.7296 (0.83) 1 1 test_checkout_copy-checkout-noop[2.40.0] 569.5883 (1.19) 569.5883 (1.19) 569.5883 (1.19) 0.0000 (1.0) 569.5883 (1.19) 0.0000 (1.0) 0;0 1.7557 (0.84) 1 1 test_checkout_copy-checkout-noop[2.41.1] 580.2749 (1.21) 580.2749 (1.21) 580.2749 (1.21) 0.0000 (1.0) 580.2749 (1.21) 0.0000 (1.0) 0;0 1.7233 (0.82) 1 1 test_checkout_copy-checkout-noop[2.45.0] 594.7877 (1.24) 594.7877 (1.24) 594.7877 (1.24) 0.0000 (1.0) 594.7877 (1.24) 0.0000 (1.0) 0;0 1.6813 (0.80) 1 1 test_checkout_copy-checkout-noop[main] 670.7153 (1.40) 670.7153 (1.40) 670.7153 (1.40) 0.0000 (1.0) 670.7153 (1.40) 0.0000 (1.0) 0;0 1.4909 (0.71) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.11.0] 1.2491 (1.95) 1.2491 (1.95) 1.2491 (1.95) 0.0000 (1.0) 1.2491 (1.95) 0.0000 (1.0) 0;0 0.8006 (0.51) 1 1 test_checkout_copy-checkout-update[2.18.1] 0.6430 (1.00) 0.6430 (1.00) 0.6430 (1.00) 0.0000 (1.0) 0.6430 (1.00) 0.0000 (1.0) 0;0 1.5552 (1.00) 1 1 test_checkout_copy-checkout-update[2.39.0] 0.6406 (1.0) 0.6406 (1.0) 0.6406 (1.0) 0.0000 (1.0) 0.6406 (1.0) 0.0000 (1.0) 0;0 1.5611 (1.0) 1 1 test_checkout_copy-checkout-update[2.40.0] 0.6435 (1.00) 0.6435 (1.00) 0.6435 (1.00) 0.0000 (1.0) 0.6435 (1.00) 0.0000 (1.0) 0;0 1.5539 (1.00) 1 1 test_checkout_copy-checkout-update[2.41.1] 0.6474 (1.01) 0.6474 (1.01) 0.6474 (1.01) 0.0000 (1.0) 0.6474 (1.01) 0.0000 (1.0) 0;0 1.5446 (0.99) 1 1 test_checkout_copy-checkout-update[2.45.0] 0.6666 (1.04) 0.6666 (1.04) 0.6666 (1.04) 0.0000 (1.0) 0.6666 (1.04) 0.0000 (1.0) 0;0 1.5002 (0.96) 1 1 test_checkout_copy-checkout-update[main] 0.8558 (1.34) 0.8558 (1.34) 0.8558 (1.34) 0.0000 (1.0) 0.8558 (1.34) 0.0000 (1.0) 0;0 1.1685 (0.75) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.11.0] 2.9527 (1.62) 2.9527 (1.62) 2.9527 (1.62) 0.0000 (1.0) 2.9527 (1.62) 0.0000 (1.0) 0;0 0.3387 (0.62) 1 1 test_status-status[2.18.1] 1.8588 (1.02) 1.8588 (1.02) 1.8588 (1.02) 0.0000 (1.0) 1.8588 (1.02) 0.0000 (1.0) 0;0 0.5380 (0.98) 1 1 test_status-status[2.39.0] 1.9165 (1.05) 1.9165 (1.05) 1.9165 (1.05) 0.0000 (1.0) 1.9165 (1.05) 0.0000 (1.0) 0;0 0.5218 (0.95) 1 1 test_status-status[2.40.0] 1.9662 (1.08) 1.9662 (1.08) 1.9662 (1.08) 0.0000 (1.0) 1.9662 (1.08) 0.0000 (1.0) 0;0 0.5086 (0.93) 1 1 test_status-status[2.41.1] 1.8940 (1.04) 1.8940 (1.04) 1.8940 (1.04) 0.0000 (1.0) 1.8940 (1.04) 0.0000 (1.0) 0;0 0.5280 (0.96) 1 1 test_status-status[2.45.0] 1.8243 (1.0) 1.8243 (1.0) 1.8243 (1.0) 0.0000 (1.0) 1.8243 (1.0) 0.0000 (1.0) 0;0 0.5482 (1.0) 1 1 test_status-status[main] 1.9653 (1.08) 1.9653 (1.08) 1.9653 (1.08) 0.0000 (1.0) 1.9653 (1.08) 0.0000 (1.0) 0;0 0.5088 (0.93) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_status-status-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.11.0] 2.2056 (2.91) 2.2056 (2.91) 2.2056 (2.91) 0.0000 (1.0) 2.2056 (2.91) 0.0000 (1.0) 0;0 0.4534 (0.34) 1 1 test_status-status-changed[2.18.1] 0.7656 (1.01) 0.7656 (1.01) 0.7656 (1.01) 0.0000 (1.0) 0.7656 (1.01) 0.0000 (1.0) 0;0 1.3062 (0.99) 1 1 test_status-status-changed[2.39.0] 0.7588 (1.0) 0.7588 (1.0) 0.7588 (1.0) 0.0000 (1.0) 0.7588 (1.0) 0.0000 (1.0) 0;0 1.3178 (1.0) 1 1 test_status-status-changed[2.40.0] 0.7810 (1.03) 0.7810 (1.03) 0.7810 (1.03) 0.0000 (1.0) 0.7810 (1.03) 0.0000 (1.0) 0;0 1.2805 (0.97) 1 1 test_status-status-changed[2.41.1] 0.7811 (1.03) 0.7811 (1.03) 0.7811 (1.03) 0.0000 (1.0) 0.7811 (1.03) 0.0000 (1.0) 0;0 1.2802 (0.97) 1 1 test_status-status-changed[2.45.0] 0.8210 (1.08) 0.8210 (1.08) 0.8210 (1.08) 0.0000 (1.0) 0.8210 (1.08) 0.0000 (1.0) 0;0 1.2180 (0.92) 1 1 test_status-status-changed[main] 0.9109 (1.20) 0.9109 (1.20) 0.9109 (1.20) 0.0000 (1.0) 0.9109 (1.20) 0.0000 (1.0) 0;0 1.0978 (0.83) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.11.0] 962.3783 (1.33) 962.3783 (1.33) 962.3783 (1.33) 0.0000 (1.0) 962.3783 (1.33) 0.0000 (1.0) 0;0 1.0391 (0.75) 1 1 test_status-status-changed-noop[2.18.1] 724.3180 (1.0) 724.3180 (1.0) 724.3180 (1.0) 0.0000 (1.0) 724.3180 (1.0) 0.0000 (1.0) 0;0 1.3806 (1.0) 1 1 test_status-status-changed-noop[2.39.0] 805.2270 (1.11) 805.2270 (1.11) 805.2270 (1.11) 0.0000 (1.0) 805.2270 (1.11) 0.0000 (1.0) 0;0 1.2419 (0.90) 1 1 test_status-status-changed-noop[2.40.0] 768.3888 (1.06) 768.3888 (1.06) 768.3888 (1.06) 0.0000 (1.0) 768.3888 (1.06) 0.0000 (1.0) 0;0 1.3014 (0.94) 1 1 test_status-status-changed-noop[2.41.1] 775.8793 (1.07) 775.8793 (1.07) 775.8793 (1.07) 0.0000 (1.0) 775.8793 (1.07) 0.0000 (1.0) 0;0 1.2889 (0.93) 1 1 test_status-status-changed-noop[2.45.0] 835.9111 (1.15) 835.9111 (1.15) 835.9111 (1.15) 0.0000 (1.0) 835.9111 (1.15) 0.0000 (1.0) 0;0 1.1963 (0.87) 1 1 test_status-status-changed-noop[main] 892.7640 (1.23) 892.7640 (1.23) 892.7640 (1.23) 0.0000 (1.0) 892.7640 (1.23) 0.0000 (1.0) 0;0 1.1201 (0.81) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.11.0] 560.5834 (1.0) 560.5834 (1.0) 560.5834 (1.0) 0.0000 (1.0) 560.5834 (1.0) 0.0000 (1.0) 0;0 1.7839 (1.0) 1 1 test_status-status-noop[2.18.1] 775.2789 (1.38) 775.2789 (1.38) 775.2789 (1.38) 0.0000 (1.0) 775.2789 (1.38) 0.0000 (1.0) 0;0 1.2899 (0.72) 1 1 test_status-status-noop[2.39.0] 788.7995 (1.41) 788.7995 (1.41) 788.7995 (1.41) 0.0000 (1.0) 788.7995 (1.41) 0.0000 (1.0) 0;0 1.2677 (0.71) 1 1 test_status-status-noop[2.40.0] 826.1540 (1.47) 826.1540 (1.47) 826.1540 (1.47) 0.0000 (1.0) 826.1540 (1.47) 0.0000 (1.0) 0;0 1.2104 (0.68) 1 1 test_status-status-noop[2.41.1] 744.9820 (1.33) 744.9820 (1.33) 744.9820 (1.33) 0.0000 (1.0) 744.9820 (1.33) 0.0000 (1.0) 0;0 1.3423 (0.75) 1 1 test_status-status-noop[2.45.0] 808.6303 (1.44) 808.6303 (1.44) 808.6303 (1.44) 0.0000 (1.0) 808.6303 (1.44) 0.0000 (1.0) 0;0 1.2367 (0.69) 1 1 test_status-status-noop[main] 916.4857 (1.63) 916.4857 (1.63) 916.4857 (1.63) 0.0000 (1.0) 916.4857 (1.63) 0.0000 (1.0) 0;0 1.0911 (0.61) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_help---help': 7 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.11.0] 146.0645 (1.0) 193.3340 (1.09) 165.2059 (1.02) 10.5693 (1.71) 164.8511 (1.01) 15.1162 (1.94) 34;0 6.0531 (0.98) 100 1 test_help---help[2.18.1] 151.3998 (1.04) 177.8510 (1.0) 162.7116 (1.0) 6.1800 (1.0) 162.6280 (1.0) 10.0753 (1.30) 40;0 6.1458 (1.0) 100 1 test_help---help[2.39.0] 193.2926 (1.32) 234.2830 (1.32) 209.2088 (1.29) 8.7407 (1.41) 208.6734 (1.28) 12.8680 (1.65) 35;1 4.7799 (0.78) 100 1 test_help---help[2.40.0] 196.2353 (1.34) 253.9079 (1.43) 212.6617 (1.31) 11.1447 (1.80) 210.1068 (1.29) 13.7820 (1.77) 29;2 4.7023 (0.77) 100 1 test_help---help[2.41.1] 198.1400 (1.36) 231.1576 (1.30) 211.3464 (1.30) 6.1938 (1.00) 210.7196 (1.30) 8.6282 (1.11) 29;1 4.7316 (0.77) 100 1 test_help---help[2.45.0] 160.3976 (1.10) 202.0525 (1.14) 172.9142 (1.06) 7.7439 (1.25) 171.8211 (1.06) 7.7774 (1.0) 18;6 5.7832 (0.94) 100 1 test_help---help[main] 160.4099 (1.10) 198.4423 (1.12) 173.6769 (1.07) 8.5242 (1.38) 172.1977 (1.06) 9.4240 (1.21) 26;7 5.7578 (0.94) 100 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.11.0] 1.3875 (1.03) 1.3875 (1.03) 1.3875 (1.03) 0.0000 (1.0) 1.3875 (1.03) 0.0000 (1.0) 0;0 0.7207 (0.97) 1 1 test_checkout_symlink-checkout[2.18.1] 1.3511 (1.0) 1.3511 (1.0) 1.3511 (1.0) 0.0000 (1.0) 1.3511 (1.0) 0.0000 (1.0) 0;0 0.7401 (1.0) 1 1 test_checkout_symlink-checkout[2.39.0] 1.3759 (1.02) 1.3759 (1.02) 1.3759 (1.02) 0.0000 (1.0) 1.3759 (1.02) 0.0000 (1.0) 0;0 0.7268 (0.98) 1 1 test_checkout_symlink-checkout[2.40.0] 1.3620 (1.01) 1.3620 (1.01) 1.3620 (1.01) 0.0000 (1.0) 1.3620 (1.01) 0.0000 (1.0) 0;0 0.7342 (0.99) 1 1 test_checkout_symlink-checkout[2.41.1] 1.3563 (1.00) 1.3563 (1.00) 1.3563 (1.00) 0.0000 (1.0) 1.3563 (1.00) 0.0000 (1.0) 0;0 0.7373 (1.00) 1 1 test_checkout_symlink-checkout[2.45.0] 1.6902 (1.25) 1.6902 (1.25) 1.6902 (1.25) 0.0000 (1.0) 1.6902 (1.25) 0.0000 (1.0) 0;0 0.5917 (0.80) 1 1 test_checkout_symlink-checkout[main] 1.5020 (1.11) 1.5020 (1.11) 1.5020 (1.11) 0.0000 (1.0) 1.5020 (1.11) 0.0000 (1.0) 0;0 0.6658 (0.90) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout-noop[2.11.0] 517.4274 (1.0) 517.4274 (1.0) 517.4274 (1.0) 0.0000 (1.0) 517.4274 (1.0) 0.0000 (1.0) 0;0 1.9326 (1.0) 1 1 test_checkout_symlink-checkout-noop[2.18.1] 565.3613 (1.09) 565.3613 (1.09) 565.3613 (1.09) 0.0000 (1.0) 565.3613 (1.09) 0.0000 (1.0) 0;0 1.7688 (0.92) 1 1 test_checkout_symlink-checkout-noop[2.39.0] 817.3919 (1.58) 817.3919 (1.58) 817.3919 (1.58) 0.0000 (1.0) 817.3919 (1.58) 0.0000 (1.0) 0;0 1.2234 (0.63) 1 1 test_checkout_symlink-checkout-noop[2.40.0] 593.2761 (1.15) 593.2761 (1.15) 593.2761 (1.15) 0.0000 (1.0) 593.2761 (1.15) 0.0000 (1.0) 0;0 1.6856 (0.87) 1 1 test_checkout_symlink-checkout-noop[2.41.1] 595.4346 (1.15) 595.4346 (1.15) 595.4346 (1.15) 0.0000 (1.0) 595.4346 (1.15) 0.0000 (1.0) 0;0 1.6794 (0.87) 1 1 test_checkout_symlink-checkout-noop[2.45.0] 1,006.7864 (1.95) 1,006.7864 (1.95) 1,006.7864 (1.95) 0.0000 (1.0) 1,006.7864 (1.95) 0.0000 (1.0) 0;0 0.9933 (0.51) 1 1 test_checkout_symlink-checkout-noop[main] 705.9091 (1.36) 705.9091 (1.36) 705.9091 (1.36) 0.0000 (1.0) 705.9091 (1.36) 0.0000 (1.0) 0;0 1.4166 (0.73) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-update[2.11.0] 1.4716 (2.19) 1.4716 (2.19) 1.4716 (2.19) 0.0000 (1.0) 1.4716 (2.19) 0.0000 (1.0) 0;0 0.6795 (0.46) 1 1 test_checkout_symlink-checkout-update[2.18.1] 0.6730 (1.0) 0.6730 (1.0) 0.6730 (1.0) 0.0000 (1.0) 0.6730 (1.0) 0.0000 (1.0) 0;0 1.4858 (1.0) 1 1 test_checkout_symlink-checkout-update[2.39.0] 0.6885 (1.02) 0.6885 (1.02) 0.6885 (1.02) 0.0000 (1.0) 0.6885 (1.02) 0.0000 (1.0) 0;0 1.4525 (0.98) 1 1 test_checkout_symlink-checkout-update[2.40.0] 0.6900 (1.03) 0.6900 (1.03) 0.6900 (1.03) 0.0000 (1.0) 0.6900 (1.03) 0.0000 (1.0) 0;0 1.4494 (0.98) 1 1 test_checkout_symlink-checkout-update[2.41.1] 0.7791 (1.16) 0.7791 (1.16) 0.7791 (1.16) 0.0000 (1.0) 0.7791 (1.16) 0.0000 (1.0) 0;0 1.2835 (0.86) 1 1 test_checkout_symlink-checkout-update[2.45.0] 0.7415 (1.10) 0.7415 (1.10) 0.7415 (1.10) 0.0000 (1.0) 0.7415 (1.10) 0.0000 (1.0) 0;0 1.3486 (0.91) 1 1 test_checkout_symlink-checkout-update[main] 0.9064 (1.35) 0.9064 (1.35) 0.9064 (1.35) 0.0000 (1.0) 0.9064 (1.35) 0.0000 (1.0) 0;0 1.1032 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.11.0] 10.0095 (1.42) 10.0095 (1.42) 10.0095 (1.42) 0.0000 (1.0) 10.0095 (1.42) 0.0000 (1.0) 0;0 0.0999 (0.71) 1 1 test_import_url-import-url[2.18.1] 8.9213 (1.26) 8.9213 (1.26) 8.9213 (1.26) 0.0000 (1.0) 8.9213 (1.26) 0.0000 (1.0) 0;0 0.1121 (0.79) 1 1 test_import_url-import-url[2.39.0] 8.7808 (1.24) 8.7808 (1.24) 8.7808 (1.24) 0.0000 (1.0) 8.7808 (1.24) 0.0000 (1.0) 0;0 0.1139 (0.80) 1 1 test_import_url-import-url[2.40.0] 8.7881 (1.25) 8.7881 (1.25) 8.7881 (1.25) 0.0000 (1.0) 8.7881 (1.25) 0.0000 (1.0) 0;0 0.1138 (0.80) 1 1 test_import_url-import-url[2.41.1] 8.7085 (1.23) 8.7085 (1.23) 8.7085 (1.23) 0.0000 (1.0) 8.7085 (1.23) 0.0000 (1.0) 0;0 0.1148 (0.81) 1 1 test_import_url-import-url[2.45.0] 7.0577 (1.0) 7.0577 (1.0) 7.0577 (1.0) 0.0000 (1.0) 7.0577 (1.0) 0.0000 (1.0) 0;0 0.1417 (1.0) 1 1 test_import_url-import-url[main] 7.2100 (1.02) 7.2100 (1.02) 7.2100 (1.02) 0.0000 (1.0) 7.2100 (1.02) 0.0000 (1.0) 0;0 0.1387 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.11.0] 11.0056 (1.51) 11.0056 (1.51) 11.0056 (1.51) 0.0000 (1.0) 11.0056 (1.51) 0.0000 (1.0) 0;0 0.0909 (0.66) 1 1 test_import-import[2.18.1] 10.5960 (1.45) 10.5960 (1.45) 10.5960 (1.45) 0.0000 (1.0) 10.5960 (1.45) 0.0000 (1.0) 0;0 0.0944 (0.69) 1 1 test_import-import[2.39.0] 8.8965 (1.22) 8.8965 (1.22) 8.8965 (1.22) 0.0000 (1.0) 8.8965 (1.22) 0.0000 (1.0) 0;0 0.1124 (0.82) 1 1 test_import-import[2.40.0] 8.8516 (1.21) 8.8516 (1.21) 8.8516 (1.21) 0.0000 (1.0) 8.8516 (1.21) 0.0000 (1.0) 0;0 0.1130 (0.82) 1 1 test_import-import[2.41.1] 8.9708 (1.23) 8.9708 (1.23) 8.9708 (1.23) 0.0000 (1.0) 8.9708 (1.23) 0.0000 (1.0) 0;0 0.1115 (0.81) 1 1 test_import-import[2.45.0] 7.2930 (1.0) 7.2930 (1.0) 7.2930 (1.0) 0.0000 (1.0) 7.2930 (1.0) 0.0000 (1.0) 0;0 0.1371 (1.0) 1 1 test_import-import[main] 9.4579 (1.30) 9.4579 (1.30) 9.4579 (1.30) 0.0000 (1.0) 9.4579 (1.30) 0.0000 (1.0) 0;0 0.1057 (0.77) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.11.0] 1.7865 (1.18) 1.7865 (1.18) 1.7865 (1.18) 0.0000 (1.0) 1.7865 (1.18) 0.0000 (1.0) 0;0 0.5598 (0.85) 1 1 test_diff-diff[2.18.1] 1.5820 (1.04) 1.5820 (1.04) 1.5820 (1.04) 0.0000 (1.0) 1.5820 (1.04) 0.0000 (1.0) 0;0 0.6321 (0.96) 1 1 test_diff-diff[2.39.0] 1.5155 (1.0) 1.5155 (1.0) 1.5155 (1.0) 0.0000 (1.0) 1.5155 (1.0) 0.0000 (1.0) 0;0 0.6599 (1.0) 1 1 test_diff-diff[2.40.0] 1.5418 (1.02) 1.5418 (1.02) 1.5418 (1.02) 0.0000 (1.0) 1.5418 (1.02) 0.0000 (1.0) 0;0 0.6486 (0.98) 1 1 test_diff-diff[2.41.1] 1.5244 (1.01) 1.5244 (1.01) 1.5244 (1.01) 0.0000 (1.0) 1.5244 (1.01) 0.0000 (1.0) 0;0 0.6560 (0.99) 1 1 test_diff-diff[2.45.0] 1.5454 (1.02) 1.5454 (1.02) 1.5454 (1.02) 0.0000 (1.0) 1.5454 (1.02) 0.0000 (1.0) 0;0 0.6471 (0.98) 1 1 test_diff-diff[main] 1.5176 (1.00) 1.5176 (1.00) 1.5176 (1.00) 0.0000 (1.0) 1.5176 (1.00) 0.0000 (1.0) 0;0 0.6589 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.11.0] 1.1846 (1.74) 1.1846 (1.74) 1.1846 (1.74) 0.0000 (1.0) 1.1846 (1.74) 0.0000 (1.0) 0;0 0.8442 (0.57) 1 1 test_diff-diff-changed[2.18.1] 0.6790 (1.0) 0.6790 (1.0) 0.6790 (1.0) 0.0000 (1.0) 0.6790 (1.0) 0.0000 (1.0) 0;0 1.4728 (1.0) 1 1 test_diff-diff-changed[2.39.0] 0.7012 (1.03) 0.7012 (1.03) 0.7012 (1.03) 0.0000 (1.0) 0.7012 (1.03) 0.0000 (1.0) 0;0 1.4261 (0.97) 1 1 test_diff-diff-changed[2.40.0] 0.7142 (1.05) 0.7142 (1.05) 0.7142 (1.05) 0.0000 (1.0) 0.7142 (1.05) 0.0000 (1.0) 0;0 1.4001 (0.95) 1 1 test_diff-diff-changed[2.41.1] 0.7003 (1.03) 0.7003 (1.03) 0.7003 (1.03) 0.0000 (1.0) 0.7003 (1.03) 0.0000 (1.0) 0;0 1.4279 (0.97) 1 1 test_diff-diff-changed[2.45.0] 0.7361 (1.08) 0.7361 (1.08) 0.7361 (1.08) 0.0000 (1.0) 0.7361 (1.08) 0.0000 (1.0) 0;0 1.3585 (0.92) 1 1 test_diff-diff-changed[main] 0.8365 (1.23) 0.8365 (1.23) 0.8365 (1.23) 0.0000 (1.0) 0.8365 (1.23) 0.0000 (1.0) 0;0 1.1954 (0.81) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.11.0] 514.7677 (1.0) 514.7677 (1.0) 514.7677 (1.0) 0.0000 (1.0) 514.7677 (1.0) 0.0000 (1.0) 0;0 1.9426 (1.0) 1 1 test_diff-diff-changed-noop[2.18.1] 680.0597 (1.32) 680.0597 (1.32) 680.0597 (1.32) 0.0000 (1.0) 680.0597 (1.32) 0.0000 (1.0) 0;0 1.4705 (0.76) 1 1 test_diff-diff-changed-noop[2.39.0] 695.9287 (1.35) 695.9287 (1.35) 695.9287 (1.35) 0.0000 (1.0) 695.9287 (1.35) 0.0000 (1.0) 0;0 1.4369 (0.74) 1 1 test_diff-diff-changed-noop[2.40.0] 726.3462 (1.41) 726.3462 (1.41) 726.3462 (1.41) 0.0000 (1.0) 726.3462 (1.41) 0.0000 (1.0) 0;0 1.3768 (0.71) 1 1 test_diff-diff-changed-noop[2.41.1] 708.3523 (1.38) 708.3523 (1.38) 708.3523 (1.38) 0.0000 (1.0) 708.3523 (1.38) 0.0000 (1.0) 0;0 1.4117 (0.73) 1 1 test_diff-diff-changed-noop[2.45.0] 744.1291 (1.45) 744.1291 (1.45) 744.1291 (1.45) 0.0000 (1.0) 744.1291 (1.45) 0.0000 (1.0) 0;0 1.3439 (0.69) 1 1 test_diff-diff-changed-noop[main] 764.1283 (1.48) 764.1283 (1.48) 764.1283 (1.48) 0.0000 (1.0) 764.1283 (1.48) 0.0000 (1.0) 0;0 1.3087 (0.67) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.11.0] 473.9008 (1.0) 473.9008 (1.0) 473.9008 (1.0) 0.0000 (1.0) 473.9008 (1.0) 0.0000 (1.0) 0;0 2.1101 (1.0) 1 1 test_diff-diff-noop[2.18.1] 637.2385 (1.34) 637.2385 (1.34) 637.2385 (1.34) 0.0000 (1.0) 637.2385 (1.34) 0.0000 (1.0) 0;0 1.5693 (0.74) 1 1 test_diff-diff-noop[2.39.0] 657.7106 (1.39) 657.7106 (1.39) 657.7106 (1.39) 0.0000 (1.0) 657.7106 (1.39) 0.0000 (1.0) 0;0 1.5204 (0.72) 1 1 test_diff-diff-noop[2.40.0] 682.1302 (1.44) 682.1302 (1.44) 682.1302 (1.44) 0.0000 (1.0) 682.1302 (1.44) 0.0000 (1.0) 0;0 1.4660 (0.69) 1 1 test_diff-diff-noop[2.41.1] 661.8771 (1.40) 661.8771 (1.40) 661.8771 (1.40) 0.0000 (1.0) 661.8771 (1.40) 0.0000 (1.0) 0;0 1.5109 (0.72) 1 1 test_diff-diff-noop[2.45.0] 696.2162 (1.47) 696.2162 (1.47) 696.2162 (1.47) 0.0000 (1.0) 696.2162 (1.47) 0.0000 (1.0) 0;0 1.4363 (0.68) 1 1 test_diff-diff-noop[main] 726.9626 (1.53) 726.9626 (1.53) 726.9626 (1.53) 0.0000 (1.0) 726.9626 (1.53) 0.0000 (1.0) 0;0 1.3756 (0.65) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.11.0] 413.0698 (1.10) 413.0698 (1.10) 413.0698 (1.10) 0.0000 (1.0) 413.0698 (1.10) 0.0000 (1.0) 0;0 2.4209 (0.91) 1 1 test_list-list[2.18.1] 376.6610 (1.0) 376.6610 (1.0) 376.6610 (1.0) 0.0000 (1.0) 376.6610 (1.0) 0.0000 (1.0) 0;0 2.6549 (1.0) 1 1 test_list-list[2.39.0] 440.4995 (1.17) 440.4995 (1.17) 440.4995 (1.17) 0.0000 (1.0) 440.4995 (1.17) 0.0000 (1.0) 0;0 2.2701 (0.86) 1 1 test_list-list[2.40.0] 400.1022 (1.06) 400.1022 (1.06) 400.1022 (1.06) 0.0000 (1.0) 400.1022 (1.06) 0.0000 (1.0) 0;0 2.4994 (0.94) 1 1 test_list-list[2.41.1] 400.5207 (1.06) 400.5207 (1.06) 400.5207 (1.06) 0.0000 (1.0) 400.5207 (1.06) 0.0000 (1.0) 0;0 2.4968 (0.94) 1 1 test_list-list[2.45.0] 418.0085 (1.11) 418.0085 (1.11) 418.0085 (1.11) 0.0000 (1.0) 418.0085 (1.11) 0.0000 (1.0) 0;0 2.3923 (0.90) 1 1 test_list-list[main] 506.7580 (1.35) 506.7580 (1.35) 506.7580 (1.35) 0.0000 (1.0) 506.7580 (1.35) 0.0000 (1.0) 0;0 1.9733 (0.74) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.11.0] 394.3599 (1.09) 394.3599 (1.09) 394.3599 (1.09) 0.0000 (1.0) 394.3599 (1.09) 0.0000 (1.0) 0;0 2.5358 (0.92) 1 1 test_list-list-dvc-only[2.18.1] 363.0720 (1.0) 363.0720 (1.0) 363.0720 (1.0) 0.0000 (1.0) 363.0720 (1.0) 0.0000 (1.0) 0;0 2.7543 (1.0) 1 1 test_list-list-dvc-only[2.39.0] 390.3931 (1.08) 390.3931 (1.08) 390.3931 (1.08) 0.0000 (1.0) 390.3931 (1.08) 0.0000 (1.0) 0;0 2.5615 (0.93) 1 1 test_list-list-dvc-only[2.40.0] 392.0454 (1.08) 392.0454 (1.08) 392.0454 (1.08) 0.0000 (1.0) 392.0454 (1.08) 0.0000 (1.0) 0;0 2.5507 (0.93) 1 1 test_list-list-dvc-only[2.41.1] 385.2781 (1.06) 385.2781 (1.06) 385.2781 (1.06) 0.0000 (1.0) 385.2781 (1.06) 0.0000 (1.0) 0;0 2.5955 (0.94) 1 1 test_list-list-dvc-only[2.45.0] 503.9450 (1.39) 503.9450 (1.39) 503.9450 (1.39) 0.0000 (1.0) 503.9450 (1.39) 0.0000 (1.0) 0;0 1.9843 (0.72) 1 1 test_list-list-dvc-only[main] 499.8796 (1.38) 499.8796 (1.38) 499.8796 (1.38) 0.0000 (1.0) 499.8796 (1.38) 0.0000 (1.0) 0;0 2.0005 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.11.0] 1.6617 (3.63) 1.6617 (3.63) 1.6617 (3.63) 0.0000 (1.0) 1.6617 (3.63) 0.0000 (1.0) 0;0 0.6018 (0.28) 1 1 test_list-list-recursive[2.18.1] 2.3523 (5.14) 2.3523 (5.14) 2.3523 (5.14) 0.0000 (1.0) 2.3523 (5.14) 0.0000 (1.0) 0;0 0.4251 (0.19) 1 1 test_list-list-recursive[2.39.0] 0.7658 (1.67) 0.7658 (1.67) 0.7658 (1.67) 0.0000 (1.0) 0.7658 (1.67) 0.0000 (1.0) 0;0 1.3058 (0.60) 1 1 test_list-list-recursive[2.40.0] 0.4612 (1.01) 0.4612 (1.01) 0.4612 (1.01) 0.0000 (1.0) 0.4612 (1.01) 0.0000 (1.0) 0;0 2.1682 (0.99) 1 1 test_list-list-recursive[2.41.1] 0.4577 (1.0) 0.4577 (1.0) 0.4577 (1.0) 0.0000 (1.0) 0.4577 (1.0) 0.0000 (1.0) 0;0 2.1849 (1.0) 1 1 test_list-list-recursive[2.45.0] 0.4644 (1.01) 0.4644 (1.01) 0.4644 (1.01) 0.0000 (1.0) 0.4644 (1.01) 0.0000 (1.0) 0;0 2.1535 (0.99) 1 1 test_list-list-recursive[main] 0.5874 (1.28) 0.5874 (1.28) 0.5874 (1.28) 0.0000 (1.0) 0.5874 (1.28) 0.0000 (1.0) 0;0 1.7023 (0.78) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.11.0] 395.9020 (1.01) 395.9020 (1.01) 395.9020 (1.01) 0.0000 (1.0) 395.9020 (1.01) 0.0000 (1.0) 0;0 2.5259 (0.99) 1 1 test_list-list-shallow[2.18.1] 391.0851 (1.0) 391.0851 (1.0) 391.0851 (1.0) 0.0000 (1.0) 391.0851 (1.0) 0.0000 (1.0) 0;0 2.5570 (1.0) 1 1 test_list-list-shallow[2.39.0] 420.3855 (1.07) 420.3855 (1.07) 420.3855 (1.07) 0.0000 (1.0) 420.3855 (1.07) 0.0000 (1.0) 0;0 2.3788 (0.93) 1 1 test_list-list-shallow[2.40.0] 419.0193 (1.07) 419.0193 (1.07) 419.0193 (1.07) 0.0000 (1.0) 419.0193 (1.07) 0.0000 (1.0) 0;0 2.3865 (0.93) 1 1 test_list-list-shallow[2.41.1] 416.5355 (1.07) 416.5355 (1.07) 416.5355 (1.07) 0.0000 (1.0) 416.5355 (1.07) 0.0000 (1.0) 0;0 2.4008 (0.94) 1 1 test_list-list-shallow[2.45.0] 430.1029 (1.10) 430.1029 (1.10) 430.1029 (1.10) 0.0000 (1.0) 430.1029 (1.10) 0.0000 (1.0) 0;0 2.3250 (0.91) 1 1 test_list-list-shallow[main] 496.5838 (1.27) 496.5838 (1.27) 496.5838 (1.27) 0.0000 (1.0) 496.5838 (1.27) 0.0000 (1.0) 0;0 2.0138 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.11.0] 1.9221 (1.09) 1.9221 (1.09) 1.9221 (1.09) 0.0000 (1.0) 1.9221 (1.09) 0.0000 (1.0) 0;0 0.5203 (0.92) 1 1 test_checkout_hardlink-checkout[2.18.1] 1.7694 (1.0) 1.7694 (1.0) 1.7694 (1.0) 0.0000 (1.0) 1.7694 (1.0) 0.0000 (1.0) 0;0 0.5652 (1.0) 1 1 test_checkout_hardlink-checkout[2.39.0] 1.7931 (1.01) 1.7931 (1.01) 1.7931 (1.01) 0.0000 (1.0) 1.7931 (1.01) 0.0000 (1.0) 0;0 0.5577 (0.99) 1 1 test_checkout_hardlink-checkout[2.40.0] 1.7897 (1.01) 1.7897 (1.01) 1.7897 (1.01) 0.0000 (1.0) 1.7897 (1.01) 0.0000 (1.0) 0;0 0.5588 (0.99) 1 1 test_checkout_hardlink-checkout[2.41.1] 1.7717 (1.00) 1.7717 (1.00) 1.7717 (1.00) 0.0000 (1.0) 1.7717 (1.00) 0.0000 (1.0) 0;0 0.5644 (1.00) 1 1 test_checkout_hardlink-checkout[2.45.0] 2.1218 (1.20) 2.1218 (1.20) 2.1218 (1.20) 0.0000 (1.0) 2.1218 (1.20) 0.0000 (1.0) 0;0 0.4713 (0.83) 1 1 test_checkout_hardlink-checkout[main] 1.9663 (1.11) 1.9663 (1.11) 1.9663 (1.11) 0.0000 (1.0) 1.9663 (1.11) 0.0000 (1.0) 0;0 0.5086 (0.90) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.11.0] 689.1203 (1.0) 689.1203 (1.0) 689.1203 (1.0) 0.0000 (1.0) 689.1203 (1.0) 0.0000 (1.0) 0;0 1.4511 (1.0) 1 1 test_checkout_hardlink-checkout-noop[2.18.1] 782.9328 (1.14) 782.9328 (1.14) 782.9328 (1.14) 0.0000 (1.0) 782.9328 (1.14) 0.0000 (1.0) 0;0 1.2772 (0.88) 1 1 test_checkout_hardlink-checkout-noop[2.39.0] 877.8391 (1.27) 877.8391 (1.27) 877.8391 (1.27) 0.0000 (1.0) 877.8391 (1.27) 0.0000 (1.0) 0;0 1.1392 (0.79) 1 1 test_checkout_hardlink-checkout-noop[2.40.0] 815.0468 (1.18) 815.0468 (1.18) 815.0468 (1.18) 0.0000 (1.0) 815.0468 (1.18) 0.0000 (1.0) 0;0 1.2269 (0.85) 1 1 test_checkout_hardlink-checkout-noop[2.41.1] 819.9604 (1.19) 819.9604 (1.19) 819.9604 (1.19) 0.0000 (1.0) 819.9604 (1.19) 0.0000 (1.0) 0;0 1.2196 (0.84) 1 1 test_checkout_hardlink-checkout-noop[2.45.0] 852.1005 (1.24) 852.1005 (1.24) 852.1005 (1.24) 0.0000 (1.0) 852.1005 (1.24) 0.0000 (1.0) 0;0 1.1736 (0.81) 1 1 test_checkout_hardlink-checkout-noop[main] 1,028.2829 (1.49) 1,028.2829 (1.49) 1,028.2829 (1.49) 0.0000 (1.0) 1,028.2829 (1.49) 0.0000 (1.0) 0;0 0.9725 (0.67) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.11.0] 1.8322 (2.07) 1.8322 (2.07) 1.8322 (2.07) 0.0000 (1.0) 1.8322 (2.07) 0.0000 (1.0) 0;0 0.5458 (0.48) 1 1 test_checkout_hardlink-checkout-update[2.18.1] 0.8855 (1.0) 0.8855 (1.0) 0.8855 (1.0) 0.0000 (1.0) 0.8855 (1.0) 0.0000 (1.0) 0;0 1.1292 (1.0) 1 1 test_checkout_hardlink-checkout-update[2.39.0] 0.9603 (1.08) 0.9603 (1.08) 0.9603 (1.08) 0.0000 (1.0) 0.9603 (1.08) 0.0000 (1.0) 0;0 1.0414 (0.92) 1 1 test_checkout_hardlink-checkout-update[2.40.0] 0.9097 (1.03) 0.9097 (1.03) 0.9097 (1.03) 0.0000 (1.0) 0.9097 (1.03) 0.0000 (1.0) 0;0 1.0992 (0.97) 1 1 test_checkout_hardlink-checkout-update[2.41.1] 0.8961 (1.01) 0.8961 (1.01) 0.8961 (1.01) 0.0000 (1.0) 0.8961 (1.01) 0.0000 (1.0) 0;0 1.1160 (0.99) 1 1 test_checkout_hardlink-checkout-update[2.45.0] 0.9862 (1.11) 0.9862 (1.11) 0.9862 (1.11) 0.0000 (1.0) 0.9862 (1.11) 0.0000 (1.0) 0;0 1.0140 (0.90) 1 1 test_checkout_hardlink-checkout-update[main] 1.2391 (1.40) 1.2391 (1.40) 1.2391 (1.40) 0.0000 (1.0) 1.2391 (1.40) 0.0000 (1.0) 0;0 0.8070 (0.71) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.11.0] 4.0065 (1.13) 4.0065 (1.13) 4.0065 (1.13) 0.0000 (1.0) 4.0065 (1.13) 0.0000 (1.0) 0;0 0.2496 (0.88) 1 1 test_push-push[2.18.1] 3.9524 (1.12) 3.9524 (1.12) 3.9524 (1.12) 0.0000 (1.0) 3.9524 (1.12) 0.0000 (1.0) 0;0 0.2530 (0.89) 1 1 test_push-push[2.39.0] 5.0631 (1.43) 5.0631 (1.43) 5.0631 (1.43) 0.0000 (1.0) 5.0631 (1.43) 0.0000 (1.0) 0;0 0.1975 (0.70) 1 1 test_push-push[2.40.0] 5.2305 (1.48) 5.2305 (1.48) 5.2305 (1.48) 0.0000 (1.0) 5.2305 (1.48) 0.0000 (1.0) 0;0 0.1912 (0.68) 1 1 test_push-push[2.41.1] 5.0906 (1.44) 5.0906 (1.44) 5.0906 (1.44) 0.0000 (1.0) 5.0906 (1.44) 0.0000 (1.0) 0;0 0.1964 (0.69) 1 1 test_push-push[2.45.0] 3.6496 (1.03) 3.6496 (1.03) 3.6496 (1.03) 0.0000 (1.0) 3.6496 (1.03) 0.0000 (1.0) 0;0 0.2740 (0.97) 1 1 test_push-push[main] 3.5317 (1.0) 3.5317 (1.0) 3.5317 (1.0) 0.0000 (1.0) 3.5317 (1.0) 0.0000 (1.0) 0;0 0.2831 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial-add[2.11.0] 8.6369 (1.85) 8.6369 (1.85) 8.6369 (1.85) 0.0000 (1.0) 8.6369 (1.85) 0.0000 (1.0) 0;0 0.1158 (0.54) 1 1 test_partial_add-add-partial-add[2.18.1] 7.3307 (1.57) 7.3307 (1.57) 7.3307 (1.57) 0.0000 (1.0) 7.3307 (1.57) 0.0000 (1.0) 0;0 0.1364 (0.64) 1 1 test_partial_add-add-partial-add[2.39.0] 6.4179 (1.38) 6.4179 (1.38) 6.4179 (1.38) 0.0000 (1.0) 6.4179 (1.38) 0.0000 (1.0) 0;0 0.1558 (0.73) 1 1 test_partial_add-add-partial-add[2.40.0] 6.5468 (1.40) 6.5468 (1.40) 6.5468 (1.40) 0.0000 (1.0) 6.5468 (1.40) 0.0000 (1.0) 0;0 0.1527 (0.71) 1 1 test_partial_add-add-partial-add[2.41.1] 6.4971 (1.39) 6.4971 (1.39) 6.4971 (1.39) 0.0000 (1.0) 6.4971 (1.39) 0.0000 (1.0) 0;0 0.1539 (0.72) 1 1 test_partial_add-add-partial-add[2.45.0] 5.0368 (1.08) 5.0368 (1.08) 5.0368 (1.08) 0.0000 (1.0) 5.0368 (1.08) 0.0000 (1.0) 0;0 0.1985 (0.93) 1 1 test_partial_add-add-partial-add[main] 4.6605 (1.0) 4.6605 (1.0) 4.6605 (1.0) 0.0000 (1.0) 4.6605 (1.0) 0.0000 (1.0) 0;0 0.2146 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.11.0] 609.6414 (1.0) 609.6414 (1.0) 609.6414 (1.0) 0.0000 (1.0) 609.6414 (1.0) 0.0000 (1.0) 0;0 1.6403 (1.0) 1 1 test_partial_add-gc-cloud-noop[2.18.1] 669.4351 (1.10) 669.4351 (1.10) 669.4351 (1.10) 0.0000 (1.0) 669.4351 (1.10) 0.0000 (1.0) 0;0 1.4938 (0.91) 1 1 test_partial_add-gc-cloud-noop[2.39.0] 740.6890 (1.21) 740.6890 (1.21) 740.6890 (1.21) 0.0000 (1.0) 740.6890 (1.21) 0.0000 (1.0) 0;0 1.3501 (0.82) 1 1 test_partial_add-gc-cloud-noop[2.40.0] 700.5935 (1.15) 700.5935 (1.15) 700.5935 (1.15) 0.0000 (1.0) 700.5935 (1.15) 0.0000 (1.0) 0;0 1.4274 (0.87) 1 1 test_partial_add-gc-cloud-noop[2.41.1] 733.0835 (1.20) 733.0835 (1.20) 733.0835 (1.20) 0.0000 (1.0) 733.0835 (1.20) 0.0000 (1.0) 0;0 1.3641 (0.83) 1 1 test_partial_add-gc-cloud-noop[2.45.0] 707.5825 (1.16) 707.5825 (1.16) 707.5825 (1.16) 0.0000 (1.0) 707.5825 (1.16) 0.0000 (1.0) 0;0 1.4133 (0.86) 1 1 test_partial_add-gc-cloud-noop[main] 855.8975 (1.40) 855.8975 (1.40) 855.8975 (1.40) 0.0000 (1.0) 855.8975 (1.40) 0.0000 (1.0) 0;0 1.1684 (0.71) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.11.0] 545.1124 (1.0) 545.1124 (1.0) 545.1124 (1.0) 0.0000 (1.0) 545.1124 (1.0) 0.0000 (1.0) 0;0 1.8345 (1.0) 1 1 test_partial_add-gc-noop[2.18.1] 596.7621 (1.09) 596.7621 (1.09) 596.7621 (1.09) 0.0000 (1.0) 596.7621 (1.09) 0.0000 (1.0) 0;0 1.6757 (0.91) 1 1 test_partial_add-gc-noop[2.39.0] 648.1954 (1.19) 648.1954 (1.19) 648.1954 (1.19) 0.0000 (1.0) 648.1954 (1.19) 0.0000 (1.0) 0;0 1.5427 (0.84) 1 1 test_partial_add-gc-noop[2.40.0] 634.7337 (1.16) 634.7337 (1.16) 634.7337 (1.16) 0.0000 (1.0) 634.7337 (1.16) 0.0000 (1.0) 0;0 1.5755 (0.86) 1 1 test_partial_add-gc-noop[2.41.1] 626.0747 (1.15) 626.0747 (1.15) 626.0747 (1.15) 0.0000 (1.0) 626.0747 (1.15) 0.0000 (1.0) 0;0 1.5973 (0.87) 1 1 test_partial_add-gc-noop[2.45.0] 622.3928 (1.14) 622.3928 (1.14) 622.3928 (1.14) 0.0000 (1.0) 622.3928 (1.14) 0.0000 (1.0) 0;0 1.6067 (0.88) 1 1 test_partial_add-gc-noop[main] 763.3185 (1.40) 763.3185 (1.40) 763.3185 (1.40) 0.0000 (1.0) 763.3185 (1.40) 0.0000 (1.0) 0;0 1.3101 (0.71) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial-add[2.11.0] 3.0591 (1.14) 3.0591 (1.14) 3.0591 (1.14) 0.0000 (1.0) 3.0591 (1.14) 0.0000 (1.0) 0;0 0.3269 (0.87) 1 1 test_partial_add-push-partial-add[2.18.1] 3.0205 (1.13) 3.0205 (1.13) 3.0205 (1.13) 0.0000 (1.0) 3.0205 (1.13) 0.0000 (1.0) 0;0 0.3311 (0.89) 1 1 test_partial_add-push-partial-add[2.39.0] 3.9329 (1.47) 3.9329 (1.47) 3.9329 (1.47) 0.0000 (1.0) 3.9329 (1.47) 0.0000 (1.0) 0;0 0.2543 (0.68) 1 1 test_partial_add-push-partial-add[2.40.0] 3.6943 (1.38) 3.6943 (1.38) 3.6943 (1.38) 0.0000 (1.0) 3.6943 (1.38) 0.0000 (1.0) 0;0 0.2707 (0.72) 1 1 test_partial_add-push-partial-add[2.41.1] 3.7868 (1.42) 3.7868 (1.42) 3.7868 (1.42) 0.0000 (1.0) 3.7868 (1.42) 0.0000 (1.0) 0;0 0.2641 (0.71) 1 1 test_partial_add-push-partial-add[2.45.0] 2.6762 (1.0) 2.6762 (1.0) 2.6762 (1.0) 0.0000 (1.0) 2.6762 (1.0) 0.0000 (1.0) 0;0 0.3737 (1.0) 1 1 test_partial_add-push-partial-add[main] 2.8775 (1.08) 2.8775 (1.08) 2.8775 (1.08) 0.0000 (1.0) 2.8775 (1.08) 0.0000 (1.0) 0;0 0.3475 (0.93) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.11.0] 432.1360 (1.0) 432.1360 (1.0) 432.1360 (1.0) 0.0000 (1.0) 432.1360 (1.0) 0.0000 (1.0) 0;0 2.3141 (1.0) 1 1 test_gc-gc[2.18.1] 452.7763 (1.05) 452.7763 (1.05) 452.7763 (1.05) 0.0000 (1.0) 452.7763 (1.05) 0.0000 (1.0) 0;0 2.2086 (0.95) 1 1 test_gc-gc[2.39.0] 486.6017 (1.13) 486.6017 (1.13) 486.6017 (1.13) 0.0000 (1.0) 486.6017 (1.13) 0.0000 (1.0) 0;0 2.0551 (0.89) 1 1 test_gc-gc[2.40.0] 561.7749 (1.30) 561.7749 (1.30) 561.7749 (1.30) 0.0000 (1.0) 561.7749 (1.30) 0.0000 (1.0) 0;0 1.7801 (0.77) 1 1 test_gc-gc[2.41.1] 487.4816 (1.13) 487.4816 (1.13) 487.4816 (1.13) 0.0000 (1.0) 487.4816 (1.13) 0.0000 (1.0) 0;0 2.0514 (0.89) 1 1 test_gc-gc[2.45.0] 488.0163 (1.13) 488.0163 (1.13) 488.0163 (1.13) 0.0000 (1.0) 488.0163 (1.13) 0.0000 (1.0) 0;0 2.0491 (0.89) 1 1 test_gc-gc[main] 554.7819 (1.28) 554.7819 (1.28) 554.7819 (1.28) 0.0000 (1.0) 554.7819 (1.28) 0.0000 (1.0) 0;0 1.8025 (0.78) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_pull-pull': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_pull-pull[2.11.0] 8.5811 (1.28) 8.5811 (1.28) 8.5811 (1.28) 0.0000 (1.0) 8.5811 (1.28) 0.0000 (1.0) 0;0 0.1165 (0.78) 1 1 test_pull-pull[2.18.1] 8.5703 (1.28) 8.5703 (1.28) 8.5703 (1.28) 0.0000 (1.0) 8.5703 (1.28) 0.0000 (1.0) 0;0 0.1167 (0.78) 1 1 test_pull-pull[2.39.0] 10.1602 (1.52) 10.1602 (1.52) 10.1602 (1.52) 0.0000 (1.0) 10.1602 (1.52) 0.0000 (1.0) 0;0 0.0984 (0.66) 1 1 test_pull-pull[2.40.0] 10.5225 (1.57) 10.5225 (1.57) 10.5225 (1.57) 0.0000 (1.0) 10.5225 (1.57) 0.0000 (1.0) 0;0 0.0950 (0.64) 1 1 test_pull-pull[2.41.1] 10.1656 (1.52) 10.1656 (1.52) 10.1656 (1.52) 0.0000 (1.0) 10.1656 (1.52) 0.0000 (1.0) 0;0 0.0984 (0.66) 1 1 test_pull-pull[2.45.0] 8.2550 (1.24) 8.2550 (1.24) 8.2550 (1.24) 0.0000 (1.0) 8.2550 (1.24) 0.0000 (1.0) 0;0 0.1211 (0.81) 1 1 test_pull-pull[main] 6.6831 (1.0) 6.6831 (1.0) 6.6831 (1.0) 0.0000 (1.0) 6.6831 (1.0) 0.0000 (1.0) 0;0 0.1496 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.11.0] 9.1268 (1.30) 9.1268 (1.30) 9.1268 (1.30) 0.0000 (1.0) 9.1268 (1.30) 0.0000 (1.0) 0;0 0.1096 (0.77) 1 1 test_update-update[2.18.1] 8.1598 (1.17) 8.1598 (1.17) 8.1598 (1.17) 0.0000 (1.0) 8.1598 (1.17) 0.0000 (1.0) 0;0 0.1226 (0.86) 1 1 test_update-update[2.39.0] 7.3394 (1.05) 7.3394 (1.05) 7.3394 (1.05) 0.0000 (1.0) 7.3394 (1.05) 0.0000 (1.0) 0;0 0.1363 (0.95) 1 1 test_update-update[2.40.0] 7.3085 (1.04) 7.3085 (1.04) 7.3085 (1.04) 0.0000 (1.0) 7.3085 (1.04) 0.0000 (1.0) 0;0 0.1368 (0.96) 1 1 test_update-update[2.41.1] 7.3535 (1.05) 7.3535 (1.05) 7.3535 (1.05) 0.0000 (1.0) 7.3535 (1.05) 0.0000 (1.0) 0;0 0.1360 (0.95) 1 1 test_update-update[2.45.0] 7.5552 (1.08) 7.5552 (1.08) 7.5552 (1.08) 0.0000 (1.0) 7.5552 (1.08) 0.0000 (1.0) 0;0 0.1324 (0.93) 1 1 test_update-update[main] 6.9952 (1.0) 6.9952 (1.0) 6.9952 (1.0) 0.0000 (1.0) 6.9952 (1.0) 0.0000 (1.0) 0;0 0.1430 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update-noop[2.11.0] 481.7853 (1.0) 481.7853 (1.0) 481.7853 (1.0) 0.0000 (1.0) 481.7853 (1.0) 0.0000 (1.0) 0;0 2.0756 (1.0) 1 1 test_update-update-noop[2.18.1] 628.1108 (1.30) 628.1108 (1.30) 628.1108 (1.30) 0.0000 (1.0) 628.1108 (1.30) 0.0000 (1.0) 0;0 1.5921 (0.77) 1 1 test_update-update-noop[2.39.0] 926.9560 (1.92) 926.9560 (1.92) 926.9560 (1.92) 0.0000 (1.0) 926.9560 (1.92) 0.0000 (1.0) 0;0 1.0788 (0.52) 1 1 test_update-update-noop[2.40.0] 920.9677 (1.91) 920.9677 (1.91) 920.9677 (1.91) 0.0000 (1.0) 920.9677 (1.91) 0.0000 (1.0) 0;0 1.0858 (0.52) 1 1 test_update-update-noop[2.41.1] 922.2942 (1.91) 922.2942 (1.91) 922.2942 (1.91) 0.0000 (1.0) 922.2942 (1.91) 0.0000 (1.0) 0;0 1.0843 (0.52) 1 1 test_update-update-noop[2.45.0] 1,025.9179 (2.13) 1,025.9179 (2.13) 1,025.9179 (2.13) 0.0000 (1.0) 1,025.9179 (2.13) 0.0000 (1.0) 0;0 0.9747 (0.47) 1 1 test_update-update-noop[main] 1,116.8079 (2.32) 1,116.8079 (2.32) 1,116.8079 (2.32) 0.0000 (1.0) 1,116.8079 (2.32) 0.0000 (1.0) 0;0 0.8954 (0.43) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.18.1] 797.6299 (1.01) 797.6299 (1.01) 797.6299 (1.01) 0.0000 (1.0) 797.6299 (1.01) 0.0000 (1.0) 0;0 1.2537 (0.99) 1 1 test_data_status-data-changed[2.39.0] 825.5008 (1.05) 825.5008 (1.05) 825.5008 (1.05) 0.0000 (1.0) 825.5008 (1.05) 0.0000 (1.0) 0;0 1.2114 (0.95) 1 1 test_data_status-data-changed[2.40.0] 830.4588 (1.06) 830.4588 (1.06) 830.4588 (1.06) 0.0000 (1.0) 830.4588 (1.06) 0.0000 (1.0) 0;0 1.2042 (0.95) 1 1 test_data_status-data-changed[2.41.1] 836.4873 (1.06) 836.4873 (1.06) 836.4873 (1.06) 0.0000 (1.0) 836.4873 (1.06) 0.0000 (1.0) 0;0 1.1955 (0.94) 1 1 test_data_status-data-changed[2.45.0] 786.6429 (1.0) 786.6429 (1.0) 786.6429 (1.0) 0.0000 (1.0) 786.6429 (1.0) 0.0000 (1.0) 0;0 1.2712 (1.0) 1 1 test_data_status-data-changed[main] 852.2582 (1.08) 852.2582 (1.08) 852.2582 (1.08) 0.0000 (1.0) 852.2582 (1.08) 0.0000 (1.0) 0;0 1.1734 (0.92) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.18.1] 800.5646 (1.03) 800.5646 (1.03) 800.5646 (1.03) 0.0000 (1.0) 800.5646 (1.03) 0.0000 (1.0) 0;0 1.2491 (0.97) 1 1 test_data_status-data-changed-noop[2.39.0] 843.0883 (1.08) 843.0883 (1.08) 843.0883 (1.08) 0.0000 (1.0) 843.0883 (1.08) 0.0000 (1.0) 0;0 1.1861 (0.93) 1 1 test_data_status-data-changed-noop[2.40.0] 822.1120 (1.05) 822.1120 (1.05) 822.1120 (1.05) 0.0000 (1.0) 822.1120 (1.05) 0.0000 (1.0) 0;0 1.2164 (0.95) 1 1 test_data_status-data-changed-noop[2.41.1] 822.9371 (1.06) 822.9371 (1.06) 822.9371 (1.06) 0.0000 (1.0) 822.9371 (1.06) 0.0000 (1.0) 0;0 1.2152 (0.95) 1 1 test_data_status-data-changed-noop[2.45.0] 779.8758 (1.0) 779.8758 (1.0) 779.8758 (1.0) 0.0000 (1.0) 779.8758 (1.0) 0.0000 (1.0) 0;0 1.2823 (1.0) 1 1 test_data_status-data-changed-noop[main] 843.9736 (1.08) 843.9736 (1.08) 843.9736 (1.08) 0.0000 (1.0) 843.9736 (1.08) 0.0000 (1.0) 0;0 1.1849 (0.92) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.18.1] 1.8274 (1.04) 1.8274 (1.04) 1.8274 (1.04) 0.0000 (1.0) 1.8274 (1.04) 0.0000 (1.0) 0;0 0.5472 (0.96) 1 1 test_data_status-data-new[2.39.0] 1.8683 (1.07) 1.8683 (1.07) 1.8683 (1.07) 0.0000 (1.0) 1.8683 (1.07) 0.0000 (1.0) 0;0 0.5353 (0.94) 1 1 test_data_status-data-new[2.40.0] 1.8446 (1.05) 1.8446 (1.05) 1.8446 (1.05) 0.0000 (1.0) 1.8446 (1.05) 0.0000 (1.0) 0;0 0.5421 (0.95) 1 1 test_data_status-data-new[2.41.1] 1.8734 (1.07) 1.8734 (1.07) 1.8734 (1.07) 0.0000 (1.0) 1.8734 (1.07) 0.0000 (1.0) 0;0 0.5338 (0.94) 1 1 test_data_status-data-new[2.45.0] 1.7532 (1.0) 1.7532 (1.0) 1.7532 (1.0) 0.0000 (1.0) 1.7532 (1.0) 0.0000 (1.0) 0;0 0.5704 (1.0) 1 1 test_data_status-data-new[main] 1.8169 (1.04) 1.8169 (1.04) 1.8169 (1.04) 0.0000 (1.0) 1.8169 (1.04) 0.0000 (1.0) 0;0 0.5504 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.18.1] 796.7138 (1.00) 796.7138 (1.00) 796.7138 (1.00) 0.0000 (1.0) 796.7138 (1.00) 0.0000 (1.0) 0;0 1.2552 (1.00) 1 1 test_data_status-data-noop[2.39.0] 858.8318 (1.08) 858.8318 (1.08) 858.8318 (1.08) 0.0000 (1.0) 858.8318 (1.08) 0.0000 (1.0) 0;0 1.1644 (0.93) 1 1 test_data_status-data-noop[2.40.0] 818.4938 (1.03) 818.4938 (1.03) 818.4938 (1.03) 0.0000 (1.0) 818.4938 (1.03) 0.0000 (1.0) 0;0 1.2218 (0.97) 1 1 test_data_status-data-noop[2.41.1] 825.7477 (1.04) 825.7477 (1.04) 825.7477 (1.04) 0.0000 (1.0) 825.7477 (1.04) 0.0000 (1.0) 0;0 1.2110 (0.96) 1 1 test_data_status-data-noop[2.45.0] 796.4305 (1.0) 796.4305 (1.0) 796.4305 (1.0) 0.0000 (1.0) 796.4305 (1.0) 0.0000 (1.0) 0;0 1.2556 (1.0) 1 1 test_data_status-data-noop[main] 845.3258 (1.06) 845.3258 (1.06) 845.3258 (1.06) 0.0000 (1.0) 845.3258 (1.06) 0.0000 (1.0) 0;0 1.1830 (0.94) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_init-init': 7 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.11.0] 324.0700 (1.0) 357.6623 (1.0) 330.4211 (1.0) 4.4008 (1.20) 330.1911 (1.0) 4.3724 (1.28) 16;3 3.0264 (1.0) 100 1 test_init-init[2.18.1] 335.8669 (1.04) 360.4275 (1.01) 342.4285 (1.04) 3.6539 (1.0) 341.9840 (1.04) 3.4044 (1.0) 21;4 2.9203 (0.96) 100 1 test_init-init[2.39.0] 385.2279 (1.19) 448.9777 (1.26) 397.8169 (1.20) 9.0506 (2.48) 395.7690 (1.20) 7.9779 (2.34) 20;5 2.5137 (0.83) 100 1 test_init-init[2.40.0] 384.3289 (1.19) 419.9115 (1.17) 392.2651 (1.19) 4.5556 (1.25) 391.7896 (1.19) 5.3102 (1.56) 23;1 2.5493 (0.84) 100 1 test_init-init[2.41.1] 387.4528 (1.20) 419.2595 (1.17) 398.4337 (1.21) 7.6178 (2.08) 395.9767 (1.20) 10.5276 (3.09) 30;1 2.5098 (0.83) 100 1 test_init-init[2.45.0] 390.9298 (1.21) 430.4496 (1.20) 403.6125 (1.22) 7.5158 (2.06) 402.1404 (1.22) 8.5365 (2.51) 29;4 2.4776 (0.82) 100 1 test_init-init[main] 473.4056 (1.46) 595.0802 (1.66) 489.8499 (1.48) 14.0366 (3.84) 488.2273 (1.48) 8.2725 (2.43) 5;3 2.0414 (0.67) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.11.0] 6.5272 (1.82) 6.5272 (1.82) 6.5272 (1.82) 0.0000 (1.0) 6.5272 (1.82) 0.0000 (1.0) 0;0 0.1532 (0.55) 1 1 test_sharing_s3-add[2.11.0] 6.4142 (1.79) 6.4142 (1.79) 6.4142 (1.79) 0.0000 (1.0) 6.4142 (1.79) 0.0000 (1.0) 0;0 0.1559 (0.56) 1 1 test_sharing_s3-add[2.39.0] 5.3733 (1.50) 5.3733 (1.50) 5.3733 (1.50) 0.0000 (1.0) 5.3733 (1.50) 0.0000 (1.0) 0;0 0.1861 (0.67) 1 1 test_sharing_s3-add[2.39.0] 5.4195 (1.51) 5.4195 (1.51) 5.4195 (1.51) 0.0000 (1.0) 5.4195 (1.51) 0.0000 (1.0) 0;0 0.1845 (0.66) 1 1 test_sharing_s3-add[2.40.0] 5.3858 (1.50) 5.3858 (1.50) 5.3858 (1.50) 0.0000 (1.0) 5.3858 (1.50) 0.0000 (1.0) 0;0 0.1857 (0.67) 1 1 test_sharing_s3-add[2.40.0] 5.3922 (1.50) 5.3922 (1.50) 5.3922 (1.50) 0.0000 (1.0) 5.3922 (1.50) 0.0000 (1.0) 0;0 0.1855 (0.67) 1 1 test_sharing_s3-add[2.41.1] 5.3496 (1.49) 5.3496 (1.49) 5.3496 (1.49) 0.0000 (1.0) 5.3496 (1.49) 0.0000 (1.0) 0;0 0.1869 (0.67) 1 1 test_sharing_s3-add[2.41.1] 5.4334 (1.51) 5.4334 (1.51) 5.4334 (1.51) 0.0000 (1.0) 5.4334 (1.51) 0.0000 (1.0) 0;0 0.1840 (0.66) 1 1 test_sharing_s3-add[main] 3.6060 (1.00) 3.6060 (1.00) 3.6060 (1.00) 0.0000 (1.0) 3.6060 (1.00) 0.0000 (1.0) 0;0 0.2773 (1.00) 1 1 test_sharing_s3-add[main] 3.5899 (1.0) 3.5899 (1.0) 3.5899 (1.0) 0.0000 (1.0) 3.5899 (1.0) 0.0000 (1.0) 0;0 0.2786 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.11.0] 3.2112 (1.46) 3.2112 (1.46) 3.2112 (1.46) 0.0000 (1.0) 3.2112 (1.46) 0.0000 (1.0) 0;0 0.3114 (0.68) 1 1 test_sharing_s3-add-noop[2.11.0] 3.2292 (1.47) 3.2292 (1.47) 3.2292 (1.47) 0.0000 (1.0) 3.2292 (1.47) 0.0000 (1.0) 0;0 0.3097 (0.68) 1 1 test_sharing_s3-add-noop[2.39.0] 2.2151 (1.01) 2.2151 (1.01) 2.2151 (1.01) 0.0000 (1.0) 2.2151 (1.01) 0.0000 (1.0) 0;0 0.4515 (0.99) 1 1 test_sharing_s3-add-noop[2.39.0] 2.2170 (1.01) 2.2170 (1.01) 2.2170 (1.01) 0.0000 (1.0) 2.2170 (1.01) 0.0000 (1.0) 0;0 0.4511 (0.99) 1 1 test_sharing_s3-add-noop[2.40.0] 2.2153 (1.01) 2.2153 (1.01) 2.2153 (1.01) 0.0000 (1.0) 2.2153 (1.01) 0.0000 (1.0) 0;0 0.4514 (0.99) 1 1 test_sharing_s3-add-noop[2.40.0] 2.1976 (1.0) 2.1976 (1.0) 2.1976 (1.0) 0.0000 (1.0) 2.1976 (1.0) 0.0000 (1.0) 0;0 0.4550 (1.0) 1 1 test_sharing_s3-add-noop[2.41.1] 2.2500 (1.02) 2.2500 (1.02) 2.2500 (1.02) 0.0000 (1.0) 2.2500 (1.02) 0.0000 (1.0) 0;0 0.4444 (0.98) 1 1 test_sharing_s3-add-noop[2.41.1] 2.2168 (1.01) 2.2168 (1.01) 2.2168 (1.01) 0.0000 (1.0) 2.2168 (1.01) 0.0000 (1.0) 0;0 0.4511 (0.99) 1 1 test_sharing_s3-add-noop[main] 2.4190 (1.10) 2.4190 (1.10) 2.4190 (1.10) 0.0000 (1.0) 2.4190 (1.10) 0.0000 (1.0) 0;0 0.4134 (0.91) 1 1 test_sharing_s3-add-noop[main] 2.4185 (1.10) 2.4185 (1.10) 2.4185 (1.10) 0.0000 (1.0) 2.4185 (1.10) 0.0000 (1.0) 0;0 0.4135 (0.91) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.11.0] 481.0830 (1.0) 481.0830 (1.0) 481.0830 (1.0) 0.0000 (1.0) 481.0830 (1.0) 0.0000 (1.0) 0;0 2.0786 (1.0) 1 1 test_sharing_s3-checkout-noop[2.11.0] 484.0378 (1.01) 484.0378 (1.01) 484.0378 (1.01) 0.0000 (1.0) 484.0378 (1.01) 0.0000 (1.0) 0;0 2.0660 (0.99) 1 1 test_sharing_s3-checkout-noop[2.39.0] 565.1615 (1.17) 565.1615 (1.17) 565.1615 (1.17) 0.0000 (1.0) 565.1615 (1.17) 0.0000 (1.0) 0;0 1.7694 (0.85) 1 1 test_sharing_s3-checkout-noop[2.39.0] 563.7510 (1.17) 563.7510 (1.17) 563.7510 (1.17) 0.0000 (1.0) 563.7510 (1.17) 0.0000 (1.0) 0;0 1.7738 (0.85) 1 1 test_sharing_s3-checkout-noop[2.40.0] 561.2197 (1.17) 561.2197 (1.17) 561.2197 (1.17) 0.0000 (1.0) 561.2197 (1.17) 0.0000 (1.0) 0;0 1.7818 (0.86) 1 1 test_sharing_s3-checkout-noop[2.40.0] 557.9149 (1.16) 557.9149 (1.16) 557.9149 (1.16) 0.0000 (1.0) 557.9149 (1.16) 0.0000 (1.0) 0;0 1.7924 (0.86) 1 1 test_sharing_s3-checkout-noop[2.41.1] 553.1986 (1.15) 553.1986 (1.15) 553.1986 (1.15) 0.0000 (1.0) 553.1986 (1.15) 0.0000 (1.0) 0;0 1.8077 (0.87) 1 1 test_sharing_s3-checkout-noop[2.41.1] 558.4857 (1.16) 558.4857 (1.16) 558.4857 (1.16) 0.0000 (1.0) 558.4857 (1.16) 0.0000 (1.0) 0;0 1.7906 (0.86) 1 1 test_sharing_s3-checkout-noop[main] 661.7326 (1.38) 661.7326 (1.38) 661.7326 (1.38) 0.0000 (1.0) 661.7326 (1.38) 0.0000 (1.0) 0;0 1.5112 (0.73) 1 1 test_sharing_s3-checkout-noop[main] 650.0214 (1.35) 650.0214 (1.35) 650.0214 (1.35) 0.0000 (1.0) 650.0214 (1.35) 0.0000 (1.0) 0;0 1.5384 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.11.0] 14.3779 (1.32) 14.3779 (1.32) 14.3779 (1.32) 0.0000 (1.0) 14.3779 (1.32) 0.0000 (1.0) 0;0 0.0696 (0.76) 1 1 test_sharing_s3-pull[2.11.0] 14.3208 (1.31) 14.3208 (1.31) 14.3208 (1.31) 0.0000 (1.0) 14.3208 (1.31) 0.0000 (1.0) 0;0 0.0698 (0.76) 1 1 test_sharing_s3-pull[2.39.0] 14.6984 (1.34) 14.6984 (1.34) 14.6984 (1.34) 0.0000 (1.0) 14.6984 (1.34) 0.0000 (1.0) 0;0 0.0680 (0.74) 1 1 test_sharing_s3-pull[2.39.0] 14.8360 (1.36) 14.8360 (1.36) 14.8360 (1.36) 0.0000 (1.0) 14.8360 (1.36) 0.0000 (1.0) 0;0 0.0674 (0.74) 1 1 test_sharing_s3-pull[2.40.0] 14.5876 (1.33) 14.5876 (1.33) 14.5876 (1.33) 0.0000 (1.0) 14.5876 (1.33) 0.0000 (1.0) 0;0 0.0686 (0.75) 1 1 test_sharing_s3-pull[2.40.0] 14.5656 (1.33) 14.5656 (1.33) 14.5656 (1.33) 0.0000 (1.0) 14.5656 (1.33) 0.0000 (1.0) 0;0 0.0687 (0.75) 1 1 test_sharing_s3-pull[2.41.1] 14.5647 (1.33) 14.5647 (1.33) 14.5647 (1.33) 0.0000 (1.0) 14.5647 (1.33) 0.0000 (1.0) 0;0 0.0687 (0.75) 1 1 test_sharing_s3-pull[2.41.1] 14.6575 (1.34) 14.6575 (1.34) 14.6575 (1.34) 0.0000 (1.0) 14.6575 (1.34) 0.0000 (1.0) 0;0 0.0682 (0.75) 1 1 test_sharing_s3-pull[main] 10.9533 (1.00) 10.9533 (1.00) 10.9533 (1.00) 0.0000 (1.0) 10.9533 (1.00) 0.0000 (1.0) 0;0 0.0913 (1.00) 1 1 test_sharing_s3-pull[main] 10.9324 (1.0) 10.9324 (1.0) 10.9324 (1.0) 0.0000 (1.0) 10.9324 (1.0) 0.0000 (1.0) 0;0 0.0915 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.11.0] 706.9750 (1.00) 706.9750 (1.00) 706.9750 (1.00) 0.0000 (1.0) 706.9750 (1.00) 0.0000 (1.0) 0;0 1.4145 (1.00) 1 1 test_sharing_s3-pull-noop[2.11.0] 706.4494 (1.0) 706.4494 (1.0) 706.4494 (1.0) 0.0000 (1.0) 706.4494 (1.0) 0.0000 (1.0) 0;0 1.4155 (1.0) 1 1 test_sharing_s3-pull-noop[2.39.0] 773.5363 (1.09) 773.5363 (1.09) 773.5363 (1.09) 0.0000 (1.0) 773.5363 (1.09) 0.0000 (1.0) 0;0 1.2928 (0.91) 1 1 test_sharing_s3-pull-noop[2.39.0] 781.3478 (1.11) 781.3478 (1.11) 781.3478 (1.11) 0.0000 (1.0) 781.3478 (1.11) 0.0000 (1.0) 0;0 1.2798 (0.90) 1 1 test_sharing_s3-pull-noop[2.40.0] 775.3324 (1.10) 775.3324 (1.10) 775.3324 (1.10) 0.0000 (1.0) 775.3324 (1.10) 0.0000 (1.0) 0;0 1.2898 (0.91) 1 1 test_sharing_s3-pull-noop[2.40.0] 770.2661 (1.09) 770.2661 (1.09) 770.2661 (1.09) 0.0000 (1.0) 770.2661 (1.09) 0.0000 (1.0) 0;0 1.2983 (0.92) 1 1 test_sharing_s3-pull-noop[2.41.1] 763.0065 (1.08) 763.0065 (1.08) 763.0065 (1.08) 0.0000 (1.0) 763.0065 (1.08) 0.0000 (1.0) 0;0 1.3106 (0.93) 1 1 test_sharing_s3-pull-noop[2.41.1] 772.4645 (1.09) 772.4645 (1.09) 772.4645 (1.09) 0.0000 (1.0) 772.4645 (1.09) 0.0000 (1.0) 0;0 1.2946 (0.91) 1 1 test_sharing_s3-pull-noop[main] 869.0200 (1.23) 869.0200 (1.23) 869.0200 (1.23) 0.0000 (1.0) 869.0200 (1.23) 0.0000 (1.0) 0;0 1.1507 (0.81) 1 1 test_sharing_s3-pull-noop[main] 870.4109 (1.23) 870.4109 (1.23) 870.4109 (1.23) 0.0000 (1.0) 870.4109 (1.23) 0.0000 (1.0) 0;0 1.1489 (0.81) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.11.0] 21.0220 (2.34) 21.0220 (2.34) 21.0220 (2.34) 0.0000 (1.0) 21.0220 (2.34) 0.0000 (1.0) 0;0 0.0476 (0.43) 1 1 test_sharing_s3-push[2.11.0] 21.0647 (2.34) 21.0647 (2.34) 21.0647 (2.34) 0.0000 (1.0) 21.0647 (2.34) 0.0000 (1.0) 0;0 0.0475 (0.43) 1 1 test_sharing_s3-push[2.39.0] 22.7417 (2.53) 22.7417 (2.53) 22.7417 (2.53) 0.0000 (1.0) 22.7417 (2.53) 0.0000 (1.0) 0;0 0.0440 (0.40) 1 1 test_sharing_s3-push[2.39.0] 22.6912 (2.52) 22.6912 (2.52) 22.6912 (2.52) 0.0000 (1.0) 22.6912 (2.52) 0.0000 (1.0) 0;0 0.0441 (0.40) 1 1 test_sharing_s3-push[2.40.0] 22.0942 (2.45) 22.0942 (2.45) 22.0942 (2.45) 0.0000 (1.0) 22.0942 (2.45) 0.0000 (1.0) 0;0 0.0453 (0.41) 1 1 test_sharing_s3-push[2.40.0] 22.1242 (2.46) 22.1242 (2.46) 22.1242 (2.46) 0.0000 (1.0) 22.1242 (2.46) 0.0000 (1.0) 0;0 0.0452 (0.41) 1 1 test_sharing_s3-push[2.41.1] 11.7351 (1.30) 11.7351 (1.30) 11.7351 (1.30) 0.0000 (1.0) 11.7351 (1.30) 0.0000 (1.0) 0;0 0.0852 (0.77) 1 1 test_sharing_s3-push[2.41.1] 11.7643 (1.31) 11.7643 (1.31) 11.7643 (1.31) 0.0000 (1.0) 11.7643 (1.31) 0.0000 (1.0) 0;0 0.0850 (0.77) 1 1 test_sharing_s3-push[main] 9.0023 (1.0) 9.0023 (1.0) 9.0023 (1.0) 0.0000 (1.0) 9.0023 (1.0) 0.0000 (1.0) 0;0 0.1111 (1.0) 1 1 test_sharing_s3-push[main] 9.0128 (1.00) 9.0128 (1.00) 9.0128 (1.00) 0.0000 (1.0) 9.0128 (1.00) 0.0000 (1.0) 0;0 0.1110 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push-noop[2.11.0] 957.0500 (1.0) 957.0500 (1.0) 957.0500 (1.0) 0.0000 (1.0) 957.0500 (1.0) 0.0000 (1.0) 0;0 1.0449 (1.0) 1 1 test_sharing_s3-push-noop[2.11.0] 968.3501 (1.01) 968.3501 (1.01) 968.3501 (1.01) 0.0000 (1.0) 968.3501 (1.01) 0.0000 (1.0) 0;0 1.0327 (0.99) 1 1 test_sharing_s3-push-noop[2.39.0] 972.8953 (1.02) 972.8953 (1.02) 972.8953 (1.02) 0.0000 (1.0) 972.8953 (1.02) 0.0000 (1.0) 0;0 1.0279 (0.98) 1 1 test_sharing_s3-push-noop[2.39.0] 1,042.6326 (1.09) 1,042.6326 (1.09) 1,042.6326 (1.09) 0.0000 (1.0) 1,042.6326 (1.09) 0.0000 (1.0) 0;0 0.9591 (0.92) 1 1 test_sharing_s3-push-noop[2.40.0] 1,063.5729 (1.11) 1,063.5729 (1.11) 1,063.5729 (1.11) 0.0000 (1.0) 1,063.5729 (1.11) 0.0000 (1.0) 0;0 0.9402 (0.90) 1 1 test_sharing_s3-push-noop[2.40.0] 976.5687 (1.02) 976.5687 (1.02) 976.5687 (1.02) 0.0000 (1.0) 976.5687 (1.02) 0.0000 (1.0) 0;0 1.0240 (0.98) 1 1 test_sharing_s3-push-noop[2.41.1] 974.2092 (1.02) 974.2092 (1.02) 974.2092 (1.02) 0.0000 (1.0) 974.2092 (1.02) 0.0000 (1.0) 0;0 1.0265 (0.98) 1 1 test_sharing_s3-push-noop[2.41.1] 961.9242 (1.01) 961.9242 (1.01) 961.9242 (1.01) 0.0000 (1.0) 961.9242 (1.01) 0.0000 (1.0) 0;0 1.0396 (0.99) 1 1 test_sharing_s3-push-noop[main] 1,051.6161 (1.10) 1,051.6161 (1.10) 1,051.6161 (1.10) 0.0000 (1.0) 1,051.6161 (1.10) 0.0000 (1.0) 0;0 0.9509 (0.91) 1 1 test_sharing_s3-push-noop[main] 1,051.5943 (1.10) 1,051.5943 (1.10) 1,051.5943 (1.10) 0.0000 (1.0) 1,051.5943 (1.10) 0.0000 (1.0) 0;0 0.9509 (0.91) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.11.0] 6.9546 (1.81) 6.9546 (1.81) 6.9546 (1.81) 0.0000 (1.0) 6.9546 (1.81) 0.0000 (1.0) 0;0 0.1438 (0.55) 1 1 test_sharing-add[2.18.1] 6.4311 (1.68) 6.4311 (1.68) 6.4311 (1.68) 0.0000 (1.0) 6.4311 (1.68) 0.0000 (1.0) 0;0 0.1555 (0.60) 1 1 test_sharing-add[2.39.0] 6.0155 (1.57) 6.0155 (1.57) 6.0155 (1.57) 0.0000 (1.0) 6.0155 (1.57) 0.0000 (1.0) 0;0 0.1662 (0.64) 1 1 test_sharing-add[2.40.0] 6.0905 (1.59) 6.0905 (1.59) 6.0905 (1.59) 0.0000 (1.0) 6.0905 (1.59) 0.0000 (1.0) 0;0 0.1642 (0.63) 1 1 test_sharing-add[2.41.1] 5.7292 (1.49) 5.7292 (1.49) 5.7292 (1.49) 0.0000 (1.0) 5.7292 (1.49) 0.0000 (1.0) 0;0 0.1745 (0.67) 1 1 test_sharing-add[2.45.0] 3.8343 (1.0) 3.8343 (1.0) 3.8343 (1.0) 0.0000 (1.0) 3.8343 (1.0) 0.0000 (1.0) 0;0 0.2608 (1.0) 1 1 test_sharing-add[main] 3.9884 (1.04) 3.9884 (1.04) 3.9884 (1.04) 0.0000 (1.0) 3.9884 (1.04) 0.0000 (1.0) 0;0 0.2507 (0.96) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.11.0] 3.4159 (1.42) 3.4159 (1.42) 3.4159 (1.42) 0.0000 (1.0) 3.4159 (1.42) 0.0000 (1.0) 0;0 0.2927 (0.70) 1 1 test_sharing-add-noop[2.18.1] 3.6280 (1.51) 3.6280 (1.51) 3.6280 (1.51) 0.0000 (1.0) 3.6280 (1.51) 0.0000 (1.0) 0;0 0.2756 (0.66) 1 1 test_sharing-add-noop[2.39.0] 2.4809 (1.03) 2.4809 (1.03) 2.4809 (1.03) 0.0000 (1.0) 2.4809 (1.03) 0.0000 (1.0) 0;0 0.4031 (0.97) 1 1 test_sharing-add-noop[2.40.0] 2.4260 (1.01) 2.4260 (1.01) 2.4260 (1.01) 0.0000 (1.0) 2.4260 (1.01) 0.0000 (1.0) 0;0 0.4122 (0.99) 1 1 test_sharing-add-noop[2.41.1] 2.4018 (1.0) 2.4018 (1.0) 2.4018 (1.0) 0.0000 (1.0) 2.4018 (1.0) 0.0000 (1.0) 0;0 0.4164 (1.0) 1 1 test_sharing-add-noop[2.45.0] 2.7134 (1.13) 2.7134 (1.13) 2.7134 (1.13) 0.0000 (1.0) 2.7134 (1.13) 0.0000 (1.0) 0;0 0.3685 (0.89) 1 1 test_sharing-add-noop[main] 2.6886 (1.12) 2.6886 (1.12) 2.6886 (1.12) 0.0000 (1.0) 2.6886 (1.12) 0.0000 (1.0) 0;0 0.3719 (0.89) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.11.0] 477.5696 (1.0) 477.5696 (1.0) 477.5696 (1.0) 0.0000 (1.0) 477.5696 (1.0) 0.0000 (1.0) 0;0 2.0939 (1.0) 1 1 test_sharing-checkout-noop[2.18.1] 553.2082 (1.16) 553.2082 (1.16) 553.2082 (1.16) 0.0000 (1.0) 553.2082 (1.16) 0.0000 (1.0) 0;0 1.8076 (0.86) 1 1 test_sharing-checkout-noop[2.39.0] 574.2418 (1.20) 574.2418 (1.20) 574.2418 (1.20) 0.0000 (1.0) 574.2418 (1.20) 0.0000 (1.0) 0;0 1.7414 (0.83) 1 1 test_sharing-checkout-noop[2.40.0] 576.5989 (1.21) 576.5989 (1.21) 576.5989 (1.21) 0.0000 (1.0) 576.5989 (1.21) 0.0000 (1.0) 0;0 1.7343 (0.83) 1 1 test_sharing-checkout-noop[2.41.1] 575.1343 (1.20) 575.1343 (1.20) 575.1343 (1.20) 0.0000 (1.0) 575.1343 (1.20) 0.0000 (1.0) 0;0 1.7387 (0.83) 1 1 test_sharing-checkout-noop[2.45.0] 597.2264 (1.25) 597.2264 (1.25) 597.2264 (1.25) 0.0000 (1.0) 597.2264 (1.25) 0.0000 (1.0) 0;0 1.6744 (0.80) 1 1 test_sharing-checkout-noop[main] 675.9217 (1.42) 675.9217 (1.42) 675.9217 (1.42) 0.0000 (1.0) 675.9217 (1.42) 0.0000 (1.0) 0;0 1.4795 (0.71) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-pull': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[2.11.0] 7.0874 (1.31) 7.0874 (1.31) 7.0874 (1.31) 0.0000 (1.0) 7.0874 (1.31) 0.0000 (1.0) 0;0 0.1411 (0.76) 1 1 test_sharing-pull[2.18.1] 7.1416 (1.32) 7.1416 (1.32) 7.1416 (1.32) 0.0000 (1.0) 7.1416 (1.32) 0.0000 (1.0) 0;0 0.1400 (0.76) 1 1 test_sharing-pull[2.39.0] 8.4660 (1.56) 8.4660 (1.56) 8.4660 (1.56) 0.0000 (1.0) 8.4660 (1.56) 0.0000 (1.0) 0;0 0.1181 (0.64) 1 1 test_sharing-pull[2.40.0] 8.4234 (1.56) 8.4234 (1.56) 8.4234 (1.56) 0.0000 (1.0) 8.4234 (1.56) 0.0000 (1.0) 0;0 0.1187 (0.64) 1 1 test_sharing-pull[2.41.1] 8.3938 (1.55) 8.3938 (1.55) 8.3938 (1.55) 0.0000 (1.0) 8.3938 (1.55) 0.0000 (1.0) 0;0 0.1191 (0.65) 1 1 test_sharing-pull[2.45.0] 6.6614 (1.23) 6.6614 (1.23) 6.6614 (1.23) 0.0000 (1.0) 6.6614 (1.23) 0.0000 (1.0) 0;0 0.1501 (0.81) 1 1 test_sharing-pull[main] 5.4147 (1.0) 5.4147 (1.0) 5.4147 (1.0) 0.0000 (1.0) 5.4147 (1.0) 0.0000 (1.0) 0;0 0.1847 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[2.11.0] 511.2303 (1.0) 511.2303 (1.0) 511.2303 (1.0) 0.0000 (1.0) 511.2303 (1.0) 0.0000 (1.0) 0;0 1.9561 (1.0) 1 1 test_sharing-pull-noop[2.18.1] 586.1933 (1.15) 586.1933 (1.15) 586.1933 (1.15) 0.0000 (1.0) 586.1933 (1.15) 0.0000 (1.0) 0;0 1.7059 (0.87) 1 1 test_sharing-pull-noop[2.39.0] 614.4045 (1.20) 614.4045 (1.20) 614.4045 (1.20) 0.0000 (1.0) 614.4045 (1.20) 0.0000 (1.0) 0;0 1.6276 (0.83) 1 1 test_sharing-pull-noop[2.40.0] 614.1677 (1.20) 614.1677 (1.20) 614.1677 (1.20) 0.0000 (1.0) 614.1677 (1.20) 0.0000 (1.0) 0;0 1.6282 (0.83) 1 1 test_sharing-pull-noop[2.41.1] 611.5381 (1.20) 611.5381 (1.20) 611.5381 (1.20) 0.0000 (1.0) 611.5381 (1.20) 0.0000 (1.0) 0;0 1.6352 (0.84) 1 1 test_sharing-pull-noop[2.45.0] 649.9260 (1.27) 649.9260 (1.27) 649.9260 (1.27) 0.0000 (1.0) 649.9260 (1.27) 0.0000 (1.0) 0;0 1.5386 (0.79) 1 1 test_sharing-pull-noop[main] 731.5625 (1.43) 731.5625 (1.43) 731.5625 (1.43) 0.0000 (1.0) 731.5625 (1.43) 0.0000 (1.0) 0;0 1.3669 (0.70) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.11.0] 3.8703 (1.16) 3.8703 (1.16) 3.8703 (1.16) 0.0000 (1.0) 3.8703 (1.16) 0.0000 (1.0) 0;0 0.2584 (0.86) 1 1 test_sharing-push[2.18.1] 3.8460 (1.15) 3.8460 (1.15) 3.8460 (1.15) 0.0000 (1.0) 3.8460 (1.15) 0.0000 (1.0) 0;0 0.2600 (0.87) 1 1 test_sharing-push[2.39.0] 4.9770 (1.49) 4.9770 (1.49) 4.9770 (1.49) 0.0000 (1.0) 4.9770 (1.49) 0.0000 (1.0) 0;0 0.2009 (0.67) 1 1 test_sharing-push[2.40.0] 4.9316 (1.48) 4.9316 (1.48) 4.9316 (1.48) 0.0000 (1.0) 4.9316 (1.48) 0.0000 (1.0) 0;0 0.2028 (0.68) 1 1 test_sharing-push[2.41.1] 4.9304 (1.48) 4.9304 (1.48) 4.9304 (1.48) 0.0000 (1.0) 4.9304 (1.48) 0.0000 (1.0) 0;0 0.2028 (0.68) 1 1 test_sharing-push[2.45.0] 3.3324 (1.0) 3.3324 (1.0) 3.3324 (1.0) 0.0000 (1.0) 3.3324 (1.0) 0.0000 (1.0) 0;0 0.3001 (1.0) 1 1 test_sharing-push[main] 3.4666 (1.04) 3.4666 (1.04) 3.4666 (1.04) 0.0000 (1.0) 3.4666 (1.04) 0.0000 (1.0) 0;0 0.2885 (0.96) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.11.0] 425.0137 (1.0) 425.0137 (1.0) 425.0137 (1.0) 0.0000 (1.0) 425.0137 (1.0) 0.0000 (1.0) 0;0 2.3529 (1.0) 1 1 test_sharing-push-noop[2.18.1] 434.2586 (1.02) 434.2586 (1.02) 434.2586 (1.02) 0.0000 (1.0) 434.2586 (1.02) 0.0000 (1.0) 0;0 2.3028 (0.98) 1 1 test_sharing-push-noop[2.39.0] 470.9442 (1.11) 470.9442 (1.11) 470.9442 (1.11) 0.0000 (1.0) 470.9442 (1.11) 0.0000 (1.0) 0;0 2.1234 (0.90) 1 1 test_sharing-push-noop[2.40.0] 471.7476 (1.11) 471.7476 (1.11) 471.7476 (1.11) 0.0000 (1.0) 471.7476 (1.11) 0.0000 (1.0) 0;0 2.1198 (0.90) 1 1 test_sharing-push-noop[2.41.1] 472.3368 (1.11) 472.3368 (1.11) 472.3368 (1.11) 0.0000 (1.0) 472.3368 (1.11) 0.0000 (1.0) 0;0 2.1171 (0.90) 1 1 test_sharing-push-noop[2.45.0] 479.1372 (1.13) 479.1372 (1.13) 479.1372 (1.13) 0.0000 (1.0) 479.1372 (1.13) 0.0000 (1.0) 0;0 2.0871 (0.89) 1 1 test_sharing-push-noop[main] 561.5774 (1.32) 561.5774 (1.32) 561.5774 (1.32) 0.0000 (1.0) 561.5774 (1.32) 0.0000 (1.0) 0;0 1.7807 (0.76) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.11.0] 7.8408 (1.39) 7.8408 (1.39) 7.8408 (1.39) 0.0000 (1.0) 7.8408 (1.39) 0.0000 (1.0) 0;0 0.1275 (0.72) 1 1 test_get-get[2.18.1] 7.2379 (1.29) 7.2379 (1.29) 7.2379 (1.29) 0.0000 (1.0) 7.2379 (1.29) 0.0000 (1.0) 0;0 0.1382 (0.78) 1 1 test_get-get[2.39.0] 5.8972 (1.05) 5.8972 (1.05) 5.8972 (1.05) 0.0000 (1.0) 5.8972 (1.05) 0.0000 (1.0) 0;0 0.1696 (0.95) 1 1 test_get-get[2.40.0] 5.6242 (1.0) 5.6242 (1.0) 5.6242 (1.0) 0.0000 (1.0) 5.6242 (1.0) 0.0000 (1.0) 0;0 0.1778 (1.0) 1 1 test_get-get[2.41.1] 5.7123 (1.02) 5.7123 (1.02) 5.7123 (1.02) 0.0000 (1.0) 5.7123 (1.02) 0.0000 (1.0) 0;0 0.1751 (0.98) 1 1 test_get-get[2.45.0] 5.6627 (1.01) 5.6627 (1.01) 5.6627 (1.01) 0.0000 (1.0) 5.6627 (1.01) 0.0000 (1.0) 0;0 0.1766 (0.99) 1 1 test_get-get[main] 9.9537 (1.77) 9.9537 (1.77) 9.9537 (1.77) 0.0000 (1.0) 9.9537 (1.77) 0.0000 (1.0) 0;0 0.1005 (0.57) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add[2.11.0] 7.3493 (1.76) 7.3493 (1.76) 7.3493 (1.76) 0.0000 (1.0) 7.3493 (1.76) 0.0000 (1.0) 0;0 0.1361 (0.57) 1 1 test_sharing_azure-add[2.11.0] 8.6171 (2.07) 8.6171 (2.07) 8.6171 (2.07) 0.0000 (1.0) 8.6171 (2.07) 0.0000 (1.0) 0;0 0.1160 (0.48) 1 1 test_sharing_azure-add[2.39.0] 6.0777 (1.46) 6.0777 (1.46) 6.0777 (1.46) 0.0000 (1.0) 6.0777 (1.46) 0.0000 (1.0) 0;0 0.1645 (0.69) 1 1 test_sharing_azure-add[2.39.0] 6.0429 (1.45) 6.0429 (1.45) 6.0429 (1.45) 0.0000 (1.0) 6.0429 (1.45) 0.0000 (1.0) 0;0 0.1655 (0.69) 1 1 test_sharing_azure-add[2.40.0] 5.9985 (1.44) 5.9985 (1.44) 5.9985 (1.44) 0.0000 (1.0) 5.9985 (1.44) 0.0000 (1.0) 0;0 0.1667 (0.70) 1 1 test_sharing_azure-add[2.40.0] 6.0035 (1.44) 6.0035 (1.44) 6.0035 (1.44) 0.0000 (1.0) 6.0035 (1.44) 0.0000 (1.0) 0;0 0.1666 (0.69) 1 1 test_sharing_azure-add[2.41.1] 6.1347 (1.47) 6.1347 (1.47) 6.1347 (1.47) 0.0000 (1.0) 6.1347 (1.47) 0.0000 (1.0) 0;0 0.1630 (0.68) 1 1 test_sharing_azure-add[2.41.1] 6.1240 (1.47) 6.1240 (1.47) 6.1240 (1.47) 0.0000 (1.0) 6.1240 (1.47) 0.0000 (1.0) 0;0 0.1633 (0.68) 1 1 test_sharing_azure-add[main] 4.1696 (1.0) 4.1696 (1.0) 4.1696 (1.0) 0.0000 (1.0) 4.1696 (1.0) 0.0000 (1.0) 0;0 0.2398 (1.0) 1 1 test_sharing_azure-add[main] 4.1765 (1.00) 4.1765 (1.00) 4.1765 (1.00) 0.0000 (1.0) 4.1765 (1.00) 0.0000 (1.0) 0;0 0.2394 (1.00) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add-noop[2.11.0] 3.4975 (1.42) 3.4975 (1.42) 3.4975 (1.42) 0.0000 (1.0) 3.4975 (1.42) 0.0000 (1.0) 0;0 0.2859 (0.71) 1 1 test_sharing_azure-add-noop[2.11.0] 3.4913 (1.41) 3.4913 (1.41) 3.4913 (1.41) 0.0000 (1.0) 3.4913 (1.41) 0.0000 (1.0) 0;0 0.2864 (0.71) 1 1 test_sharing_azure-add-noop[2.39.0] 2.5098 (1.02) 2.5098 (1.02) 2.5098 (1.02) 0.0000 (1.0) 2.5098 (1.02) 0.0000 (1.0) 0;0 0.3984 (0.98) 1 1 test_sharing_azure-add-noop[2.39.0] 2.5246 (1.02) 2.5246 (1.02) 2.5246 (1.02) 0.0000 (1.0) 2.5246 (1.02) 0.0000 (1.0) 0;0 0.3961 (0.98) 1 1 test_sharing_azure-add-noop[2.40.0] 2.4922 (1.01) 2.4922 (1.01) 2.4922 (1.01) 0.0000 (1.0) 2.4922 (1.01) 0.0000 (1.0) 0;0 0.4013 (0.99) 1 1 test_sharing_azure-add-noop[2.40.0] 2.4684 (1.0) 2.4684 (1.0) 2.4684 (1.0) 0.0000 (1.0) 2.4684 (1.0) 0.0000 (1.0) 0;0 0.4051 (1.0) 1 1 test_sharing_azure-add-noop[2.41.1] 2.5664 (1.04) 2.5664 (1.04) 2.5664 (1.04) 0.0000 (1.0) 2.5664 (1.04) 0.0000 (1.0) 0;0 0.3896 (0.96) 1 1 test_sharing_azure-add-noop[2.41.1] 2.4785 (1.00) 2.4785 (1.00) 2.4785 (1.00) 0.0000 (1.0) 2.4785 (1.00) 0.0000 (1.0) 0;0 0.4035 (1.00) 1 1 test_sharing_azure-add-noop[main] 2.7908 (1.13) 2.7908 (1.13) 2.7908 (1.13) 0.0000 (1.0) 2.7908 (1.13) 0.0000 (1.0) 0;0 0.3583 (0.88) 1 1 test_sharing_azure-add-noop[main] 2.7655 (1.12) 2.7655 (1.12) 2.7655 (1.12) 0.0000 (1.0) 2.7655 (1.12) 0.0000 (1.0) 0;0 0.3616 (0.89) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-checkout-noop[2.11.0] 510.0540 (1.0) 510.0540 (1.0) 510.0540 (1.0) 0.0000 (1.0) 510.0540 (1.0) 0.0000 (1.0) 0;0 1.9606 (1.0) 1 1 test_sharing_azure-checkout-noop[2.11.0] 536.7284 (1.05) 536.7284 (1.05) 536.7284 (1.05) 0.0000 (1.0) 536.7284 (1.05) 0.0000 (1.0) 0;0 1.8631 (0.95) 1 1 test_sharing_azure-checkout-noop[2.39.0] 602.7663 (1.18) 602.7663 (1.18) 602.7663 (1.18) 0.0000 (1.0) 602.7663 (1.18) 0.0000 (1.0) 0;0 1.6590 (0.85) 1 1 test_sharing_azure-checkout-noop[2.39.0] 611.8949 (1.20) 611.8949 (1.20) 611.8949 (1.20) 0.0000 (1.0) 611.8949 (1.20) 0.0000 (1.0) 0;0 1.6343 (0.83) 1 1 test_sharing_azure-checkout-noop[2.40.0] 602.6009 (1.18) 602.6009 (1.18) 602.6009 (1.18) 0.0000 (1.0) 602.6009 (1.18) 0.0000 (1.0) 0;0 1.6595 (0.85) 1 1 test_sharing_azure-checkout-noop[2.40.0] 597.5456 (1.17) 597.5456 (1.17) 597.5456 (1.17) 0.0000 (1.0) 597.5456 (1.17) 0.0000 (1.0) 0;0 1.6735 (0.85) 1 1 test_sharing_azure-checkout-noop[2.41.1] 604.1121 (1.18) 604.1121 (1.18) 604.1121 (1.18) 0.0000 (1.0) 604.1121 (1.18) 0.0000 (1.0) 0;0 1.6553 (0.84) 1 1 test_sharing_azure-checkout-noop[2.41.1] 607.7901 (1.19) 607.7901 (1.19) 607.7901 (1.19) 0.0000 (1.0) 607.7901 (1.19) 0.0000 (1.0) 0;0 1.6453 (0.84) 1 1 test_sharing_azure-checkout-noop[main] 721.5029 (1.41) 721.5029 (1.41) 721.5029 (1.41) 0.0000 (1.0) 721.5029 (1.41) 0.0000 (1.0) 0;0 1.3860 (0.71) 1 1 test_sharing_azure-checkout-noop[main] 711.5705 (1.40) 711.5705 (1.40) 711.5705 (1.40) 0.0000 (1.0) 711.5705 (1.40) 0.0000 (1.0) 0;0 1.4053 (0.72) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull[2.11.0] 7.2955 (1.32) 7.2955 (1.32) 7.2955 (1.32) 0.0000 (1.0) 7.2955 (1.32) 0.0000 (1.0) 0;0 0.1371 (0.76) 1 1 test_sharing_azure-pull[2.11.0] 7.3017 (1.32) 7.3017 (1.32) 7.3017 (1.32) 0.0000 (1.0) 7.3017 (1.32) 0.0000 (1.0) 0;0 0.1370 (0.76) 1 1 test_sharing_azure-pull[2.39.0] 8.5831 (1.55) 8.5831 (1.55) 8.5831 (1.55) 0.0000 (1.0) 8.5831 (1.55) 0.0000 (1.0) 0;0 0.1165 (0.64) 1 1 test_sharing_azure-pull[2.39.0] 9.0472 (1.64) 9.0472 (1.64) 9.0472 (1.64) 0.0000 (1.0) 9.0472 (1.64) 0.0000 (1.0) 0;0 0.1105 (0.61) 1 1 test_sharing_azure-pull[2.40.0] 8.6736 (1.57) 8.6736 (1.57) 8.6736 (1.57) 0.0000 (1.0) 8.6736 (1.57) 0.0000 (1.0) 0;0 0.1153 (0.64) 1 1 test_sharing_azure-pull[2.40.0] 8.8510 (1.60) 8.8510 (1.60) 8.8510 (1.60) 0.0000 (1.0) 8.8510 (1.60) 0.0000 (1.0) 0;0 0.1130 (0.62) 1 1 test_sharing_azure-pull[2.41.1] 8.6606 (1.57) 8.6606 (1.57) 8.6606 (1.57) 0.0000 (1.0) 8.6606 (1.57) 0.0000 (1.0) 0;0 0.1155 (0.64) 1 1 test_sharing_azure-pull[2.41.1] 8.9741 (1.62) 8.9741 (1.62) 8.9741 (1.62) 0.0000 (1.0) 8.9741 (1.62) 0.0000 (1.0) 0;0 0.1114 (0.62) 1 1 test_sharing_azure-pull[main] 5.6675 (1.02) 5.6675 (1.02) 5.6675 (1.02) 0.0000 (1.0) 5.6675 (1.02) 0.0000 (1.0) 0;0 0.1764 (0.98) 1 1 test_sharing_azure-pull[main] 5.5317 (1.0) 5.5317 (1.0) 5.5317 (1.0) 0.0000 (1.0) 5.5317 (1.0) 0.0000 (1.0) 0;0 0.1808 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull-noop[2.11.0] 540.7229 (1.0) 540.7229 (1.0) 540.7229 (1.0) 0.0000 (1.0) 540.7229 (1.0) 0.0000 (1.0) 0;0 1.8494 (1.0) 1 1 test_sharing_azure-pull-noop[2.11.0] 558.3247 (1.03) 558.3247 (1.03) 558.3247 (1.03) 0.0000 (1.0) 558.3247 (1.03) 0.0000 (1.0) 0;0 1.7911 (0.97) 1 1 test_sharing_azure-pull-noop[2.39.0] 647.5891 (1.20) 647.5891 (1.20) 647.5891 (1.20) 0.0000 (1.0) 647.5891 (1.20) 0.0000 (1.0) 0;0 1.5442 (0.83) 1 1 test_sharing_azure-pull-noop[2.39.0] 644.8492 (1.19) 644.8492 (1.19) 644.8492 (1.19) 0.0000 (1.0) 644.8492 (1.19) 0.0000 (1.0) 0;0 1.5508 (0.84) 1 1 test_sharing_azure-pull-noop[2.40.0] 636.5374 (1.18) 636.5374 (1.18) 636.5374 (1.18) 0.0000 (1.0) 636.5374 (1.18) 0.0000 (1.0) 0;0 1.5710 (0.85) 1 1 test_sharing_azure-pull-noop[2.40.0] 639.1351 (1.18) 639.1351 (1.18) 639.1351 (1.18) 0.0000 (1.0) 639.1351 (1.18) 0.0000 (1.0) 0;0 1.5646 (0.85) 1 1 test_sharing_azure-pull-noop[2.41.1] 639.3710 (1.18) 639.3710 (1.18) 639.3710 (1.18) 0.0000 (1.0) 639.3710 (1.18) 0.0000 (1.0) 0;0 1.5640 (0.85) 1 1 test_sharing_azure-pull-noop[2.41.1] 646.0851 (1.19) 646.0851 (1.19) 646.0851 (1.19) 0.0000 (1.0) 646.0851 (1.19) 0.0000 (1.0) 0;0 1.5478 (0.84) 1 1 test_sharing_azure-pull-noop[main] 764.9238 (1.41) 764.9238 (1.41) 764.9238 (1.41) 0.0000 (1.0) 764.9238 (1.41) 0.0000 (1.0) 0;0 1.3073 (0.71) 1 1 test_sharing_azure-pull-noop[main] 761.4189 (1.41) 761.4189 (1.41) 761.4189 (1.41) 0.0000 (1.0) 761.4189 (1.41) 0.0000 (1.0) 0;0 1.3133 (0.71) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push[2.11.0] 4.0110 (1.09) 4.0110 (1.09) 4.0110 (1.09) 0.0000 (1.0) 4.0110 (1.09) 0.0000 (1.0) 0;0 0.2493 (0.92) 1 1 test_sharing_azure-push[2.11.0] 4.0679 (1.10) 4.0679 (1.10) 4.0679 (1.10) 0.0000 (1.0) 4.0679 (1.10) 0.0000 (1.0) 0;0 0.2458 (0.91) 1 1 test_sharing_azure-push[2.39.0] 5.1026 (1.38) 5.1026 (1.38) 5.1026 (1.38) 0.0000 (1.0) 5.1026 (1.38) 0.0000 (1.0) 0;0 0.1960 (0.72) 1 1 test_sharing_azure-push[2.39.0] 5.1058 (1.38) 5.1058 (1.38) 5.1058 (1.38) 0.0000 (1.0) 5.1058 (1.38) 0.0000 (1.0) 0;0 0.1959 (0.72) 1 1 test_sharing_azure-push[2.40.0] 5.1043 (1.38) 5.1043 (1.38) 5.1043 (1.38) 0.0000 (1.0) 5.1043 (1.38) 0.0000 (1.0) 0;0 0.1959 (0.72) 1 1 test_sharing_azure-push[2.40.0] 5.0607 (1.37) 5.0607 (1.37) 5.0607 (1.37) 0.0000 (1.0) 5.0607 (1.37) 0.0000 (1.0) 0;0 0.1976 (0.73) 1 1 test_sharing_azure-push[2.41.1] 5.0940 (1.38) 5.0940 (1.38) 5.0940 (1.38) 0.0000 (1.0) 5.0940 (1.38) 0.0000 (1.0) 0;0 0.1963 (0.72) 1 1 test_sharing_azure-push[2.41.1] 5.0551 (1.37) 5.0551 (1.37) 5.0551 (1.37) 0.0000 (1.0) 5.0551 (1.37) 0.0000 (1.0) 0;0 0.1978 (0.73) 1 1 test_sharing_azure-push[main] 3.6921 (1.0) 3.6921 (1.0) 3.6921 (1.0) 0.0000 (1.0) 3.6921 (1.0) 0.0000 (1.0) 0;0 0.2709 (1.0) 1 1 test_sharing_azure-push[main] 3.9968 (1.08) 3.9968 (1.08) 3.9968 (1.08) 0.0000 (1.0) 3.9968 (1.08) 0.0000 (1.0) 0;0 0.2502 (0.92) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push-noop[2.11.0] 462.9815 (1.0) 462.9815 (1.0) 462.9815 (1.0) 0.0000 (1.0) 462.9815 (1.0) 0.0000 (1.0) 0;0 2.1599 (1.0) 1 1 test_sharing_azure-push-noop[2.11.0] 463.2173 (1.00) 463.2173 (1.00) 463.2173 (1.00) 0.0000 (1.0) 463.2173 (1.00) 0.0000 (1.0) 0;0 2.1588 (1.00) 1 1 test_sharing_azure-push-noop[2.39.0] 492.5132 (1.06) 492.5132 (1.06) 492.5132 (1.06) 0.0000 (1.0) 492.5132 (1.06) 0.0000 (1.0) 0;0 2.0304 (0.94) 1 1 test_sharing_azure-push-noop[2.39.0] 489.1124 (1.06) 489.1124 (1.06) 489.1124 (1.06) 0.0000 (1.0) 489.1124 (1.06) 0.0000 (1.0) 0;0 2.0445 (0.95) 1 1 test_sharing_azure-push-noop[2.40.0] 496.8077 (1.07) 496.8077 (1.07) 496.8077 (1.07) 0.0000 (1.0) 496.8077 (1.07) 0.0000 (1.0) 0;0 2.0129 (0.93) 1 1 test_sharing_azure-push-noop[2.40.0] 502.2454 (1.08) 502.2454 (1.08) 502.2454 (1.08) 0.0000 (1.0) 502.2454 (1.08) 0.0000 (1.0) 0;0 1.9911 (0.92) 1 1 test_sharing_azure-push-noop[2.41.1] 498.7247 (1.08) 498.7247 (1.08) 498.7247 (1.08) 0.0000 (1.0) 498.7247 (1.08) 0.0000 (1.0) 0;0 2.0051 (0.93) 1 1 test_sharing_azure-push-noop[2.41.1] 498.2785 (1.08) 498.2785 (1.08) 498.2785 (1.08) 0.0000 (1.0) 498.2785 (1.08) 0.0000 (1.0) 0;0 2.0069 (0.93) 1 1 test_sharing_azure-push-noop[main] 653.3201 (1.41) 653.3201 (1.41) 653.3201 (1.41) 0.0000 (1.0) 653.3201 (1.41) 0.0000 (1.0) 0;0 1.5306 (0.71) 1 1 test_sharing_azure-push-noop[main] 584.7181 (1.26) 584.7181 (1.26) 584.7181 (1.26) 0.0000 (1.0) 584.7181 (1.26) 0.0000 (1.0) 0;0 1.7102 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.11.0] 2.7142 (1.80) 2.7142 (1.80) 2.7142 (1.80) 0.0000 (1.0) 2.7142 (1.80) 0.0000 (1.0) 0;0 0.3684 (0.56) 1 1 test_partial_remove-add[2.18.1] 2.2886 (1.52) 2.2886 (1.52) 2.2886 (1.52) 0.0000 (1.0) 2.2886 (1.52) 0.0000 (1.0) 0;0 0.4369 (0.66) 1 1 test_partial_remove-add[2.39.0] 1.7019 (1.13) 1.7019 (1.13) 1.7019 (1.13) 0.0000 (1.0) 1.7019 (1.13) 0.0000 (1.0) 0;0 0.5876 (0.89) 1 1 test_partial_remove-add[2.40.0] 1.6995 (1.13) 1.6995 (1.13) 1.6995 (1.13) 0.0000 (1.0) 1.6995 (1.13) 0.0000 (1.0) 0;0 0.5884 (0.89) 1 1 test_partial_remove-add[2.41.1] 1.7094 (1.13) 1.7094 (1.13) 1.7094 (1.13) 0.0000 (1.0) 1.7094 (1.13) 0.0000 (1.0) 0;0 0.5850 (0.88) 1 1 test_partial_remove-add[2.45.0] 1.7162 (1.14) 1.7162 (1.14) 1.7162 (1.14) 0.0000 (1.0) 1.7162 (1.14) 0.0000 (1.0) 0;0 0.5827 (0.88) 1 1 test_partial_remove-add[main] 1.5100 (1.0) 1.5100 (1.0) 1.5100 (1.0) 0.0000 (1.0) 1.5100 (1.0) 0.0000 (1.0) 0;0 0.6623 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.11.0] 422.4812 (1.0) 422.4812 (1.0) 422.4812 (1.0) 0.0000 (1.0) 422.4812 (1.0) 0.0000 (1.0) 0;0 2.3670 (1.0) 1 1 test_partial_remove-gc[2.18.1] 455.0517 (1.08) 455.0517 (1.08) 455.0517 (1.08) 0.0000 (1.0) 455.0517 (1.08) 0.0000 (1.0) 0;0 2.1976 (0.93) 1 1 test_partial_remove-gc[2.39.0] 481.5411 (1.14) 481.5411 (1.14) 481.5411 (1.14) 0.0000 (1.0) 481.5411 (1.14) 0.0000 (1.0) 0;0 2.0767 (0.88) 1 1 test_partial_remove-gc[2.40.0] 482.2170 (1.14) 482.2170 (1.14) 482.2170 (1.14) 0.0000 (1.0) 482.2170 (1.14) 0.0000 (1.0) 0;0 2.0738 (0.88) 1 1 test_partial_remove-gc[2.41.1] 483.9264 (1.15) 483.9264 (1.15) 483.9264 (1.15) 0.0000 (1.0) 483.9264 (1.15) 0.0000 (1.0) 0;0 2.0664 (0.87) 1 1 test_partial_remove-gc[2.45.0] 475.8487 (1.13) 475.8487 (1.13) 475.8487 (1.13) 0.0000 (1.0) 475.8487 (1.13) 0.0000 (1.0) 0;0 2.1015 (0.89) 1 1 test_partial_remove-gc[main] 555.1845 (1.31) 555.1845 (1.31) 555.1845 (1.31) 0.0000 (1.0) 555.1845 (1.31) 0.0000 (1.0) 0;0 1.8012 (0.76) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.11.0] 463.1025 (1.0) 463.1025 (1.0) 463.1025 (1.0) 0.0000 (1.0) 463.1025 (1.0) 0.0000 (1.0) 0;0 2.1593 (1.0) 1 1 test_partial_remove-gc-cloud[2.18.1] 493.8899 (1.07) 493.8899 (1.07) 493.8899 (1.07) 0.0000 (1.0) 493.8899 (1.07) 0.0000 (1.0) 0;0 2.0247 (0.94) 1 1 test_partial_remove-gc-cloud[2.39.0] 524.9165 (1.13) 524.9165 (1.13) 524.9165 (1.13) 0.0000 (1.0) 524.9165 (1.13) 0.0000 (1.0) 0;0 1.9051 (0.88) 1 1 test_partial_remove-gc-cloud[2.40.0] 517.9279 (1.12) 517.9279 (1.12) 517.9279 (1.12) 0.0000 (1.0) 517.9279 (1.12) 0.0000 (1.0) 0;0 1.9308 (0.89) 1 1 test_partial_remove-gc-cloud[2.41.1] 516.5763 (1.12) 516.5763 (1.12) 516.5763 (1.12) 0.0000 (1.0) 516.5763 (1.12) 0.0000 (1.0) 0;0 1.9358 (0.90) 1 1 test_partial_remove-gc-cloud[2.45.0] 509.6794 (1.10) 509.6794 (1.10) 509.6794 (1.10) 0.0000 (1.0) 509.6794 (1.10) 0.0000 (1.0) 0;0 1.9620 (0.91) 1 1 test_partial_remove-gc-cloud[main] 633.2543 (1.37) 633.2543 (1.37) 633.2543 (1.37) 0.0000 (1.0) 633.2543 (1.37) 0.0000 (1.0) 0;0 1.5791 (0.73) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.11.0] 421.0963 (1.0) 421.0963 (1.0) 421.0963 (1.0) 0.0000 (1.0) 421.0963 (1.0) 0.0000 (1.0) 0;0 2.3748 (1.0) 1 1 test_partial_remove-push[2.18.1] 434.0719 (1.03) 434.0719 (1.03) 434.0719 (1.03) 0.0000 (1.0) 434.0719 (1.03) 0.0000 (1.0) 0;0 2.3038 (0.97) 1 1 test_partial_remove-push[2.39.0] 464.4312 (1.10) 464.4312 (1.10) 464.4312 (1.10) 0.0000 (1.0) 464.4312 (1.10) 0.0000 (1.0) 0;0 2.1532 (0.91) 1 1 test_partial_remove-push[2.40.0] 466.4303 (1.11) 466.4303 (1.11) 466.4303 (1.11) 0.0000 (1.0) 466.4303 (1.11) 0.0000 (1.0) 0;0 2.1439 (0.90) 1 1 test_partial_remove-push[2.41.1] 463.4084 (1.10) 463.4084 (1.10) 463.4084 (1.10) 0.0000 (1.0) 463.4084 (1.10) 0.0000 (1.0) 0;0 2.1579 (0.91) 1 1 test_partial_remove-push[2.45.0] 468.8258 (1.11) 468.8258 (1.11) 468.8258 (1.11) 0.0000 (1.0) 468.8258 (1.11) 0.0000 (1.0) 0;0 2.1330 (0.90) 1 1 test_partial_remove-push[main] 581.1561 (1.38) 581.1561 (1.38) 581.1561 (1.38) 0.0000 (1.0) 581.1561 (1.38) 0.0000 (1.0) 0;0 1.7207 (0.72) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.39.0] 1.1443 (1.19) 1.1532 (1.19) 1.1501 (1.19) 0.0036 (1.05) 1.1503 (1.19) 0.0048 (1.21) 1;0 0.8695 (0.84) 5 3 test_plots-plots-diff[2.40.0] 1.1416 (1.19) 1.1507 (1.18) 1.1458 (1.19) 0.0040 (1.15) 1.1456 (1.19) 0.0072 (1.82) 2;0 0.8728 (0.84) 5 3 test_plots-plots-diff[2.41.1] 1.1120 (1.16) 1.1198 (1.15) 1.1159 (1.16) 0.0035 (1.0) 1.1156 (1.16) 0.0063 (1.60) 2;0 0.8961 (0.87) 5 3 test_plots-plots-diff[2.45.0] 1.0173 (1.06) 1.0470 (1.08) 1.0313 (1.07) 0.0124 (3.58) 1.0273 (1.06) 0.0205 (5.21) 2;0 0.9696 (0.94) 5 3 test_plots-plots-diff[main] 0.9621 (1.0) 0.9723 (1.0) 0.9656 (1.0) 0.0040 (1.15) 0.9651 (1.0) 0.0039 (1.0) 1;0 1.0356 (1.0) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.39.0] 2.0849 (1.64) 2.1250 (1.65) 2.1052 (1.65) 0.0143 (3.19) 2.1049 (1.65) 0.0136 (3.37) 2;0 0.4750 (0.61) 5 3 test_plots-plots-diff-json[2.40.0] 2.0773 (1.63) 2.0890 (1.63) 2.0821 (1.63) 0.0052 (1.15) 2.0802 (1.63) 0.0089 (2.20) 1;0 0.4803 (0.61) 5 3 test_plots-plots-diff-json[2.41.1] 2.0746 (1.63) 2.0855 (1.62) 2.0824 (1.63) 0.0045 (1.0) 2.0845 (1.64) 0.0040 (1.0) 1;1 0.4802 (0.61) 5 3 test_plots-plots-diff-json[2.45.0] 1.8396 (1.44) 1.8565 (1.44) 1.8496 (1.45) 0.0062 (1.38) 1.8510 (1.45) 0.0056 (1.39) 2;0 0.5407 (0.69) 5 3 test_plots-plots-diff-json[main] 1.2736 (1.0) 1.2849 (1.0) 1.2782 (1.0) 0.0053 (1.18) 1.2749 (1.0) 0.0089 (2.22) 1;0 0.7824 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show[2.39.0] 762.3280 (1.07) 768.6931 (1.06) 765.5856 (1.06) 2.8762 (1.0) 765.9310 (1.07) 5.3685 (2.09) 2;0 1.3062 (0.94) 5 3 test_plots-plots-show[2.40.0] 763.9018 (1.07) 775.0532 (1.07) 768.1588 (1.07) 4.3593 (1.52) 768.2577 (1.07) 5.5141 (2.15) 1;0 1.3018 (0.94) 5 3 test_plots-plots-show[2.41.1] 752.9884 (1.05) 761.9187 (1.05) 756.0793 (1.05) 3.7480 (1.30) 754.7600 (1.05) 5.5489 (2.16) 1;0 1.3226 (0.95) 5 3 test_plots-plots-show[2.45.0] 713.8984 (1.0) 723.8334 (1.0) 719.4683 (1.0) 3.9203 (1.36) 718.8628 (1.0) 5.7347 (2.23) 2;0 1.3899 (1.0) 5 3 test_plots-plots-show[main] 786.3006 (1.10) 793.9520 (1.10) 789.0730 (1.10) 2.8916 (1.01) 788.1253 (1.10) 2.5698 (1.0) 1;0 1.2673 (0.91) 5 3 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.39.0] 1.2839 (1.34) 1.2944 (1.31) 1.2889 (1.32) 0.0045 (1.39) 1.2906 (1.31) 0.0075 (1.87) 2;0 0.7758 (0.76) 5 3 test_plots-plots-show-json[2.40.0] 1.2641 (1.31) 1.2863 (1.30) 1.2735 (1.30) 0.0083 (2.55) 1.2734 (1.29) 0.0095 (2.37) 2;0 0.7853 (0.77) 5 3 test_plots-plots-show-json[2.41.1] 1.2637 (1.31) 1.2724 (1.28) 1.2676 (1.29) 0.0032 (1.0) 1.2676 (1.29) 0.0040 (1.0) 2;0 0.7889 (0.77) 5 3 test_plots-plots-show-json[2.45.0] 1.1767 (1.22) 1.1954 (1.21) 1.1822 (1.21) 0.0077 (2.37) 1.1805 (1.20) 0.0078 (1.97) 1;0 0.8459 (0.83) 5 3 test_plots-plots-show-json[main] 0.9615 (1.0) 0.9914 (1.0) 0.9798 (1.0) 0.0127 (3.92) 0.9852 (1.0) 0.0202 (5.07) 1;0 1.0207 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.18.1] 1.3379 (1.0) 1.3379 (1.0) 1.3379 (1.0) 0.0000 (1.0) 1.3379 (1.0) 0.0000 (1.0) 0;0 0.7474 (1.0) 1 1 test_data_status_all_flags-data-changed[2.39.0] 1.4042 (1.05) 1.4042 (1.05) 1.4042 (1.05) 0.0000 (1.0) 1.4042 (1.05) 0.0000 (1.0) 0;0 0.7121 (0.95) 1 1 test_data_status_all_flags-data-changed[2.40.0] 1.3926 (1.04) 1.3926 (1.04) 1.3926 (1.04) 0.0000 (1.0) 1.3926 (1.04) 0.0000 (1.0) 0;0 0.7181 (0.96) 1 1 test_data_status_all_flags-data-changed[2.41.1] 1.4682 (1.10) 1.4682 (1.10) 1.4682 (1.10) 0.0000 (1.0) 1.4682 (1.10) 0.0000 (1.0) 0;0 0.6811 (0.91) 1 1 test_data_status_all_flags-data-changed[2.45.0] 1.4331 (1.07) 1.4331 (1.07) 1.4331 (1.07) 0.0000 (1.0) 1.4331 (1.07) 0.0000 (1.0) 0;0 0.6978 (0.93) 1 1 test_data_status_all_flags-data-changed[main] 1.5224 (1.14) 1.5224 (1.14) 1.5224 (1.14) 0.0000 (1.0) 1.5224 (1.14) 0.0000 (1.0) 0;0 0.6568 (0.88) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.18.1] 1.3995 (1.03) 1.3995 (1.03) 1.3995 (1.03) 0.0000 (1.0) 1.3995 (1.03) 0.0000 (1.0) 0;0 0.7146 (0.97) 1 1 test_data_status_all_flags-data-changed-noop[2.39.0] 1.4449 (1.06) 1.4449 (1.06) 1.4449 (1.06) 0.0000 (1.0) 1.4449 (1.06) 0.0000 (1.0) 0;0 0.6921 (0.94) 1 1 test_data_status_all_flags-data-changed-noop[2.40.0] 1.6455 (1.21) 1.6455 (1.21) 1.6455 (1.21) 0.0000 (1.0) 1.6455 (1.21) 0.0000 (1.0) 0;0 0.6077 (0.83) 1 1 test_data_status_all_flags-data-changed-noop[2.41.1] 1.4158 (1.04) 1.4158 (1.04) 1.4158 (1.04) 0.0000 (1.0) 1.4158 (1.04) 0.0000 (1.0) 0;0 0.7063 (0.96) 1 1 test_data_status_all_flags-data-changed-noop[2.45.0] 1.3607 (1.0) 1.3607 (1.0) 1.3607 (1.0) 0.0000 (1.0) 1.3607 (1.0) 0.0000 (1.0) 0;0 0.7349 (1.0) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.4943 (1.10) 1.4943 (1.10) 1.4943 (1.10) 0.0000 (1.0) 1.4943 (1.10) 0.0000 (1.0) 0;0 0.6692 (0.91) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.18.1] 2.3751 (1.04) 2.3751 (1.04) 2.3751 (1.04) 0.0000 (1.0) 2.3751 (1.04) 0.0000 (1.0) 0;0 0.4210 (0.96) 1 1 test_data_status_all_flags-data-new[2.39.0] 2.3392 (1.02) 2.3392 (1.02) 2.3392 (1.02) 0.0000 (1.0) 2.3392 (1.02) 0.0000 (1.0) 0;0 0.4275 (0.98) 1 1 test_data_status_all_flags-data-new[2.40.0] 2.4381 (1.07) 2.4381 (1.07) 2.4381 (1.07) 0.0000 (1.0) 2.4381 (1.07) 0.0000 (1.0) 0;0 0.4102 (0.94) 1 1 test_data_status_all_flags-data-new[2.41.1] 2.4772 (1.09) 2.4772 (1.09) 2.4772 (1.09) 0.0000 (1.0) 2.4772 (1.09) 0.0000 (1.0) 0;0 0.4037 (0.92) 1 1 test_data_status_all_flags-data-new[2.45.0] 2.2825 (1.0) 2.2825 (1.0) 2.2825 (1.0) 0.0000 (1.0) 2.2825 (1.0) 0.0000 (1.0) 0;0 0.4381 (1.0) 1 1 test_data_status_all_flags-data-new[main] 2.3914 (1.05) 2.3914 (1.05) 2.3914 (1.05) 0.0000 (1.0) 2.3914 (1.05) 0.0000 (1.0) 0;0 0.4182 (0.95) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.18.1] 1.3065 (1.00) 1.3065 (1.00) 1.3065 (1.00) 0.0000 (1.0) 1.3065 (1.00) 0.0000 (1.0) 0;0 0.7654 (1.00) 1 1 test_data_status_all_flags-data-noop[2.39.0] 1.3029 (1.0) 1.3029 (1.0) 1.3029 (1.0) 0.0000 (1.0) 1.3029 (1.0) 0.0000 (1.0) 0;0 0.7675 (1.0) 1 1 test_data_status_all_flags-data-noop[2.40.0] 1.3368 (1.03) 1.3368 (1.03) 1.3368 (1.03) 0.0000 (1.0) 1.3368 (1.03) 0.0000 (1.0) 0;0 0.7481 (0.97) 1 1 test_data_status_all_flags-data-noop[2.41.1] 1.3326 (1.02) 1.3326 (1.02) 1.3326 (1.02) 0.0000 (1.0) 1.3326 (1.02) 0.0000 (1.0) 0;0 0.7504 (0.98) 1 1 test_data_status_all_flags-data-noop[2.45.0] 1.3854 (1.06) 1.3854 (1.06) 1.3854 (1.06) 0.0000 (1.0) 1.3854 (1.06) 0.0000 (1.0) 0;0 0.7218 (0.94) 1 1 test_data_status_all_flags-data-noop[main] 1.3858 (1.06) 1.3858 (1.06) 1.3858 (1.06) 0.0000 (1.0) 1.3858 (1.06) 0.0000 (1.0) 0;0 0.7216 (0.94) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.11.0] 3.5715 (1.12) 3.5715 (1.12) 3.5715 (1.12) 0.0000 (1.0) 3.5715 (1.12) 0.0000 (1.0) 0;0 0.2800 (0.89) 1 1 test_exp_show-exp[2.18.1] 3.6954 (1.16) 3.6954 (1.16) 3.6954 (1.16) 0.0000 (1.0) 3.6954 (1.16) 0.0000 (1.0) 0;0 0.2706 (0.86) 1 1 test_exp_show-exp[2.39.0] 3.3093 (1.04) 3.3093 (1.04) 3.3093 (1.04) 0.0000 (1.0) 3.3093 (1.04) 0.0000 (1.0) 0;0 0.3022 (0.96) 1 1 test_exp_show-exp[2.40.0] 3.1895 (1.0) 3.1895 (1.0) 3.1895 (1.0) 0.0000 (1.0) 3.1895 (1.0) 0.0000 (1.0) 0;0 0.3135 (1.0) 1 1 test_exp_show-exp[2.41.1] 3.2644 (1.02) 3.2644 (1.02) 3.2644 (1.02) 0.0000 (1.0) 3.2644 (1.02) 0.0000 (1.0) 0;0 0.3063 (0.98) 1 1 test_exp_show-exp[2.45.0] 3.4354 (1.08) 3.4354 (1.08) 3.4354 (1.08) 0.0000 (1.0) 3.4354 (1.08) 0.0000 (1.0) 0;0 0.2911 (0.93) 1 1 test_exp_show-exp[main] 4.0870 (1.28) 4.0870 (1.28) 4.0870 (1.28) 0.0000 (1.0) 4.0870 (1.28) 0.0000 (1.0) 0;0 0.2447 (0.78) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_add-add': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[2.11.0] 10.1319 (1.82) 10.1319 (1.82) 10.1319 (1.82) 0.0000 (1.0) 10.1319 (1.82) 0.0000 (1.0) 0;0 0.0987 (0.55) 1 1 test_add-add[2.18.1] 9.1647 (1.65) 9.1647 (1.65) 9.1647 (1.65) 0.0000 (1.0) 9.1647 (1.65) 0.0000 (1.0) 0;0 0.1091 (0.61) 1 1 test_add-add[2.39.0] 8.6787 (1.56) 8.6787 (1.56) 8.6787 (1.56) 0.0000 (1.0) 8.6787 (1.56) 0.0000 (1.0) 0;0 0.1152 (0.64) 1 1 test_add-add[2.40.0] 8.5712 (1.54) 8.5712 (1.54) 8.5712 (1.54) 0.0000 (1.0) 8.5712 (1.54) 0.0000 (1.0) 0;0 0.1167 (0.65) 1 1 test_add-add[2.41.1] 8.4287 (1.52) 8.4287 (1.52) 8.4287 (1.52) 0.0000 (1.0) 8.4287 (1.52) 0.0000 (1.0) 0;0 0.1186 (0.66) 1 1 test_add-add[2.45.0] 5.5539 (1.0) 5.5539 (1.0) 5.5539 (1.0) 0.0000 (1.0) 5.5539 (1.0) 0.0000 (1.0) 0;0 0.1801 (1.0) 1 1 test_add-add[main] 5.7428 (1.03) 5.7428 (1.03) 5.7428 (1.03) 0.0000 (1.0) 5.7428 (1.03) 0.0000 (1.0) 0;0 0.1741 (0.97) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 year ago 
github-actions[bot]
commented
1 year ago