Closed pmrowla closed 1 year ago
Sun May 7 05:33:52 UTC 2023 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.39.0] 1.4714 (1.17) 1.5264 (1.18) 1.4980 (1.17) 0.0244 (2.13) 1.5087 (1.18) 0.0414 (2.70) 3;0 0.6676 (0.85) 5 3 test_plots-plots-diff[2.40.0] 1.5287 (1.22) 1.5559 (1.21) 1.5401 (1.21) 0.0114 (1.0) 1.5360 (1.20) 0.0188 (1.22) 1;0 0.6493 (0.83) 5 3 test_plots-plots-diff[2.41.1] 1.4879 (1.19) 1.5748 (1.22) 1.5343 (1.20) 0.0396 (3.46) 1.5346 (1.20) 0.0744 (4.84) 2;0 0.6518 (0.83) 5 3 test_plots-plots-diff[2.45.0] 1.3526 (1.08) 1.4043 (1.09) 1.3768 (1.08) 0.0201 (1.75) 1.3818 (1.08) 0.0284 (1.85) 2;0 0.7263 (0.93) 5 3 test_plots-plots-diff[main] 1.2548 (1.0) 1.2886 (1.0) 1.2765 (1.0) 0.0132 (1.15) 1.2781 (1.0) 0.0154 (1.0) 1;0 0.7834 (1.0) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.39.0] 2.6684 (1.58) 2.7761 (1.57) 2.7257 (1.58) 0.0413 (1.63) 2.7324 (1.59) 0.0599 (1.27) 2;0 0.3669 (0.63) 5 3 test_plots-plots-diff-json[2.40.0] 2.6627 (1.57) 2.7426 (1.55) 2.7075 (1.57) 0.0332 (1.31) 2.7159 (1.58) 0.0551 (1.17) 2;0 0.3693 (0.64) 5 3 test_plots-plots-diff-json[2.41.1] 2.6612 (1.57) 2.7157 (1.54) 2.6876 (1.56) 0.0254 (1.0) 2.6899 (1.56) 0.0486 (1.03) 2;0 0.3721 (0.64) 5 3 test_plots-plots-diff-json[2.45.0] 2.4201 (1.43) 2.4772 (1.40) 2.4438 (1.42) 0.0268 (1.05) 2.4290 (1.41) 0.0470 (1.0) 1;0 0.4092 (0.71) 5 3 test_plots-plots-diff-json[main] 1.6923 (1.0) 1.7641 (1.0) 1.7261 (1.0) 0.0292 (1.15) 1.7218 (1.0) 0.0479 (1.02) 2;0 0.5793 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_plots-plots-show': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show[2.39.0] 1.0001 (1.03) 1.0560 (1.05) 1.0129 (1.02) 0.0243 (1.51) 1.0015 (1.01) 0.0189 (1.0) 1;1 0.9873 (0.98) 5 3 test_plots-plots-show[2.40.0] 1.0284 (1.06) 1.1078 (1.10) 1.0513 (1.06) 0.0330 (2.06) 1.0346 (1.05) 0.0353 (1.87) 1;0 0.9512 (0.94) 5 3 test_plots-plots-show[2.41.1] 0.9943 (1.02) 1.0860 (1.08) 1.0319 (1.04) 0.0351 (2.19) 1.0185 (1.03) 0.0442 (2.34) 2;0 0.9691 (0.96) 5 3 test_plots-plots-show[2.45.0] 0.9733 (1.0) 1.0099 (1.0) 0.9926 (1.0) 0.0160 (1.0) 0.9878 (1.0) 0.0278 (1.47) 2;0 1.0075 (1.0) 5 3 test_plots-plots-show[main] 1.0396 (1.07) 1.0895 (1.08) 1.0600 (1.07) 0.0219 (1.37) 1.0505 (1.06) 0.0373 (1.97) 1;0 0.9434 (0.94) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.39.0] 1.6290 (1.31) 1.6909 (1.22) 1.6578 (1.27) 0.0222 (1.51) 1.6583 (1.25) 0.0213 (1.36) 2;0 0.6032 (0.79) 5 3 test_plots-plots-show-json[2.40.0] 1.6340 (1.31) 1.7106 (1.24) 1.6701 (1.28) 0.0340 (2.31) 1.6798 (1.27) 0.0599 (3.82) 3;0 0.5988 (0.78) 5 3 test_plots-plots-show-json[2.41.1] 1.6409 (1.32) 1.6869 (1.22) 1.6630 (1.27) 0.0165 (1.12) 1.6642 (1.25) 0.0157 (1.0) 2;0 0.6013 (0.79) 5 3 test_plots-plots-show-json[2.45.0] 1.5310 (1.23) 1.5701 (1.14) 1.5499 (1.18) 0.0147 (1.0) 1.5470 (1.17) 0.0198 (1.26) 2;0 0.6452 (0.84) 5 3 test_plots-plots-show-json[main] 1.2448 (1.0) 1.3810 (1.0) 1.3082 (1.0) 0.0556 (3.78) 1.3263 (1.0) 0.0855 (5.45) 2;0 0.7644 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.18.1] 1.1390 (1.0) 1.1390 (1.0) 1.1390 (1.0) 0.0000 (1.0) 1.1390 (1.0) 0.0000 (1.0) 0;0 0.8780 (1.0) 1 1 test_data_status_all_flags-data-changed[2.39.0] 1.1753 (1.03) 1.1753 (1.03) 1.1753 (1.03) 0.0000 (1.0) 1.1753 (1.03) 0.0000 (1.0) 0;0 0.8508 (0.97) 1 1 test_data_status_all_flags-data-changed[2.40.0] 1.1715 (1.03) 1.1715 (1.03) 1.1715 (1.03) 0.0000 (1.0) 1.1715 (1.03) 0.0000 (1.0) 0;0 0.8536 (0.97) 1 1 test_data_status_all_flags-data-changed[2.41.1] 1.1772 (1.03) 1.1772 (1.03) 1.1772 (1.03) 0.0000 (1.0) 1.1772 (1.03) 0.0000 (1.0) 0;0 0.8495 (0.97) 1 1 test_data_status_all_flags-data-changed[2.45.0] 1.1794 (1.04) 1.1794 (1.04) 1.1794 (1.04) 0.0000 (1.0) 1.1794 (1.04) 0.0000 (1.0) 0;0 0.8479 (0.97) 1 1 test_data_status_all_flags-data-changed[main] 1.2024 (1.06) 1.2024 (1.06) 1.2024 (1.06) 0.0000 (1.0) 1.2024 (1.06) 0.0000 (1.0) 0;0 0.8317 (0.95) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.18.1] 1.1394 (1.0) 1.1394 (1.0) 1.1394 (1.0) 0.0000 (1.0) 1.1394 (1.0) 0.0000 (1.0) 0;0 0.8777 (1.0) 1 1 test_data_status_all_flags-data-changed-noop[2.39.0] 1.1774 (1.03) 1.1774 (1.03) 1.1774 (1.03) 0.0000 (1.0) 1.1774 (1.03) 0.0000 (1.0) 0;0 0.8493 (0.97) 1 1 test_data_status_all_flags-data-changed-noop[2.40.0] 1.1726 (1.03) 1.1726 (1.03) 1.1726 (1.03) 0.0000 (1.0) 1.1726 (1.03) 0.0000 (1.0) 0;0 0.8528 (0.97) 1 1 test_data_status_all_flags-data-changed-noop[2.41.1] 1.1705 (1.03) 1.1705 (1.03) 1.1705 (1.03) 0.0000 (1.0) 1.1705 (1.03) 0.0000 (1.0) 0;0 0.8543 (0.97) 1 1 test_data_status_all_flags-data-changed-noop[2.45.0] 1.1807 (1.04) 1.1807 (1.04) 1.1807 (1.04) 0.0000 (1.0) 1.1807 (1.04) 0.0000 (1.0) 0;0 0.8469 (0.96) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.2047 (1.06) 1.2047 (1.06) 1.2047 (1.06) 0.0000 (1.0) 1.2047 (1.06) 0.0000 (1.0) 0;0 0.8301 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.18.1] 1.8650 (1.01) 1.8650 (1.01) 1.8650 (1.01) 0.0000 (1.0) 1.8650 (1.01) 0.0000 (1.0) 0;0 0.5362 (0.99) 1 1 test_data_status_all_flags-data-new[2.39.0] 1.8815 (1.02) 1.8815 (1.02) 1.8815 (1.02) 0.0000 (1.0) 1.8815 (1.02) 0.0000 (1.0) 0;0 0.5315 (0.98) 1 1 test_data_status_all_flags-data-new[2.40.0] 1.8888 (1.02) 1.8888 (1.02) 1.8888 (1.02) 0.0000 (1.0) 1.8888 (1.02) 0.0000 (1.0) 0;0 0.5294 (0.98) 1 1 test_data_status_all_flags-data-new[2.41.1] 1.9530 (1.06) 1.9530 (1.06) 1.9530 (1.06) 0.0000 (1.0) 1.9530 (1.06) 0.0000 (1.0) 0;0 0.5120 (0.95) 1 1 test_data_status_all_flags-data-new[2.45.0] 1.8482 (1.0) 1.8482 (1.0) 1.8482 (1.0) 0.0000 (1.0) 1.8482 (1.0) 0.0000 (1.0) 0;0 0.5411 (1.0) 1 1 test_data_status_all_flags-data-new[main] 1.9080 (1.03) 1.9080 (1.03) 1.9080 (1.03) 0.0000 (1.0) 1.9080 (1.03) 0.0000 (1.0) 0;0 0.5241 (0.97) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.18.1] 1.1066 (1.0) 1.1066 (1.0) 1.1066 (1.0) 0.0000 (1.0) 1.1066 (1.0) 0.0000 (1.0) 0;0 0.9037 (1.0) 1 1 test_data_status_all_flags-data-noop[2.39.0] 1.1213 (1.01) 1.1213 (1.01) 1.1213 (1.01) 0.0000 (1.0) 1.1213 (1.01) 0.0000 (1.0) 0;0 0.8918 (0.99) 1 1 test_data_status_all_flags-data-noop[2.40.0] 1.1184 (1.01) 1.1184 (1.01) 1.1184 (1.01) 0.0000 (1.0) 1.1184 (1.01) 0.0000 (1.0) 0;0 0.8941 (0.99) 1 1 test_data_status_all_flags-data-noop[2.41.1] 1.1236 (1.02) 1.1236 (1.02) 1.1236 (1.02) 0.0000 (1.0) 1.1236 (1.02) 0.0000 (1.0) 0;0 0.8900 (0.98) 1 1 test_data_status_all_flags-data-noop[2.45.0] 1.4481 (1.31) 1.4481 (1.31) 1.4481 (1.31) 0.0000 (1.0) 1.4481 (1.31) 0.0000 (1.0) 0;0 0.6906 (0.76) 1 1 test_data_status_all_flags-data-noop[main] 1.1786 (1.07) 1.1786 (1.07) 1.1786 (1.07) 0.0000 (1.0) 1.1786 (1.07) 0.0000 (1.0) 0;0 0.8484 (0.94) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.11.0] 8.6872 (1.85) 8.6872 (1.85) 8.6872 (1.85) 0.0000 (1.0) 8.6872 (1.85) 0.0000 (1.0) 0;0 0.1151 (0.54) 1 1 test_sharing-add[2.18.1] 7.6144 (1.62) 7.6144 (1.62) 7.6144 (1.62) 0.0000 (1.0) 7.6144 (1.62) 0.0000 (1.0) 0;0 0.1313 (0.62) 1 1 test_sharing-add[2.39.0] 6.9542 (1.48) 6.9542 (1.48) 6.9542 (1.48) 0.0000 (1.0) 6.9542 (1.48) 0.0000 (1.0) 0;0 0.1438 (0.68) 1 1 test_sharing-add[2.40.0] 6.9429 (1.48) 6.9429 (1.48) 6.9429 (1.48) 0.0000 (1.0) 6.9429 (1.48) 0.0000 (1.0) 0;0 0.1440 (0.68) 1 1 test_sharing-add[2.41.1] 7.0412 (1.50) 7.0412 (1.50) 7.0412 (1.50) 0.0000 (1.0) 7.0412 (1.50) 0.0000 (1.0) 0;0 0.1420 (0.67) 1 1 test_sharing-add[2.45.0] 4.7021 (1.0) 4.7021 (1.0) 4.7021 (1.0) 0.0000 (1.0) 4.7021 (1.0) 0.0000 (1.0) 0;0 0.2127 (1.0) 1 1 test_sharing-add[main] 4.8086 (1.02) 4.8086 (1.02) 4.8086 (1.02) 0.0000 (1.0) 4.8086 (1.02) 0.0000 (1.0) 0;0 0.2080 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.11.0] 4.0771 (1.40) 4.0771 (1.40) 4.0771 (1.40) 0.0000 (1.0) 4.0771 (1.40) 0.0000 (1.0) 0;0 0.2453 (0.71) 1 1 test_sharing-add-noop[2.18.1] 4.3122 (1.48) 4.3122 (1.48) 4.3122 (1.48) 0.0000 (1.0) 4.3122 (1.48) 0.0000 (1.0) 0;0 0.2319 (0.67) 1 1 test_sharing-add-noop[2.39.0] 2.9657 (1.02) 2.9657 (1.02) 2.9657 (1.02) 0.0000 (1.0) 2.9657 (1.02) 0.0000 (1.0) 0;0 0.3372 (0.98) 1 1 test_sharing-add-noop[2.40.0] 3.0033 (1.03) 3.0033 (1.03) 3.0033 (1.03) 0.0000 (1.0) 3.0033 (1.03) 0.0000 (1.0) 0;0 0.3330 (0.97) 1 1 test_sharing-add-noop[2.41.1] 2.9102 (1.0) 2.9102 (1.0) 2.9102 (1.0) 0.0000 (1.0) 2.9102 (1.0) 0.0000 (1.0) 0;0 0.3436 (1.0) 1 1 test_sharing-add-noop[2.45.0] 3.1304 (1.08) 3.1304 (1.08) 3.1304 (1.08) 0.0000 (1.0) 3.1304 (1.08) 0.0000 (1.0) 0;0 0.3195 (0.93) 1 1 test_sharing-add-noop[main] 3.2278 (1.11) 3.2278 (1.11) 3.2278 (1.11) 0.0000 (1.0) 3.2278 (1.11) 0.0000 (1.0) 0;0 0.3098 (0.90) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.11.0] 646.7282 (1.0) 646.7282 (1.0) 646.7282 (1.0) 0.0000 (1.0) 646.7282 (1.0) 0.0000 (1.0) 0;0 1.5462 (1.0) 1 1 test_sharing-checkout-noop[2.18.1] 652.4817 (1.01) 652.4817 (1.01) 652.4817 (1.01) 0.0000 (1.0) 652.4817 (1.01) 0.0000 (1.0) 0;0 1.5326 (0.99) 1 1 test_sharing-checkout-noop[2.39.0] 717.6197 (1.11) 717.6197 (1.11) 717.6197 (1.11) 0.0000 (1.0) 717.6197 (1.11) 0.0000 (1.0) 0;0 1.3935 (0.90) 1 1 test_sharing-checkout-noop[2.40.0] 708.1793 (1.10) 708.1793 (1.10) 708.1793 (1.10) 0.0000 (1.0) 708.1793 (1.10) 0.0000 (1.0) 0;0 1.4121 (0.91) 1 1 test_sharing-checkout-noop[2.41.1] 701.6915 (1.08) 701.6915 (1.08) 701.6915 (1.08) 0.0000 (1.0) 701.6915 (1.08) 0.0000 (1.0) 0;0 1.4251 (0.92) 1 1 test_sharing-checkout-noop[2.45.0] 733.2542 (1.13) 733.2542 (1.13) 733.2542 (1.13) 0.0000 (1.0) 733.2542 (1.13) 0.0000 (1.0) 0;0 1.3638 (0.88) 1 1 test_sharing-checkout-noop[main] 786.7432 (1.22) 786.7432 (1.22) 786.7432 (1.22) 0.0000 (1.0) 786.7432 (1.22) 0.0000 (1.0) 0;0 1.2711 (0.82) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing-pull': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[2.11.0] 8.5523 (1.06) 8.5523 (1.06) 8.5523 (1.06) 0.0000 (1.0) 8.5523 (1.06) 0.0000 (1.0) 0;0 0.1169 (0.95) 1 1 test_sharing-pull[2.18.1] 8.5040 (1.05) 8.5040 (1.05) 8.5040 (1.05) 0.0000 (1.0) 8.5040 (1.05) 0.0000 (1.0) 0;0 0.1176 (0.95) 1 1 test_sharing-pull[2.39.0] 10.1451 (1.25) 10.1451 (1.25) 10.1451 (1.25) 0.0000 (1.0) 10.1451 (1.25) 0.0000 (1.0) 0;0 0.0986 (0.80) 1 1 test_sharing-pull[2.40.0] 10.1716 (1.26) 10.1716 (1.26) 10.1716 (1.26) 0.0000 (1.0) 10.1716 (1.26) 0.0000 (1.0) 0;0 0.0983 (0.80) 1 1 test_sharing-pull[2.41.1] 10.1498 (1.25) 10.1498 (1.25) 10.1498 (1.25) 0.0000 (1.0) 10.1498 (1.25) 0.0000 (1.0) 0;0 0.0985 (0.80) 1 1 test_sharing-pull[2.45.0] 8.0965 (1.0) 8.0965 (1.0) 8.0965 (1.0) 0.0000 (1.0) 8.0965 (1.0) 0.0000 (1.0) 0;0 0.1235 (1.0) 1 1 test_sharing-pull[main] 8.1292 (1.00) 8.1292 (1.00) 8.1292 (1.00) 0.0000 (1.0) 8.1292 (1.00) 0.0000 (1.0) 0;0 0.1230 (1.00) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[2.11.0] 632.8628 (1.0) 632.8628 (1.0) 632.8628 (1.0) 0.0000 (1.0) 632.8628 (1.0) 0.0000 (1.0) 0;0 1.5801 (1.0) 1 1 test_sharing-pull-noop[2.18.1] 701.7673 (1.11) 701.7673 (1.11) 701.7673 (1.11) 0.0000 (1.0) 701.7673 (1.11) 0.0000 (1.0) 0;0 1.4250 (0.90) 1 1 test_sharing-pull-noop[2.39.0] 739.2535 (1.17) 739.2535 (1.17) 739.2535 (1.17) 0.0000 (1.0) 739.2535 (1.17) 0.0000 (1.0) 0;0 1.3527 (0.86) 1 1 test_sharing-pull-noop[2.40.0] 742.1127 (1.17) 742.1127 (1.17) 742.1127 (1.17) 0.0000 (1.0) 742.1127 (1.17) 0.0000 (1.0) 0;0 1.3475 (0.85) 1 1 test_sharing-pull-noop[2.41.1] 732.3776 (1.16) 732.3776 (1.16) 732.3776 (1.16) 0.0000 (1.0) 732.3776 (1.16) 0.0000 (1.0) 0;0 1.3654 (0.86) 1 1 test_sharing-pull-noop[2.45.0] 790.0130 (1.25) 790.0130 (1.25) 790.0130 (1.25) 0.0000 (1.0) 790.0130 (1.25) 0.0000 (1.0) 0;0 1.2658 (0.80) 1 1 test_sharing-pull-noop[main] 844.9134 (1.34) 844.9134 (1.34) 844.9134 (1.34) 0.0000 (1.0) 844.9134 (1.34) 0.0000 (1.0) 0;0 1.1836 (0.75) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.11.0] 4.7072 (1.15) 4.7072 (1.15) 4.7072 (1.15) 0.0000 (1.0) 4.7072 (1.15) 0.0000 (1.0) 0;0 0.2124 (0.87) 1 1 test_sharing-push[2.18.1] 4.6385 (1.13) 4.6385 (1.13) 4.6385 (1.13) 0.0000 (1.0) 4.6385 (1.13) 0.0000 (1.0) 0;0 0.2156 (0.89) 1 1 test_sharing-push[2.39.0] 5.9634 (1.45) 5.9634 (1.45) 5.9634 (1.45) 0.0000 (1.0) 5.9634 (1.45) 0.0000 (1.0) 0;0 0.1677 (0.69) 1 1 test_sharing-push[2.40.0] 6.0508 (1.47) 6.0508 (1.47) 6.0508 (1.47) 0.0000 (1.0) 6.0508 (1.47) 0.0000 (1.0) 0;0 0.1653 (0.68) 1 1 test_sharing-push[2.41.1] 6.0171 (1.47) 6.0171 (1.47) 6.0171 (1.47) 0.0000 (1.0) 6.0171 (1.47) 0.0000 (1.0) 0;0 0.1662 (0.68) 1 1 test_sharing-push[2.45.0] 4.1083 (1.00) 4.1083 (1.00) 4.1083 (1.00) 0.0000 (1.0) 4.1083 (1.00) 0.0000 (1.0) 0;0 0.2434 (1.00) 1 1 test_sharing-push[main] 4.1056 (1.0) 4.1056 (1.0) 4.1056 (1.0) 0.0000 (1.0) 4.1056 (1.0) 0.0000 (1.0) 0;0 0.2436 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.11.0] 542.8276 (1.04) 542.8276 (1.04) 542.8276 (1.04) 0.0000 (1.0) 542.8276 (1.04) 0.0000 (1.0) 0;0 1.8422 (0.96) 1 1 test_sharing-push-noop[2.18.1] 522.8560 (1.0) 522.8560 (1.0) 522.8560 (1.0) 0.0000 (1.0) 522.8560 (1.0) 0.0000 (1.0) 0;0 1.9126 (1.0) 1 1 test_sharing-push-noop[2.39.0] 564.6021 (1.08) 564.6021 (1.08) 564.6021 (1.08) 0.0000 (1.0) 564.6021 (1.08) 0.0000 (1.0) 0;0 1.7712 (0.93) 1 1 test_sharing-push-noop[2.40.0] 571.6461 (1.09) 571.6461 (1.09) 571.6461 (1.09) 0.0000 (1.0) 571.6461 (1.09) 0.0000 (1.0) 0;0 1.7493 (0.91) 1 1 test_sharing-push-noop[2.41.1] 575.1694 (1.10) 575.1694 (1.10) 575.1694 (1.10) 0.0000 (1.0) 575.1694 (1.10) 0.0000 (1.0) 0;0 1.7386 (0.91) 1 1 test_sharing-push-noop[2.45.0] 577.6339 (1.10) 577.6339 (1.10) 577.6339 (1.10) 0.0000 (1.0) 577.6339 (1.10) 0.0000 (1.0) 0;0 1.7312 (0.91) 1 1 test_sharing-push-noop[main] 667.0174 (1.28) 667.0174 (1.28) 667.0174 (1.28) 0.0000 (1.0) 667.0174 (1.28) 0.0000 (1.0) 0;0 1.4992 (0.78) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.11.0] 5.2511 (1.39) 5.2511 (1.39) 5.2511 (1.39) 0.0000 (1.0) 5.2511 (1.39) 0.0000 (1.0) 0;0 0.1904 (0.72) 1 1 test_get-get[2.18.1] 4.8404 (1.28) 4.8404 (1.28) 4.8404 (1.28) 0.0000 (1.0) 4.8404 (1.28) 0.0000 (1.0) 0;0 0.2066 (0.78) 1 1 test_get-get[2.39.0] 3.9479 (1.04) 3.9479 (1.04) 3.9479 (1.04) 0.0000 (1.0) 3.9479 (1.04) 0.0000 (1.0) 0;0 0.2533 (0.96) 1 1 test_get-get[2.40.0] 3.9222 (1.04) 3.9222 (1.04) 3.9222 (1.04) 0.0000 (1.0) 3.9222 (1.04) 0.0000 (1.0) 0;0 0.2550 (0.96) 1 1 test_get-get[2.41.1] 3.7785 (1.0) 3.7785 (1.0) 3.7785 (1.0) 0.0000 (1.0) 3.7785 (1.0) 0.0000 (1.0) 0;0 0.2647 (1.0) 1 1 test_get-get[2.45.0] 3.9468 (1.04) 3.9468 (1.04) 3.9468 (1.04) 0.0000 (1.0) 3.9468 (1.04) 0.0000 (1.0) 0;0 0.2534 (0.96) 1 1 test_get-get[main] 5.1380 (1.36) 5.1380 (1.36) 5.1380 (1.36) 0.0000 (1.0) 5.1380 (1.36) 0.0000 (1.0) 0;0 0.1946 (0.74) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.11.0] 1.8451 (1.04) 1.8451 (1.04) 1.8451 (1.04) 0.0000 (1.0) 1.8451 (1.04) 0.0000 (1.0) 0;0 0.5420 (0.96) 1 1 test_checkout_symlink-checkout[2.18.1] 1.7682 (1.0) 1.7682 (1.0) 1.7682 (1.0) 0.0000 (1.0) 1.7682 (1.0) 0.0000 (1.0) 0;0 0.5655 (1.0) 1 1 test_checkout_symlink-checkout[2.39.0] 1.7892 (1.01) 1.7892 (1.01) 1.7892 (1.01) 0.0000 (1.0) 1.7892 (1.01) 0.0000 (1.0) 0;0 0.5589 (0.99) 1 1 test_checkout_symlink-checkout[2.40.0] 1.9728 (1.12) 1.9728 (1.12) 1.9728 (1.12) 0.0000 (1.0) 1.9728 (1.12) 0.0000 (1.0) 0;0 0.5069 (0.90) 1 1 test_checkout_symlink-checkout[2.41.1] 1.9356 (1.09) 1.9356 (1.09) 1.9356 (1.09) 0.0000 (1.0) 1.9356 (1.09) 0.0000 (1.0) 0;0 0.5166 (0.91) 1 1 test_checkout_symlink-checkout[2.45.0] 2.3365 (1.32) 2.3365 (1.32) 2.3365 (1.32) 0.0000 (1.0) 2.3365 (1.32) 0.0000 (1.0) 0;0 0.4280 (0.76) 1 1 test_checkout_symlink-checkout[main] 2.3178 (1.31) 2.3178 (1.31) 2.3178 (1.31) 0.0000 (1.0) 2.3178 (1.31) 0.0000 (1.0) 0;0 0.4314 (0.76) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.11.0] 655.1610 (1.0) 655.1610 (1.0) 655.1610 (1.0) 0.0000 (1.0) 655.1610 (1.0) 0.0000 (1.0) 0;0 1.5263 (1.0) 1 1 test_checkout_symlink-checkout-noop[2.18.1] 738.1680 (1.13) 738.1680 (1.13) 738.1680 (1.13) 0.0000 (1.0) 738.1680 (1.13) 0.0000 (1.0) 0;0 1.3547 (0.89) 1 1 test_checkout_symlink-checkout-noop[2.39.0] 833.9592 (1.27) 833.9592 (1.27) 833.9592 (1.27) 0.0000 (1.0) 833.9592 (1.27) 0.0000 (1.0) 0;0 1.1991 (0.79) 1 1 test_checkout_symlink-checkout-noop[2.40.0] 840.7808 (1.28) 840.7808 (1.28) 840.7808 (1.28) 0.0000 (1.0) 840.7808 (1.28) 0.0000 (1.0) 0;0 1.1894 (0.78) 1 1 test_checkout_symlink-checkout-noop[2.41.1] 829.0187 (1.27) 829.0187 (1.27) 829.0187 (1.27) 0.0000 (1.0) 829.0187 (1.27) 0.0000 (1.0) 0;0 1.2062 (0.79) 1 1 test_checkout_symlink-checkout-noop[2.45.0] 902.0212 (1.38) 902.0212 (1.38) 902.0212 (1.38) 0.0000 (1.0) 902.0212 (1.38) 0.0000 (1.0) 0;0 1.1086 (0.73) 1 1 test_checkout_symlink-checkout-noop[main] 989.7499 (1.51) 989.7499 (1.51) 989.7499 (1.51) 0.0000 (1.0) 989.7499 (1.51) 0.0000 (1.0) 0;0 1.0104 (0.66) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-update[2.11.0] 1.8360 (2.02) 1.8360 (2.02) 1.8360 (2.02) 0.0000 (1.0) 1.8360 (2.02) 0.0000 (1.0) 0;0 0.5447 (0.49) 1 1 test_checkout_symlink-checkout-update[2.18.1] 0.9077 (1.0) 0.9077 (1.0) 0.9077 (1.0) 0.0000 (1.0) 0.9077 (1.0) 0.0000 (1.0) 0;0 1.1017 (1.0) 1 1 test_checkout_symlink-checkout-update[2.39.0] 0.9966 (1.10) 0.9966 (1.10) 0.9966 (1.10) 0.0000 (1.0) 0.9966 (1.10) 0.0000 (1.0) 0;0 1.0034 (0.91) 1 1 test_checkout_symlink-checkout-update[2.40.0] 1.0098 (1.11) 1.0098 (1.11) 1.0098 (1.11) 0.0000 (1.0) 1.0098 (1.11) 0.0000 (1.0) 0;0 0.9903 (0.90) 1 1 test_checkout_symlink-checkout-update[2.41.1] 0.9340 (1.03) 0.9340 (1.03) 0.9340 (1.03) 0.0000 (1.0) 0.9340 (1.03) 0.0000 (1.0) 0;0 1.0706 (0.97) 1 1 test_checkout_symlink-checkout-update[2.45.0] 1.0331 (1.14) 1.0331 (1.14) 1.0331 (1.14) 0.0000 (1.0) 1.0331 (1.14) 0.0000 (1.0) 0;0 0.9679 (0.88) 1 1 test_checkout_symlink-checkout-update[main] 1.1360 (1.25) 1.1360 (1.25) 1.1360 (1.25) 0.0000 (1.0) 1.1360 (1.25) 0.0000 (1.0) 0;0 0.8803 (0.80) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.11.0] 423.4852 (1.0) 423.4852 (1.0) 423.4852 (1.0) 0.0000 (1.0) 423.4852 (1.0) 0.0000 (1.0) 0;0 2.3614 (1.0) 1 1 test_gc-gc[2.18.1] 443.5839 (1.05) 443.5839 (1.05) 443.5839 (1.05) 0.0000 (1.0) 443.5839 (1.05) 0.0000 (1.0) 0;0 2.2544 (0.95) 1 1 test_gc-gc[2.39.0] 487.8468 (1.15) 487.8468 (1.15) 487.8468 (1.15) 0.0000 (1.0) 487.8468 (1.15) 0.0000 (1.0) 0;0 2.0498 (0.87) 1 1 test_gc-gc[2.40.0] 503.7153 (1.19) 503.7153 (1.19) 503.7153 (1.19) 0.0000 (1.0) 503.7153 (1.19) 0.0000 (1.0) 0;0 1.9852 (0.84) 1 1 test_gc-gc[2.41.1] 486.0892 (1.15) 486.0892 (1.15) 486.0892 (1.15) 0.0000 (1.0) 486.0892 (1.15) 0.0000 (1.0) 0;0 2.0572 (0.87) 1 1 test_gc-gc[2.45.0] 494.9392 (1.17) 494.9392 (1.17) 494.9392 (1.17) 0.0000 (1.0) 494.9392 (1.17) 0.0000 (1.0) 0;0 2.0205 (0.86) 1 1 test_gc-gc[main] 528.9798 (1.25) 528.9798 (1.25) 528.9798 (1.25) 0.0000 (1.0) 528.9798 (1.25) 0.0000 (1.0) 0;0 1.8904 (0.80) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.11.0] 2.6810 (1.0) 2.6810 (1.0) 2.6810 (1.0) 0.0000 (1.0) 2.6810 (1.0) 0.0000 (1.0) 0;0 0.3730 (1.0) 1 1 test_get_url-get-url[2.18.1] 2.7361 (1.02) 2.7361 (1.02) 2.7361 (1.02) 0.0000 (1.0) 2.7361 (1.02) 0.0000 (1.0) 0;0 0.3655 (0.98) 1 1 test_get_url-get-url[2.39.0] 2.7392 (1.02) 2.7392 (1.02) 2.7392 (1.02) 0.0000 (1.0) 2.7392 (1.02) 0.0000 (1.0) 0;0 0.3651 (0.98) 1 1 test_get_url-get-url[2.40.0] 2.8285 (1.06) 2.8285 (1.06) 2.8285 (1.06) 0.0000 (1.0) 2.8285 (1.06) 0.0000 (1.0) 0;0 0.3535 (0.95) 1 1 test_get_url-get-url[2.41.1] 2.7273 (1.02) 2.7273 (1.02) 2.7273 (1.02) 0.0000 (1.0) 2.7273 (1.02) 0.0000 (1.0) 0;0 0.3667 (0.98) 1 1 test_get_url-get-url[2.45.0] 2.7351 (1.02) 2.7351 (1.02) 2.7351 (1.02) 0.0000 (1.0) 2.7351 (1.02) 0.0000 (1.0) 0;0 0.3656 (0.98) 1 1 test_get_url-get-url[main] 2.8284 (1.05) 2.8284 (1.05) 2.8284 (1.05) 0.0000 (1.0) 2.8284 (1.05) 0.0000 (1.0) 0;0 0.3536 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.11.0] 6.9119 (1.99) 6.9119 (1.99) 6.9119 (1.99) 0.0000 (1.0) 6.9119 (1.99) 0.0000 (1.0) 0;0 0.1447 (0.50) 1 1 test_sharing_s3-add[2.18.1] 5.7999 (1.67) 5.7999 (1.67) 5.7999 (1.67) 0.0000 (1.0) 5.7999 (1.67) 0.0000 (1.0) 0;0 0.1724 (0.60) 1 1 test_sharing_s3-add[2.39.0] 5.3601 (1.55) 5.3601 (1.55) 5.3601 (1.55) 0.0000 (1.0) 5.3601 (1.55) 0.0000 (1.0) 0;0 0.1866 (0.65) 1 1 test_sharing_s3-add[2.40.0] 5.4209 (1.56) 5.4209 (1.56) 5.4209 (1.56) 0.0000 (1.0) 5.4209 (1.56) 0.0000 (1.0) 0;0 0.1845 (0.64) 1 1 test_sharing_s3-add[2.41.1] 5.3550 (1.54) 5.3550 (1.54) 5.3550 (1.54) 0.0000 (1.0) 5.3550 (1.54) 0.0000 (1.0) 0;0 0.1867 (0.65) 1 1 test_sharing_s3-add[2.45.0] 3.4689 (1.0) 3.4689 (1.0) 3.4689 (1.0) 0.0000 (1.0) 3.4689 (1.0) 0.0000 (1.0) 0;0 0.2883 (1.0) 1 1 test_sharing_s3-add[main] 3.8556 (1.11) 3.8556 (1.11) 3.8556 (1.11) 0.0000 (1.0) 3.8556 (1.11) 0.0000 (1.0) 0;0 0.2594 (0.90) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.11.0] 3.1479 (1.44) 3.1479 (1.44) 3.1479 (1.44) 0.0000 (1.0) 3.1479 (1.44) 0.0000 (1.0) 0;0 0.3177 (0.69) 1 1 test_sharing_s3-add-noop[2.18.1] 3.3129 (1.52) 3.3129 (1.52) 3.3129 (1.52) 0.0000 (1.0) 3.3129 (1.52) 0.0000 (1.0) 0;0 0.3019 (0.66) 1 1 test_sharing_s3-add-noop[2.39.0] 2.2081 (1.01) 2.2081 (1.01) 2.2081 (1.01) 0.0000 (1.0) 2.2081 (1.01) 0.0000 (1.0) 0;0 0.4529 (0.99) 1 1 test_sharing_s3-add-noop[2.40.0] 2.1846 (1.0) 2.1846 (1.0) 2.1846 (1.0) 0.0000 (1.0) 2.1846 (1.0) 0.0000 (1.0) 0;0 0.4577 (1.0) 1 1 test_sharing_s3-add-noop[2.41.1] 2.1974 (1.01) 2.1974 (1.01) 2.1974 (1.01) 0.0000 (1.0) 2.1974 (1.01) 0.0000 (1.0) 0;0 0.4551 (0.99) 1 1 test_sharing_s3-add-noop[2.45.0] 2.3129 (1.06) 2.3129 (1.06) 2.3129 (1.06) 0.0000 (1.0) 2.3129 (1.06) 0.0000 (1.0) 0;0 0.4324 (0.94) 1 1 test_sharing_s3-add-noop[main] 2.2958 (1.05) 2.2958 (1.05) 2.2958 (1.05) 0.0000 (1.0) 2.2958 (1.05) 0.0000 (1.0) 0;0 0.4356 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.11.0] 477.5663 (1.0) 477.5663 (1.0) 477.5663 (1.0) 0.0000 (1.0) 477.5663 (1.0) 0.0000 (1.0) 0;0 2.0939 (1.0) 1 1 test_sharing_s3-checkout-noop[2.18.1] 534.7163 (1.12) 534.7163 (1.12) 534.7163 (1.12) 0.0000 (1.0) 534.7163 (1.12) 0.0000 (1.0) 0;0 1.8702 (0.89) 1 1 test_sharing_s3-checkout-noop[2.39.0] 559.3909 (1.17) 559.3909 (1.17) 559.3909 (1.17) 0.0000 (1.0) 559.3909 (1.17) 0.0000 (1.0) 0;0 1.7877 (0.85) 1 1 test_sharing_s3-checkout-noop[2.40.0] 558.7925 (1.17) 558.7925 (1.17) 558.7925 (1.17) 0.0000 (1.0) 558.7925 (1.17) 0.0000 (1.0) 0;0 1.7896 (0.85) 1 1 test_sharing_s3-checkout-noop[2.41.1] 554.9996 (1.16) 554.9996 (1.16) 554.9996 (1.16) 0.0000 (1.0) 554.9996 (1.16) 0.0000 (1.0) 0;0 1.8018 (0.86) 1 1 test_sharing_s3-checkout-noop[2.45.0] 623.2838 (1.31) 623.2838 (1.31) 623.2838 (1.31) 0.0000 (1.0) 623.2838 (1.31) 0.0000 (1.0) 0;0 1.6044 (0.77) 1 1 test_sharing_s3-checkout-noop[main] 645.3331 (1.35) 645.3331 (1.35) 645.3331 (1.35) 0.0000 (1.0) 645.3331 (1.35) 0.0000 (1.0) 0;0 1.5496 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.11.0] 14.0787 (1.15) 14.0787 (1.15) 14.0787 (1.15) 0.0000 (1.0) 14.0787 (1.15) 0.0000 (1.0) 0;0 0.0710 (0.87) 1 1 test_sharing_s3-pull[2.18.1] 14.1165 (1.15) 14.1165 (1.15) 14.1165 (1.15) 0.0000 (1.0) 14.1165 (1.15) 0.0000 (1.0) 0;0 0.0708 (0.87) 1 1 test_sharing_s3-pull[2.39.0] 14.2184 (1.16) 14.2184 (1.16) 14.2184 (1.16) 0.0000 (1.0) 14.2184 (1.16) 0.0000 (1.0) 0;0 0.0703 (0.86) 1 1 test_sharing_s3-pull[2.40.0] 14.4032 (1.18) 14.4032 (1.18) 14.4032 (1.18) 0.0000 (1.0) 14.4032 (1.18) 0.0000 (1.0) 0;0 0.0694 (0.85) 1 1 test_sharing_s3-pull[2.41.1] 14.5195 (1.19) 14.5195 (1.19) 14.5195 (1.19) 0.0000 (1.0) 14.5195 (1.19) 0.0000 (1.0) 0;0 0.0689 (0.84) 1 1 test_sharing_s3-pull[2.45.0] 12.2432 (1.0) 12.2432 (1.0) 12.2432 (1.0) 0.0000 (1.0) 12.2432 (1.0) 0.0000 (1.0) 0;0 0.0817 (1.0) 1 1 test_sharing_s3-pull[main] 12.3037 (1.00) 12.3037 (1.00) 12.3037 (1.00) 0.0000 (1.0) 12.3037 (1.00) 0.0000 (1.0) 0;0 0.0813 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.11.0] 701.3626 (1.0) 701.3626 (1.0) 701.3626 (1.0) 0.0000 (1.0) 701.3626 (1.0) 0.0000 (1.0) 0;0 1.4258 (1.0) 1 1 test_sharing_s3-pull-noop[2.18.1] 753.9214 (1.07) 753.9214 (1.07) 753.9214 (1.07) 0.0000 (1.0) 753.9214 (1.07) 0.0000 (1.0) 0;0 1.3264 (0.93) 1 1 test_sharing_s3-pull-noop[2.39.0] 768.1991 (1.10) 768.1991 (1.10) 768.1991 (1.10) 0.0000 (1.0) 768.1991 (1.10) 0.0000 (1.0) 0;0 1.3017 (0.91) 1 1 test_sharing_s3-pull-noop[2.40.0] 769.6245 (1.10) 769.6245 (1.10) 769.6245 (1.10) 0.0000 (1.0) 769.6245 (1.10) 0.0000 (1.0) 0;0 1.2993 (0.91) 1 1 test_sharing_s3-pull-noop[2.41.1] 764.9967 (1.09) 764.9967 (1.09) 764.9967 (1.09) 0.0000 (1.0) 764.9967 (1.09) 0.0000 (1.0) 0;0 1.3072 (0.92) 1 1 test_sharing_s3-pull-noop[2.45.0] 802.0698 (1.14) 802.0698 (1.14) 802.0698 (1.14) 0.0000 (1.0) 802.0698 (1.14) 0.0000 (1.0) 0;0 1.2468 (0.87) 1 1 test_sharing_s3-pull-noop[main] 877.1418 (1.25) 877.1418 (1.25) 877.1418 (1.25) 0.0000 (1.0) 877.1418 (1.25) 0.0000 (1.0) 0;0 1.1401 (0.80) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.11.0] 20.5521 (2.26) 20.5521 (2.26) 20.5521 (2.26) 0.0000 (1.0) 20.5521 (2.26) 0.0000 (1.0) 0;0 0.0487 (0.44) 1 1 test_sharing_s3-push[2.18.1] 20.7587 (2.29) 20.7587 (2.29) 20.7587 (2.29) 0.0000 (1.0) 20.7587 (2.29) 0.0000 (1.0) 0;0 0.0482 (0.44) 1 1 test_sharing_s3-push[2.39.0] 22.1332 (2.44) 22.1332 (2.44) 22.1332 (2.44) 0.0000 (1.0) 22.1332 (2.44) 0.0000 (1.0) 0;0 0.0452 (0.41) 1 1 test_sharing_s3-push[2.40.0] 22.0371 (2.43) 22.0371 (2.43) 22.0371 (2.43) 0.0000 (1.0) 22.0371 (2.43) 0.0000 (1.0) 0;0 0.0454 (0.41) 1 1 test_sharing_s3-push[2.41.1] 11.8999 (1.31) 11.8999 (1.31) 11.8999 (1.31) 0.0000 (1.0) 11.8999 (1.31) 0.0000 (1.0) 0;0 0.0840 (0.76) 1 1 test_sharing_s3-push[2.45.0] 9.2226 (1.02) 9.2226 (1.02) 9.2226 (1.02) 0.0000 (1.0) 9.2226 (1.02) 0.0000 (1.0) 0;0 0.1084 (0.98) 1 1 test_sharing_s3-push[main] 9.0798 (1.0) 9.0798 (1.0) 9.0798 (1.0) 0.0000 (1.0) 9.0798 (1.0) 0.0000 (1.0) 0;0 0.1101 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push-noop[2.11.0] 942.1580 (1.0) 942.1580 (1.0) 942.1580 (1.0) 0.0000 (1.0) 942.1580 (1.0) 0.0000 (1.0) 0;0 1.0614 (1.0) 1 1 test_sharing_s3-push-noop[2.18.1] 948.5777 (1.01) 948.5777 (1.01) 948.5777 (1.01) 0.0000 (1.0) 948.5777 (1.01) 0.0000 (1.0) 0;0 1.0542 (0.99) 1 1 test_sharing_s3-push-noop[2.39.0] 968.3455 (1.03) 968.3455 (1.03) 968.3455 (1.03) 0.0000 (1.0) 968.3455 (1.03) 0.0000 (1.0) 0;0 1.0327 (0.97) 1 1 test_sharing_s3-push-noop[2.40.0] 962.4421 (1.02) 962.4421 (1.02) 962.4421 (1.02) 0.0000 (1.0) 962.4421 (1.02) 0.0000 (1.0) 0;0 1.0390 (0.98) 1 1 test_sharing_s3-push-noop[2.41.1] 960.7877 (1.02) 960.7877 (1.02) 960.7877 (1.02) 0.0000 (1.0) 960.7877 (1.02) 0.0000 (1.0) 0;0 1.0408 (0.98) 1 1 test_sharing_s3-push-noop[2.45.0] 956.9958 (1.02) 956.9958 (1.02) 956.9958 (1.02) 0.0000 (1.0) 956.9958 (1.02) 0.0000 (1.0) 0;0 1.0449 (0.98) 1 1 test_sharing_s3-push-noop[main] 1,051.1302 (1.12) 1,051.1302 (1.12) 1,051.1302 (1.12) 0.0000 (1.0) 1,051.1302 (1.12) 0.0000 (1.0) 0;0 0.9514 (0.90) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.11.0] 10.8514 (1.42) 10.8514 (1.42) 10.8514 (1.42) 0.0000 (1.0) 10.8514 (1.42) 0.0000 (1.0) 0;0 0.0922 (0.70) 1 1 test_import_url-import-url[2.18.1] 9.6762 (1.27) 9.6762 (1.27) 9.6762 (1.27) 0.0000 (1.0) 9.6762 (1.27) 0.0000 (1.0) 0;0 0.1033 (0.79) 1 1 test_import_url-import-url[2.39.0] 9.7936 (1.28) 9.7936 (1.28) 9.7936 (1.28) 0.0000 (1.0) 9.7936 (1.28) 0.0000 (1.0) 0;0 0.1021 (0.78) 1 1 test_import_url-import-url[2.40.0] 9.7453 (1.28) 9.7453 (1.28) 9.7453 (1.28) 0.0000 (1.0) 9.7453 (1.28) 0.0000 (1.0) 0;0 0.1026 (0.78) 1 1 test_import_url-import-url[2.41.1] 9.8437 (1.29) 9.8437 (1.29) 9.8437 (1.29) 0.0000 (1.0) 9.8437 (1.29) 0.0000 (1.0) 0;0 0.1016 (0.78) 1 1 test_import_url-import-url[2.45.0] 7.6316 (1.0) 7.6316 (1.0) 7.6316 (1.0) 0.0000 (1.0) 7.6316 (1.0) 0.0000 (1.0) 0;0 0.1310 (1.0) 1 1 test_import_url-import-url[main] 7.6915 (1.01) 7.6915 (1.01) 7.6915 (1.01) 0.0000 (1.0) 7.6915 (1.01) 0.0000 (1.0) 0;0 0.1300 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.11.0] 2.5760 (1.68) 2.5760 (1.68) 2.5760 (1.68) 0.0000 (1.0) 2.5760 (1.68) 0.0000 (1.0) 0;0 0.3882 (0.60) 1 1 test_status-status[2.18.1] 1.5668 (1.02) 1.5668 (1.02) 1.5668 (1.02) 0.0000 (1.0) 1.5668 (1.02) 0.0000 (1.0) 0;0 0.6383 (0.98) 1 1 test_status-status[2.39.0] 2.0815 (1.35) 2.0815 (1.35) 2.0815 (1.35) 0.0000 (1.0) 2.0815 (1.35) 0.0000 (1.0) 0;0 0.4804 (0.74) 1 1 test_status-status[2.40.0] 1.5455 (1.01) 1.5455 (1.01) 1.5455 (1.01) 0.0000 (1.0) 1.5455 (1.01) 0.0000 (1.0) 0;0 0.6470 (0.99) 1 1 test_status-status[2.41.1] 1.5372 (1.0) 1.5372 (1.0) 1.5372 (1.0) 0.0000 (1.0) 1.5372 (1.0) 0.0000 (1.0) 0;0 0.6505 (1.0) 1 1 test_status-status[2.45.0] 2.0823 (1.35) 2.0823 (1.35) 2.0823 (1.35) 0.0000 (1.0) 2.0823 (1.35) 0.0000 (1.0) 0;0 0.4802 (0.74) 1 1 test_status-status[main] 1.5909 (1.03) 1.5909 (1.03) 1.5909 (1.03) 0.0000 (1.0) 1.5909 (1.03) 0.0000 (1.0) 0;0 0.6286 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_status-status-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.11.0] 1.8127 (3.37) 1.8127 (3.37) 1.8127 (3.37) 0.0000 (1.0) 1.8127 (3.37) 0.0000 (1.0) 0;0 0.5517 (0.30) 1 1 test_status-status-changed[2.18.1] 0.5386 (1.0) 0.5386 (1.0) 0.5386 (1.0) 0.0000 (1.0) 0.5386 (1.0) 0.0000 (1.0) 0;0 1.8565 (1.0) 1 1 test_status-status-changed[2.39.0] 0.5963 (1.11) 0.5963 (1.11) 0.5963 (1.11) 0.0000 (1.0) 0.5963 (1.11) 0.0000 (1.0) 0;0 1.6771 (0.90) 1 1 test_status-status-changed[2.40.0] 0.6351 (1.18) 0.6351 (1.18) 0.6351 (1.18) 0.0000 (1.0) 0.6351 (1.18) 0.0000 (1.0) 0;0 1.5745 (0.85) 1 1 test_status-status-changed[2.41.1] 0.6343 (1.18) 0.6343 (1.18) 0.6343 (1.18) 0.0000 (1.0) 0.6343 (1.18) 0.0000 (1.0) 0;0 1.5765 (0.85) 1 1 test_status-status-changed[2.45.0] 0.6271 (1.16) 0.6271 (1.16) 0.6271 (1.16) 0.0000 (1.0) 0.6271 (1.16) 0.0000 (1.0) 0;0 1.5946 (0.86) 1 1 test_status-status-changed[main] 0.7044 (1.31) 0.7044 (1.31) 0.7044 (1.31) 0.0000 (1.0) 0.7044 (1.31) 0.0000 (1.0) 0;0 1.4196 (0.76) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.11.0] 775.4753 (1.42) 775.4753 (1.42) 775.4753 (1.42) 0.0000 (1.0) 775.4753 (1.42) 0.0000 (1.0) 0;0 1.2895 (0.70) 1 1 test_status-status-changed-noop[2.18.1] 546.4665 (1.0) 546.4665 (1.0) 546.4665 (1.0) 0.0000 (1.0) 546.4665 (1.0) 0.0000 (1.0) 0;0 1.8299 (1.0) 1 1 test_status-status-changed-noop[2.39.0] 582.0601 (1.07) 582.0601 (1.07) 582.0601 (1.07) 0.0000 (1.0) 582.0601 (1.07) 0.0000 (1.0) 0;0 1.7180 (0.94) 1 1 test_status-status-changed-noop[2.40.0] 590.4864 (1.08) 590.4864 (1.08) 590.4864 (1.08) 0.0000 (1.0) 590.4864 (1.08) 0.0000 (1.0) 0;0 1.6935 (0.93) 1 1 test_status-status-changed-noop[2.41.1] 635.0618 (1.16) 635.0618 (1.16) 635.0618 (1.16) 0.0000 (1.0) 635.0618 (1.16) 0.0000 (1.0) 0;0 1.5746 (0.86) 1 1 test_status-status-changed-noop[2.45.0] 622.3689 (1.14) 622.3689 (1.14) 622.3689 (1.14) 0.0000 (1.0) 622.3689 (1.14) 0.0000 (1.0) 0;0 1.6068 (0.88) 1 1 test_status-status-changed-noop[main] 735.5173 (1.35) 735.5173 (1.35) 735.5173 (1.35) 0.0000 (1.0) 735.5173 (1.35) 0.0000 (1.0) 0;0 1.3596 (0.74) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.11.0] 501.8789 (1.0) 501.8789 (1.0) 501.8789 (1.0) 0.0000 (1.0) 501.8789 (1.0) 0.0000 (1.0) 0;0 1.9925 (1.0) 1 1 test_status-status-noop[2.18.1] 559.1097 (1.11) 559.1097 (1.11) 559.1097 (1.11) 0.0000 (1.0) 559.1097 (1.11) 0.0000 (1.0) 0;0 1.7886 (0.90) 1 1 test_status-status-noop[2.39.0] 591.6104 (1.18) 591.6104 (1.18) 591.6104 (1.18) 0.0000 (1.0) 591.6104 (1.18) 0.0000 (1.0) 0;0 1.6903 (0.85) 1 1 test_status-status-noop[2.40.0] 642.0784 (1.28) 642.0784 (1.28) 642.0784 (1.28) 0.0000 (1.0) 642.0784 (1.28) 0.0000 (1.0) 0;0 1.5574 (0.78) 1 1 test_status-status-noop[2.41.1] 632.8644 (1.26) 632.8644 (1.26) 632.8644 (1.26) 0.0000 (1.0) 632.8644 (1.26) 0.0000 (1.0) 0;0 1.5801 (0.79) 1 1 test_status-status-noop[2.45.0] 615.1961 (1.23) 615.1961 (1.23) 615.1961 (1.23) 0.0000 (1.0) 615.1961 (1.23) 0.0000 (1.0) 0;0 1.6255 (0.82) 1 1 test_status-status-noop[main] 691.5411 (1.38) 691.5411 (1.38) 691.5411 (1.38) 0.0000 (1.0) 691.5411 (1.38) 0.0000 (1.0) 0;0 1.4460 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_pull-pull': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_pull-pull[2.11.0] 7.1751 (1.03) 7.1751 (1.03) 7.1751 (1.03) 0.0000 (1.0) 7.1751 (1.03) 0.0000 (1.0) 0;0 0.1394 (0.97) 1 1 test_pull-pull[2.18.1] 7.3885 (1.06) 7.3885 (1.06) 7.3885 (1.06) 0.0000 (1.0) 7.3885 (1.06) 0.0000 (1.0) 0;0 0.1353 (0.94) 1 1 test_pull-pull[2.39.0] 9.0321 (1.30) 9.0321 (1.30) 9.0321 (1.30) 0.0000 (1.0) 9.0321 (1.30) 0.0000 (1.0) 0;0 0.1107 (0.77) 1 1 test_pull-pull[2.40.0] 8.8808 (1.28) 8.8808 (1.28) 8.8808 (1.28) 0.0000 (1.0) 8.8808 (1.28) 0.0000 (1.0) 0;0 0.1126 (0.78) 1 1 test_pull-pull[2.41.1] 8.5793 (1.24) 8.5793 (1.24) 8.5793 (1.24) 0.0000 (1.0) 8.5793 (1.24) 0.0000 (1.0) 0;0 0.1166 (0.81) 1 1 test_pull-pull[2.45.0] 7.0951 (1.02) 7.0951 (1.02) 7.0951 (1.02) 0.0000 (1.0) 7.0951 (1.02) 0.0000 (1.0) 0;0 0.1409 (0.98) 1 1 test_pull-pull[main] 6.9419 (1.0) 6.9419 (1.0) 6.9419 (1.0) 0.0000 (1.0) 6.9419 (1.0) 0.0000 (1.0) 0;0 0.1441 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[2.11.0] 7.0187 (1.83) 7.0187 (1.83) 7.0187 (1.83) 0.0000 (1.0) 7.0187 (1.83) 0.0000 (1.0) 0;0 0.1425 (0.55) 1 1 test_add-add[2.18.1] 6.1074 (1.59) 6.1074 (1.59) 6.1074 (1.59) 0.0000 (1.0) 6.1074 (1.59) 0.0000 (1.0) 0;0 0.1637 (0.63) 1 1 test_add-add[2.39.0] 5.9611 (1.55) 5.9611 (1.55) 5.9611 (1.55) 0.0000 (1.0) 5.9611 (1.55) 0.0000 (1.0) 0;0 0.1678 (0.64) 1 1 test_add-add[2.40.0] 5.8908 (1.53) 5.8908 (1.53) 5.8908 (1.53) 0.0000 (1.0) 5.8908 (1.53) 0.0000 (1.0) 0;0 0.1698 (0.65) 1 1 test_add-add[2.41.1] 5.9289 (1.54) 5.9289 (1.54) 5.9289 (1.54) 0.0000 (1.0) 5.9289 (1.54) 0.0000 (1.0) 0;0 0.1687 (0.65) 1 1 test_add-add[2.45.0] 3.8439 (1.0) 3.8439 (1.0) 3.8439 (1.0) 0.0000 (1.0) 3.8439 (1.0) 0.0000 (1.0) 0;0 0.2602 (1.0) 1 1 test_add-add[main] 3.9247 (1.02) 3.9247 (1.02) 3.9247 (1.02) 0.0000 (1.0) 3.9247 (1.02) 0.0000 (1.0) 0;0 0.2548 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_init-init': 7 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.11.0] 317.5953 (1.0) 405.8423 (1.0) 341.8590 (1.0) 11.3332 (2.18) 344.3075 (1.00) 5.7428 (1.95) 19;19 2.9252 (1.0) 100 1 test_init-init[2.18.1] 337.6080 (1.06) 448.8094 (1.11) 344.1245 (1.01) 10.8773 (2.09) 342.9883 (1.0) 2.9395 (1.0) 1;3 2.9059 (0.99) 100 1 test_init-init[2.39.0] 380.1001 (1.20) 443.9004 (1.09) 390.2473 (1.14) 7.1653 (1.38) 389.2669 (1.13) 5.0514 (1.72) 15;6 2.5625 (0.88) 100 1 test_init-init[2.40.0] 380.6613 (1.20) 421.0835 (1.04) 390.7049 (1.14) 7.3322 (1.41) 389.3365 (1.14) 9.0136 (3.07) 25;3 2.5595 (0.87) 100 1 test_init-init[2.41.1] 381.6840 (1.20) 409.4042 (1.01) 396.3262 (1.16) 5.1967 (1.0) 396.8368 (1.16) 5.9045 (2.01) 30;5 2.5232 (0.86) 100 1 test_init-init[2.45.0] 383.2181 (1.21) 424.1665 (1.05) 395.5685 (1.16) 8.4137 (1.62) 393.3747 (1.15) 10.2933 (3.50) 27;4 2.5280 (0.86) 100 1 test_init-init[main] 466.1781 (1.47) 529.9160 (1.31) 482.1416 (1.41) 14.4943 (2.79) 476.2096 (1.39) 13.4687 (4.58) 20;11 2.0741 (0.71) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.11.0] 3.7934 (1.18) 3.7934 (1.18) 3.7934 (1.18) 0.0000 (1.0) 3.7934 (1.18) 0.0000 (1.0) 0;0 0.2636 (0.85) 1 1 test_push-push[2.18.1] 3.5754 (1.11) 3.5754 (1.11) 3.5754 (1.11) 0.0000 (1.0) 3.5754 (1.11) 0.0000 (1.0) 0;0 0.2797 (0.90) 1 1 test_push-push[2.39.0] 5.1302 (1.60) 5.1302 (1.60) 5.1302 (1.60) 0.0000 (1.0) 5.1302 (1.60) 0.0000 (1.0) 0;0 0.1949 (0.63) 1 1 test_push-push[2.40.0] 4.6416 (1.45) 4.6416 (1.45) 4.6416 (1.45) 0.0000 (1.0) 4.6416 (1.45) 0.0000 (1.0) 0;0 0.2154 (0.69) 1 1 test_push-push[2.41.1] 4.7141 (1.47) 4.7141 (1.47) 4.7141 (1.47) 0.0000 (1.0) 4.7141 (1.47) 0.0000 (1.0) 0;0 0.2121 (0.68) 1 1 test_push-push[2.45.0] 3.2704 (1.02) 3.2704 (1.02) 3.2704 (1.02) 0.0000 (1.0) 3.2704 (1.02) 0.0000 (1.0) 0;0 0.3058 (0.98) 1 1 test_push-push[main] 3.2099 (1.0) 3.2099 (1.0) 3.2099 (1.0) 0.0000 (1.0) 3.2099 (1.0) 0.0000 (1.0) 0;0 0.3115 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.11.0] 1.2831 (1.04) 1.2831 (1.04) 1.2831 (1.04) 0.0000 (1.0) 1.2831 (1.04) 0.0000 (1.0) 0;0 0.7794 (0.96) 1 1 test_checkout_hardlink-checkout[2.18.1] 1.4109 (1.14) 1.4109 (1.14) 1.4109 (1.14) 0.0000 (1.0) 1.4109 (1.14) 0.0000 (1.0) 0;0 0.7088 (0.88) 1 1 test_checkout_hardlink-checkout[2.39.0] 1.2360 (1.0) 1.2360 (1.0) 1.2360 (1.0) 0.0000 (1.0) 1.2360 (1.0) 0.0000 (1.0) 0;0 0.8091 (1.0) 1 1 test_checkout_hardlink-checkout[2.40.0] 1.2494 (1.01) 1.2494 (1.01) 1.2494 (1.01) 0.0000 (1.0) 1.2494 (1.01) 0.0000 (1.0) 0;0 0.8004 (0.99) 1 1 test_checkout_hardlink-checkout[2.41.1] 1.2397 (1.00) 1.2397 (1.00) 1.2397 (1.00) 0.0000 (1.0) 1.2397 (1.00) 0.0000 (1.0) 0;0 0.8067 (1.00) 1 1 test_checkout_hardlink-checkout[2.45.0] 1.5752 (1.27) 1.5752 (1.27) 1.5752 (1.27) 0.0000 (1.0) 1.5752 (1.27) 0.0000 (1.0) 0;0 0.6349 (0.78) 1 1 test_checkout_hardlink-checkout[main] 1.6496 (1.33) 1.6496 (1.33) 1.6496 (1.33) 0.0000 (1.0) 1.6496 (1.33) 0.0000 (1.0) 0;0 0.6062 (0.75) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.11.0] 486.4223 (1.0) 486.4223 (1.0) 486.4223 (1.0) 0.0000 (1.0) 486.4223 (1.0) 0.0000 (1.0) 0;0 2.0558 (1.0) 1 1 test_checkout_hardlink-checkout-noop[2.18.1] 558.0270 (1.15) 558.0270 (1.15) 558.0270 (1.15) 0.0000 (1.0) 558.0270 (1.15) 0.0000 (1.0) 0;0 1.7920 (0.87) 1 1 test_checkout_hardlink-checkout-noop[2.39.0] 588.7509 (1.21) 588.7509 (1.21) 588.7509 (1.21) 0.0000 (1.0) 588.7509 (1.21) 0.0000 (1.0) 0;0 1.6985 (0.83) 1 1 test_checkout_hardlink-checkout-noop[2.40.0] 575.9507 (1.18) 575.9507 (1.18) 575.9507 (1.18) 0.0000 (1.0) 575.9507 (1.18) 0.0000 (1.0) 0;0 1.7363 (0.84) 1 1 test_checkout_hardlink-checkout-noop[2.41.1] 577.4106 (1.19) 577.4106 (1.19) 577.4106 (1.19) 0.0000 (1.0) 577.4106 (1.19) 0.0000 (1.0) 0;0 1.7319 (0.84) 1 1 test_checkout_hardlink-checkout-noop[2.45.0] 599.6147 (1.23) 599.6147 (1.23) 599.6147 (1.23) 0.0000 (1.0) 599.6147 (1.23) 0.0000 (1.0) 0;0 1.6677 (0.81) 1 1 test_checkout_hardlink-checkout-noop[main] 658.9706 (1.35) 658.9706 (1.35) 658.9706 (1.35) 0.0000 (1.0) 658.9706 (1.35) 0.0000 (1.0) 0;0 1.5175 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.11.0] 1.2705 (1.98) 1.2705 (1.98) 1.2705 (1.98) 0.0000 (1.0) 1.2705 (1.98) 0.0000 (1.0) 0;0 0.7871 (0.51) 1 1 test_checkout_hardlink-checkout-update[2.18.1] 0.6429 (1.0) 0.6429 (1.0) 0.6429 (1.0) 0.0000 (1.0) 0.6429 (1.0) 0.0000 (1.0) 0;0 1.5554 (1.0) 1 1 test_checkout_hardlink-checkout-update[2.39.0] 0.8552 (1.33) 0.8552 (1.33) 0.8552 (1.33) 0.0000 (1.0) 0.8552 (1.33) 0.0000 (1.0) 0;0 1.1693 (0.75) 1 1 test_checkout_hardlink-checkout-update[2.40.0] 0.6515 (1.01) 0.6515 (1.01) 0.6515 (1.01) 0.0000 (1.0) 0.6515 (1.01) 0.0000 (1.0) 0;0 1.5349 (0.99) 1 1 test_checkout_hardlink-checkout-update[2.41.1] 0.6450 (1.00) 0.6450 (1.00) 0.6450 (1.00) 0.0000 (1.0) 0.6450 (1.00) 0.0000 (1.0) 0;0 1.5504 (1.00) 1 1 test_checkout_hardlink-checkout-update[2.45.0] 0.6772 (1.05) 0.6772 (1.05) 0.6772 (1.05) 0.0000 (1.0) 0.6772 (1.05) 0.0000 (1.0) 0;0 1.4766 (0.95) 1 1 test_checkout_hardlink-checkout-update[main] 0.7300 (1.14) 0.7300 (1.14) 0.7300 (1.14) 0.0000 (1.0) 0.7300 (1.14) 0.0000 (1.0) 0;0 1.3698 (0.88) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.11.0] 8.2708 (1.36) 8.2708 (1.36) 8.2708 (1.36) 0.0000 (1.0) 8.2708 (1.36) 0.0000 (1.0) 0;0 0.1209 (0.74) 1 1 test_update-update[2.18.1] 7.4793 (1.23) 7.4793 (1.23) 7.4793 (1.23) 0.0000 (1.0) 7.4793 (1.23) 0.0000 (1.0) 0;0 0.1337 (0.81) 1 1 test_update-update[2.39.0] 6.6143 (1.09) 6.6143 (1.09) 6.6143 (1.09) 0.0000 (1.0) 6.6143 (1.09) 0.0000 (1.0) 0;0 0.1512 (0.92) 1 1 test_update-update[2.40.0] 6.6230 (1.09) 6.6230 (1.09) 6.6230 (1.09) 0.0000 (1.0) 6.6230 (1.09) 0.0000 (1.0) 0;0 0.1510 (0.92) 1 1 test_update-update[2.41.1] 6.6149 (1.09) 6.6149 (1.09) 6.6149 (1.09) 0.0000 (1.0) 6.6149 (1.09) 0.0000 (1.0) 0;0 0.1512 (0.92) 1 1 test_update-update[2.45.0] 6.7286 (1.10) 6.7286 (1.10) 6.7286 (1.10) 0.0000 (1.0) 6.7286 (1.10) 0.0000 (1.0) 0;0 0.1486 (0.91) 1 1 test_update-update[main] 6.0924 (1.0) 6.0924 (1.0) 6.0924 (1.0) 0.0000 (1.0) 6.0924 (1.0) 0.0000 (1.0) 0;0 0.1641 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update-noop[2.11.0] 467.1948 (1.0) 467.1948 (1.0) 467.1948 (1.0) 0.0000 (1.0) 467.1948 (1.0) 0.0000 (1.0) 0;0 2.1404 (1.0) 1 1 test_update-update-noop[2.18.1] 601.0292 (1.29) 601.0292 (1.29) 601.0292 (1.29) 0.0000 (1.0) 601.0292 (1.29) 0.0000 (1.0) 0;0 1.6638 (0.78) 1 1 test_update-update-noop[2.39.0] 874.0027 (1.87) 874.0027 (1.87) 874.0027 (1.87) 0.0000 (1.0) 874.0027 (1.87) 0.0000 (1.0) 0;0 1.1442 (0.53) 1 1 test_update-update-noop[2.40.0] 875.5149 (1.87) 875.5149 (1.87) 875.5149 (1.87) 0.0000 (1.0) 875.5149 (1.87) 0.0000 (1.0) 0;0 1.1422 (0.53) 1 1 test_update-update-noop[2.41.1] 872.4249 (1.87) 872.4249 (1.87) 872.4249 (1.87) 0.0000 (1.0) 872.4249 (1.87) 0.0000 (1.0) 0;0 1.1462 (0.54) 1 1 test_update-update-noop[2.45.0] 984.6096 (2.11) 984.6096 (2.11) 984.6096 (2.11) 0.0000 (1.0) 984.6096 (2.11) 0.0000 (1.0) 0;0 1.0156 (0.47) 1 1 test_update-update-noop[main] 1,056.2768 (2.26) 1,056.2768 (2.26) 1,056.2768 (2.26) 0.0000 (1.0) 1,056.2768 (2.26) 0.0000 (1.0) 0;0 0.9467 (0.44) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.18.1] 652.2475 (1.02) 652.2475 (1.02) 652.2475 (1.02) 0.0000 (1.0) 652.2475 (1.02) 0.0000 (1.0) 0;0 1.5332 (0.98) 1 1 test_data_status-data-changed[2.39.0] 682.1848 (1.07) 682.1848 (1.07) 682.1848 (1.07) 0.0000 (1.0) 682.1848 (1.07) 0.0000 (1.0) 0;0 1.4659 (0.94) 1 1 test_data_status-data-changed[2.40.0] 700.3457 (1.10) 700.3457 (1.10) 700.3457 (1.10) 0.0000 (1.0) 700.3457 (1.10) 0.0000 (1.0) 0;0 1.4279 (0.91) 1 1 test_data_status-data-changed[2.41.1] 691.4833 (1.08) 691.4833 (1.08) 691.4833 (1.08) 0.0000 (1.0) 691.4833 (1.08) 0.0000 (1.0) 0;0 1.4462 (0.92) 1 1 test_data_status-data-changed[2.45.0] 638.1519 (1.0) 638.1519 (1.0) 638.1519 (1.0) 0.0000 (1.0) 638.1519 (1.0) 0.0000 (1.0) 0;0 1.5670 (1.0) 1 1 test_data_status-data-changed[main] 701.4583 (1.10) 701.4583 (1.10) 701.4583 (1.10) 0.0000 (1.0) 701.4583 (1.10) 0.0000 (1.0) 0;0 1.4256 (0.91) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.18.1] 652.6829 (1.01) 652.6829 (1.01) 652.6829 (1.01) 0.0000 (1.0) 652.6829 (1.01) 0.0000 (1.0) 0;0 1.5321 (0.99) 1 1 test_data_status-data-changed-noop[2.39.0] 679.0248 (1.06) 679.0248 (1.06) 679.0248 (1.06) 0.0000 (1.0) 679.0248 (1.06) 0.0000 (1.0) 0;0 1.4727 (0.95) 1 1 test_data_status-data-changed-noop[2.40.0] 694.0750 (1.08) 694.0750 (1.08) 694.0750 (1.08) 0.0000 (1.0) 694.0750 (1.08) 0.0000 (1.0) 0;0 1.4408 (0.93) 1 1 test_data_status-data-changed-noop[2.41.1] 689.1642 (1.07) 689.1642 (1.07) 689.1642 (1.07) 0.0000 (1.0) 689.1642 (1.07) 0.0000 (1.0) 0;0 1.4510 (0.93) 1 1 test_data_status-data-changed-noop[2.45.0] 643.5986 (1.0) 643.5986 (1.0) 643.5986 (1.0) 0.0000 (1.0) 643.5986 (1.0) 0.0000 (1.0) 0;0 1.5538 (1.0) 1 1 test_data_status-data-changed-noop[main] 694.3249 (1.08) 694.3249 (1.08) 694.3249 (1.08) 0.0000 (1.0) 694.3249 (1.08) 0.0000 (1.0) 0;0 1.4402 (0.93) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.18.1] 1.4871 (1.04) 1.4871 (1.04) 1.4871 (1.04) 0.0000 (1.0) 1.4871 (1.04) 0.0000 (1.0) 0;0 0.6725 (0.96) 1 1 test_data_status-data-new[2.39.0] 1.9612 (1.38) 1.9612 (1.38) 1.9612 (1.38) 0.0000 (1.0) 1.9612 (1.38) 0.0000 (1.0) 0;0 0.5099 (0.73) 1 1 test_data_status-data-new[2.40.0] 2.1541 (1.51) 2.1541 (1.51) 2.1541 (1.51) 0.0000 (1.0) 2.1541 (1.51) 0.0000 (1.0) 0;0 0.4642 (0.66) 1 1 test_data_status-data-new[2.41.1] 2.0435 (1.43) 2.0435 (1.43) 2.0435 (1.43) 0.0000 (1.0) 2.0435 (1.43) 0.0000 (1.0) 0;0 0.4894 (0.70) 1 1 test_data_status-data-new[2.45.0] 1.4248 (1.0) 1.4248 (1.0) 1.4248 (1.0) 0.0000 (1.0) 1.4248 (1.0) 0.0000 (1.0) 0;0 0.7018 (1.0) 1 1 test_data_status-data-new[main] 1.4588 (1.02) 1.4588 (1.02) 1.4588 (1.02) 0.0000 (1.0) 1.4588 (1.02) 0.0000 (1.0) 0;0 0.6855 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.18.1] 646.2996 (1.01) 646.2996 (1.01) 646.2996 (1.01) 0.0000 (1.0) 646.2996 (1.01) 0.0000 (1.0) 0;0 1.5473 (0.99) 1 1 test_data_status-data-noop[2.39.0] 669.5847 (1.05) 669.5847 (1.05) 669.5847 (1.05) 0.0000 (1.0) 669.5847 (1.05) 0.0000 (1.0) 0;0 1.4935 (0.95) 1 1 test_data_status-data-noop[2.40.0] 682.2096 (1.07) 682.2096 (1.07) 682.2096 (1.07) 0.0000 (1.0) 682.2096 (1.07) 0.0000 (1.0) 0;0 1.4658 (0.94) 1 1 test_data_status-data-noop[2.41.1] 681.5463 (1.07) 681.5463 (1.07) 681.5463 (1.07) 0.0000 (1.0) 681.5463 (1.07) 0.0000 (1.0) 0;0 1.4673 (0.94) 1 1 test_data_status-data-noop[2.45.0] 639.3111 (1.0) 639.3111 (1.0) 639.3111 (1.0) 0.0000 (1.0) 639.3111 (1.0) 0.0000 (1.0) 0;0 1.5642 (1.0) 1 1 test_data_status-data-noop[main] 688.7572 (1.08) 688.7572 (1.08) 688.7572 (1.08) 0.0000 (1.0) 688.7572 (1.08) 0.0000 (1.0) 0;0 1.4519 (0.93) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.11.0] 3.6345 (1.10) 3.6345 (1.10) 3.6345 (1.10) 0.0000 (1.0) 3.6345 (1.10) 0.0000 (1.0) 0;0 0.2751 (0.91) 1 1 test_exp_show-exp[2.18.1] 3.6927 (1.12) 3.6927 (1.12) 3.6927 (1.12) 0.0000 (1.0) 3.6927 (1.12) 0.0000 (1.0) 0;0 0.2708 (0.90) 1 1 test_exp_show-exp[2.39.0] 3.3089 (1.0) 3.3089 (1.0) 3.3089 (1.0) 0.0000 (1.0) 3.3089 (1.0) 0.0000 (1.0) 0;0 0.3022 (1.0) 1 1 test_exp_show-exp[2.40.0] 3.3282 (1.01) 3.3282 (1.01) 3.3282 (1.01) 0.0000 (1.0) 3.3282 (1.01) 0.0000 (1.0) 0;0 0.3005 (0.99) 1 1 test_exp_show-exp[2.41.1] 3.3122 (1.00) 3.3122 (1.00) 3.3122 (1.00) 0.0000 (1.0) 3.3122 (1.00) 0.0000 (1.0) 0;0 0.3019 (1.00) 1 1 test_exp_show-exp[2.45.0] 3.3988 (1.03) 3.3988 (1.03) 3.3988 (1.03) 0.0000 (1.0) 3.3988 (1.03) 0.0000 (1.0) 0;0 0.2942 (0.97) 1 1 test_exp_show-exp[main] 4.2926 (1.30) 4.2926 (1.30) 4.2926 (1.30) 0.0000 (1.0) 4.2926 (1.30) 0.0000 (1.0) 0;0 0.2330 (0.77) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.11.0] 402.6527 (1.07) 402.6527 (1.07) 402.6527 (1.07) 0.0000 (1.0) 402.6527 (1.07) 0.0000 (1.0) 0;0 2.4835 (0.94) 1 1 test_list-list[2.18.1] 377.7603 (1.0) 377.7603 (1.0) 377.7603 (1.0) 0.0000 (1.0) 377.7603 (1.0) 0.0000 (1.0) 0;0 2.6472 (1.0) 1 1 test_list-list[2.39.0] 398.4326 (1.05) 398.4326 (1.05) 398.4326 (1.05) 0.0000 (1.0) 398.4326 (1.05) 0.0000 (1.0) 0;0 2.5098 (0.95) 1 1 test_list-list[2.40.0] 403.2874 (1.07) 403.2874 (1.07) 403.2874 (1.07) 0.0000 (1.0) 403.2874 (1.07) 0.0000 (1.0) 0;0 2.4796 (0.94) 1 1 test_list-list[2.41.1] 401.0533 (1.06) 401.0533 (1.06) 401.0533 (1.06) 0.0000 (1.0) 401.0533 (1.06) 0.0000 (1.0) 0;0 2.4934 (0.94) 1 1 test_list-list[2.45.0] 517.2216 (1.37) 517.2216 (1.37) 517.2216 (1.37) 0.0000 (1.0) 517.2216 (1.37) 0.0000 (1.0) 0;0 1.9334 (0.73) 1 1 test_list-list[main] 497.3859 (1.32) 497.3859 (1.32) 497.3859 (1.32) 0.0000 (1.0) 497.3859 (1.32) 0.0000 (1.0) 0;0 2.0105 (0.76) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.11.0] 390.7604 (1.07) 390.7604 (1.07) 390.7604 (1.07) 0.0000 (1.0) 390.7604 (1.07) 0.0000 (1.0) 0;0 2.5591 (0.94) 1 1 test_list-list-dvc-only[2.18.1] 365.9996 (1.0) 365.9996 (1.0) 365.9996 (1.0) 0.0000 (1.0) 365.9996 (1.0) 0.0000 (1.0) 0;0 2.7322 (1.0) 1 1 test_list-list-dvc-only[2.39.0] 390.0982 (1.07) 390.0982 (1.07) 390.0982 (1.07) 0.0000 (1.0) 390.0982 (1.07) 0.0000 (1.0) 0;0 2.5635 (0.94) 1 1 test_list-list-dvc-only[2.40.0] 388.6080 (1.06) 388.6080 (1.06) 388.6080 (1.06) 0.0000 (1.0) 388.6080 (1.06) 0.0000 (1.0) 0;0 2.5733 (0.94) 1 1 test_list-list-dvc-only[2.41.1] 387.8092 (1.06) 387.8092 (1.06) 387.8092 (1.06) 0.0000 (1.0) 387.8092 (1.06) 0.0000 (1.0) 0;0 2.5786 (0.94) 1 1 test_list-list-dvc-only[2.45.0] 401.7297 (1.10) 401.7297 (1.10) 401.7297 (1.10) 0.0000 (1.0) 401.7297 (1.10) 0.0000 (1.0) 0;0 2.4892 (0.91) 1 1 test_list-list-dvc-only[main] 487.4370 (1.33) 487.4370 (1.33) 487.4370 (1.33) 0.0000 (1.0) 487.4370 (1.33) 0.0000 (1.0) 0;0 2.0515 (0.75) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.11.0] 1.6589 (3.61) 1.6589 (3.61) 1.6589 (3.61) 0.0000 (1.0) 1.6589 (3.61) 0.0000 (1.0) 0;0 0.6028 (0.28) 1 1 test_list-list-recursive[2.18.1] 2.3418 (5.10) 2.3418 (5.10) 2.3418 (5.10) 0.0000 (1.0) 2.3418 (5.10) 0.0000 (1.0) 0;0 0.4270 (0.20) 1 1 test_list-list-recursive[2.39.0] 0.8337 (1.81) 0.8337 (1.81) 0.8337 (1.81) 0.0000 (1.0) 0.8337 (1.81) 0.0000 (1.0) 0;0 1.1995 (0.55) 1 1 test_list-list-recursive[2.40.0] 0.4619 (1.01) 0.4619 (1.01) 0.4619 (1.01) 0.0000 (1.0) 0.4619 (1.01) 0.0000 (1.0) 0;0 2.1650 (0.99) 1 1 test_list-list-recursive[2.41.1] 0.4595 (1.0) 0.4595 (1.0) 0.4595 (1.0) 0.0000 (1.0) 0.4595 (1.0) 0.0000 (1.0) 0;0 2.1762 (1.0) 1 1 test_list-list-recursive[2.45.0] 0.4682 (1.02) 0.4682 (1.02) 0.4682 (1.02) 0.0000 (1.0) 0.4682 (1.02) 0.0000 (1.0) 0;0 2.1357 (0.98) 1 1 test_list-list-recursive[main] 0.5847 (1.27) 0.5847 (1.27) 0.5847 (1.27) 0.0000 (1.0) 0.5847 (1.27) 0.0000 (1.0) 0;0 1.7102 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.11.0] 389.6687 (1.0) 389.6687 (1.0) 389.6687 (1.0) 0.0000 (1.0) 389.6687 (1.0) 0.0000 (1.0) 0;0 2.5663 (1.0) 1 1 test_list-list-shallow[2.18.1] 397.1396 (1.02) 397.1396 (1.02) 397.1396 (1.02) 0.0000 (1.0) 397.1396 (1.02) 0.0000 (1.0) 0;0 2.5180 (0.98) 1 1 test_list-list-shallow[2.39.0] 416.6965 (1.07) 416.6965 (1.07) 416.6965 (1.07) 0.0000 (1.0) 416.6965 (1.07) 0.0000 (1.0) 0;0 2.3998 (0.94) 1 1 test_list-list-shallow[2.40.0] 416.5002 (1.07) 416.5002 (1.07) 416.5002 (1.07) 0.0000 (1.0) 416.5002 (1.07) 0.0000 (1.0) 0;0 2.4010 (0.94) 1 1 test_list-list-shallow[2.41.1] 422.2199 (1.08) 422.2199 (1.08) 422.2199 (1.08) 0.0000 (1.0) 422.2199 (1.08) 0.0000 (1.0) 0;0 2.3684 (0.92) 1 1 test_list-list-shallow[2.45.0] 434.2711 (1.11) 434.2711 (1.11) 434.2711 (1.11) 0.0000 (1.0) 434.2711 (1.11) 0.0000 (1.0) 0;0 2.3027 (0.90) 1 1 test_list-list-shallow[main] 492.0602 (1.26) 492.0602 (1.26) 492.0602 (1.26) 0.0000 (1.0) 492.0602 (1.26) 0.0000 (1.0) 0;0 2.0323 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.11.0] 142.0101 (1.0) 150.4859 (1.0) 144.7279 (1.0) 1.3319 (1.73) 144.5970 (1.0) 1.3303 (1.35) 21;5 6.9095 (1.0) 100 1 test_help---help[2.18.1] 146.6347 (1.03) 152.6414 (1.01) 149.3808 (1.03) 1.1381 (1.48) 149.5084 (1.03) 1.6305 (1.66) 36;1 6.6943 (0.97) 100 1 test_help---help[2.39.0] 187.5021 (1.32) 201.3978 (1.34) 191.2336 (1.32) 1.8237 (2.37) 190.9298 (1.32) 1.6065 (1.63) 23;7 5.2292 (0.76) 100 1 test_help---help[2.40.0] 185.5299 (1.31) 195.2047 (1.30) 189.6476 (1.31) 1.9652 (2.56) 189.3535 (1.31) 2.8061 (2.85) 29;1 5.2729 (0.76) 100 1 test_help---help[2.41.1] 188.1878 (1.33) 204.1066 (1.36) 192.2987 (1.33) 1.9058 (2.48) 192.2013 (1.33) 2.0428 (2.08) 19;2 5.2002 (0.75) 100 1 test_help---help[2.45.0] 148.5663 (1.05) 153.0185 (1.02) 150.2845 (1.04) 0.7688 (1.0) 150.2765 (1.04) 0.9832 (1.0) 25;2 6.6540 (0.96) 100 1 test_help---help[main] 149.2934 (1.05) 155.5550 (1.03) 152.4189 (1.05) 1.2781 (1.66) 152.6050 (1.06) 1.8916 (1.92) 31;0 6.5609 (0.95) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.11.0] 1.6170 (1.21) 1.6170 (1.21) 1.6170 (1.21) 0.0000 (1.0) 1.6170 (1.21) 0.0000 (1.0) 0;0 0.6184 (0.83) 1 1 test_diff-diff[2.18.1] 1.3370 (1.0) 1.3370 (1.0) 1.3370 (1.0) 0.0000 (1.0) 1.3370 (1.0) 0.0000 (1.0) 0;0 0.7480 (1.0) 1 1 test_diff-diff[2.39.0] 1.4180 (1.06) 1.4180 (1.06) 1.4180 (1.06) 0.0000 (1.0) 1.4180 (1.06) 0.0000 (1.0) 0;0 0.7052 (0.94) 1 1 test_diff-diff[2.40.0] 1.3756 (1.03) 1.3756 (1.03) 1.3756 (1.03) 0.0000 (1.0) 1.3756 (1.03) 0.0000 (1.0) 0;0 0.7270 (0.97) 1 1 test_diff-diff[2.41.1] 1.3830 (1.03) 1.3830 (1.03) 1.3830 (1.03) 0.0000 (1.0) 1.3830 (1.03) 0.0000 (1.0) 0;0 0.7230 (0.97) 1 1 test_diff-diff[2.45.0] 1.3512 (1.01) 1.3512 (1.01) 1.3512 (1.01) 0.0000 (1.0) 1.3512 (1.01) 0.0000 (1.0) 0;0 0.7401 (0.99) 1 1 test_diff-diff[main] 1.3534 (1.01) 1.3534 (1.01) 1.3534 (1.01) 0.0000 (1.0) 1.3534 (1.01) 0.0000 (1.0) 0;0 0.7389 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.11.0] 1.0764 (1.70) 1.0764 (1.70) 1.0764 (1.70) 0.0000 (1.0) 1.0764 (1.70) 0.0000 (1.0) 0;0 0.9290 (0.59) 1 1 test_diff-diff-changed[2.18.1] 0.6331 (1.0) 0.6331 (1.0) 0.6331 (1.0) 0.0000 (1.0) 0.6331 (1.0) 0.0000 (1.0) 0;0 1.5795 (1.0) 1 1 test_diff-diff-changed[2.39.0] 0.6582 (1.04) 0.6582 (1.04) 0.6582 (1.04) 0.0000 (1.0) 0.6582 (1.04) 0.0000 (1.0) 0;0 1.5194 (0.96) 1 1 test_diff-diff-changed[2.40.0] 0.6817 (1.08) 0.6817 (1.08) 0.6817 (1.08) 0.0000 (1.0) 0.6817 (1.08) 0.0000 (1.0) 0;0 1.4670 (0.93) 1 1 test_diff-diff-changed[2.41.1] 0.6582 (1.04) 0.6582 (1.04) 0.6582 (1.04) 0.0000 (1.0) 0.6582 (1.04) 0.0000 (1.0) 0;0 1.5194 (0.96) 1 1 test_diff-diff-changed[2.45.0] 0.6741 (1.06) 0.6741 (1.06) 0.6741 (1.06) 0.0000 (1.0) 0.6741 (1.06) 0.0000 (1.0) 0;0 1.4834 (0.94) 1 1 test_diff-diff-changed[main] 0.7575 (1.20) 0.7575 (1.20) 0.7575 (1.20) 0.0000 (1.0) 0.7575 (1.20) 0.0000 (1.0) 0;0 1.3201 (0.84) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.11.0] 487.8609 (1.0) 487.8609 (1.0) 487.8609 (1.0) 0.0000 (1.0) 487.8609 (1.0) 0.0000 (1.0) 0;0 2.0498 (1.0) 1 1 test_diff-diff-changed-noop[2.18.1] 634.5941 (1.30) 634.5941 (1.30) 634.5941 (1.30) 0.0000 (1.0) 634.5941 (1.30) 0.0000 (1.0) 0;0 1.5758 (0.77) 1 1 test_diff-diff-changed-noop[2.39.0] 658.0914 (1.35) 658.0914 (1.35) 658.0914 (1.35) 0.0000 (1.0) 658.0914 (1.35) 0.0000 (1.0) 0;0 1.5195 (0.74) 1 1 test_diff-diff-changed-noop[2.40.0] 651.9705 (1.34) 651.9705 (1.34) 651.9705 (1.34) 0.0000 (1.0) 651.9705 (1.34) 0.0000 (1.0) 0;0 1.5338 (0.75) 1 1 test_diff-diff-changed-noop[2.41.1] 654.4275 (1.34) 654.4275 (1.34) 654.4275 (1.34) 0.0000 (1.0) 654.4275 (1.34) 0.0000 (1.0) 0;0 1.5281 (0.75) 1 1 test_diff-diff-changed-noop[2.45.0] 678.5220 (1.39) 678.5220 (1.39) 678.5220 (1.39) 0.0000 (1.0) 678.5220 (1.39) 0.0000 (1.0) 0;0 1.4738 (0.72) 1 1 test_diff-diff-changed-noop[main] 717.8353 (1.47) 717.8353 (1.47) 717.8353 (1.47) 0.0000 (1.0) 717.8353 (1.47) 0.0000 (1.0) 0;0 1.3931 (0.68) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.11.0] 448.7801 (1.0) 448.7801 (1.0) 448.7801 (1.0) 0.0000 (1.0) 448.7801 (1.0) 0.0000 (1.0) 0;0 2.2283 (1.0) 1 1 test_diff-diff-noop[2.18.1] 585.3959 (1.30) 585.3959 (1.30) 585.3959 (1.30) 0.0000 (1.0) 585.3959 (1.30) 0.0000 (1.0) 0;0 1.7082 (0.77) 1 1 test_diff-diff-noop[2.39.0] 835.3038 (1.86) 835.3038 (1.86) 835.3038 (1.86) 0.0000 (1.0) 835.3038 (1.86) 0.0000 (1.0) 0;0 1.1972 (0.54) 1 1 test_diff-diff-noop[2.40.0] 785.1120 (1.75) 785.1120 (1.75) 785.1120 (1.75) 0.0000 (1.0) 785.1120 (1.75) 0.0000 (1.0) 0;0 1.2737 (0.57) 1 1 test_diff-diff-noop[2.41.1] 617.6919 (1.38) 617.6919 (1.38) 617.6919 (1.38) 0.0000 (1.0) 617.6919 (1.38) 0.0000 (1.0) 0;0 1.6189 (0.73) 1 1 test_diff-diff-noop[2.45.0] 639.9257 (1.43) 639.9257 (1.43) 639.9257 (1.43) 0.0000 (1.0) 639.9257 (1.43) 0.0000 (1.0) 0;0 1.5627 (0.70) 1 1 test_diff-diff-noop[main] 672.9297 (1.50) 672.9297 (1.50) 672.9297 (1.50) 0.0000 (1.0) 672.9297 (1.50) 0.0000 (1.0) 0;0 1.4860 (0.67) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.11.0] 3.1704 (1.0) 3.1704 (1.0) 3.1704 (1.0) 0.0000 (1.0) 3.1704 (1.0) 0.0000 (1.0) 0;0 0.3154 (1.0) 1 1 test_checkout_copy-checkout[2.18.1] 3.2774 (1.03) 3.2774 (1.03) 3.2774 (1.03) 0.0000 (1.0) 3.2774 (1.03) 0.0000 (1.0) 0;0 0.3051 (0.97) 1 1 test_checkout_copy-checkout[2.39.0] 3.7813 (1.19) 3.7813 (1.19) 3.7813 (1.19) 0.0000 (1.0) 3.7813 (1.19) 0.0000 (1.0) 0;0 0.2645 (0.84) 1 1 test_checkout_copy-checkout[2.40.0] 3.6888 (1.16) 3.6888 (1.16) 3.6888 (1.16) 0.0000 (1.0) 3.6888 (1.16) 0.0000 (1.0) 0;0 0.2711 (0.86) 1 1 test_checkout_copy-checkout[2.41.1] 3.6931 (1.16) 3.6931 (1.16) 3.6931 (1.16) 0.0000 (1.0) 3.6931 (1.16) 0.0000 (1.0) 0;0 0.2708 (0.86) 1 1 test_checkout_copy-checkout[2.45.0] 3.9493 (1.25) 3.9493 (1.25) 3.9493 (1.25) 0.0000 (1.0) 3.9493 (1.25) 0.0000 (1.0) 0;0 0.2532 (0.80) 1 1 test_checkout_copy-checkout[main] 3.4797 (1.10) 3.4797 (1.10) 3.4797 (1.10) 0.0000 (1.0) 3.4797 (1.10) 0.0000 (1.0) 0;0 0.2874 (0.91) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.11.0] 481.1847 (1.0) 481.1847 (1.0) 481.1847 (1.0) 0.0000 (1.0) 481.1847 (1.0) 0.0000 (1.0) 0;0 2.0782 (1.0) 1 1 test_checkout_copy-checkout-noop[2.18.1] 560.2408 (1.16) 560.2408 (1.16) 560.2408 (1.16) 0.0000 (1.0) 560.2408 (1.16) 0.0000 (1.0) 0;0 1.7849 (0.86) 1 1 test_checkout_copy-checkout-noop[2.39.0] 582.7416 (1.21) 582.7416 (1.21) 582.7416 (1.21) 0.0000 (1.0) 582.7416 (1.21) 0.0000 (1.0) 0;0 1.7160 (0.83) 1 1 test_checkout_copy-checkout-noop[2.40.0] 579.3832 (1.20) 579.3832 (1.20) 579.3832 (1.20) 0.0000 (1.0) 579.3832 (1.20) 0.0000 (1.0) 0;0 1.7260 (0.83) 1 1 test_checkout_copy-checkout-noop[2.41.1] 582.5254 (1.21) 582.5254 (1.21) 582.5254 (1.21) 0.0000 (1.0) 582.5254 (1.21) 0.0000 (1.0) 0;0 1.7167 (0.83) 1 1 test_checkout_copy-checkout-noop[2.45.0] 600.1280 (1.25) 600.1280 (1.25) 600.1280 (1.25) 0.0000 (1.0) 600.1280 (1.25) 0.0000 (1.0) 0;0 1.6663 (0.80) 1 1 test_checkout_copy-checkout-noop[main] 683.8302 (1.42) 683.8302 (1.42) 683.8302 (1.42) 0.0000 (1.0) 683.8302 (1.42) 0.0000 (1.0) 0;0 1.4624 (0.70) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.11.0] 1.2650 (1.97) 1.2650 (1.97) 1.2650 (1.97) 0.0000 (1.0) 1.2650 (1.97) 0.0000 (1.0) 0;0 0.7905 (0.51) 1 1 test_checkout_copy-checkout-update[2.18.1] 0.6425 (1.0) 0.6425 (1.0) 0.6425 (1.0) 0.0000 (1.0) 0.6425 (1.0) 0.0000 (1.0) 0;0 1.5564 (1.0) 1 1 test_checkout_copy-checkout-update[2.39.0] 0.6578 (1.02) 0.6578 (1.02) 0.6578 (1.02) 0.0000 (1.0) 0.6578 (1.02) 0.0000 (1.0) 0;0 1.5203 (0.98) 1 1 test_checkout_copy-checkout-update[2.40.0] 0.6539 (1.02) 0.6539 (1.02) 0.6539 (1.02) 0.0000 (1.0) 0.6539 (1.02) 0.0000 (1.0) 0;0 1.5294 (0.98) 1 1 test_checkout_copy-checkout-update[2.41.1] 0.6531 (1.02) 0.6531 (1.02) 0.6531 (1.02) 0.0000 (1.0) 0.6531 (1.02) 0.0000 (1.0) 0;0 1.5312 (0.98) 1 1 test_checkout_copy-checkout-update[2.45.0] 0.6740 (1.05) 0.6740 (1.05) 0.6740 (1.05) 0.0000 (1.0) 0.6740 (1.05) 0.0000 (1.0) 0;0 1.4836 (0.95) 1 1 test_checkout_copy-checkout-update[main] 0.7435 (1.16) 0.7435 (1.16) 0.7435 (1.16) 0.0000 (1.0) 0.7435 (1.16) 0.0000 (1.0) 0;0 1.3449 (0.86) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.11.0] 10.9305 (1.52) 10.9305 (1.52) 10.9305 (1.52) 0.0000 (1.0) 10.9305 (1.52) 0.0000 (1.0) 0;0 0.0915 (0.66) 1 1 test_import-import[2.18.1] 10.4157 (1.45) 10.4157 (1.45) 10.4157 (1.45) 0.0000 (1.0) 10.4157 (1.45) 0.0000 (1.0) 0;0 0.0960 (0.69) 1 1 test_import-import[2.39.0] 8.8836 (1.24) 8.8836 (1.24) 8.8836 (1.24) 0.0000 (1.0) 8.8836 (1.24) 0.0000 (1.0) 0;0 0.1126 (0.81) 1 1 test_import-import[2.40.0] 8.7417 (1.22) 8.7417 (1.22) 8.7417 (1.22) 0.0000 (1.0) 8.7417 (1.22) 0.0000 (1.0) 0;0 0.1144 (0.82) 1 1 test_import-import[2.41.1] 8.6502 (1.20) 8.6502 (1.20) 8.6502 (1.20) 0.0000 (1.0) 8.6502 (1.20) 0.0000 (1.0) 0;0 0.1156 (0.83) 1 1 test_import-import[2.45.0] 7.1852 (1.0) 7.1852 (1.0) 7.1852 (1.0) 0.0000 (1.0) 7.1852 (1.0) 0.0000 (1.0) 0;0 0.1392 (1.0) 1 1 test_import-import[main] 8.0491 (1.12) 8.0491 (1.12) 8.0491 (1.12) 0.0000 (1.0) 8.0491 (1.12) 0.0000 (1.0) 0;0 0.1242 (0.89) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.11.0] 5.0999 (9.72) 5.0999 (9.72) 5.0999 (9.72) 0.0000 (1.0) 5.0999 (9.72) 0.0000 (1.0) 0;0 0.1961 (0.10) 1 1 test_partial_remove-add[2.18.1] 0.5247 (1.0) 0.5247 (1.0) 0.5247 (1.0) 0.0000 (1.0) 0.5247 (1.0) 0.0000 (1.0) 0;0 1.9058 (1.0) 1 1 test_partial_remove-add[2.39.0] 1.8636 (3.55) 1.8636 (3.55) 1.8636 (3.55) 0.0000 (1.0) 1.8636 (3.55) 0.0000 (1.0) 0;0 0.5366 (0.28) 1 1 test_partial_remove-add[2.40.0] 3.3003 (6.29) 3.3003 (6.29) 3.3003 (6.29) 0.0000 (1.0) 3.3003 (6.29) 0.0000 (1.0) 0;0 0.3030 (0.16) 1 1 test_partial_remove-add[2.41.1] 1.8885 (3.60) 1.8885 (3.60) 1.8885 (3.60) 0.0000 (1.0) 1.8885 (3.60) 0.0000 (1.0) 0;0 0.5295 (0.28) 1 1 test_partial_remove-add[2.45.0] 1.9003 (3.62) 1.9003 (3.62) 1.9003 (3.62) 0.0000 (1.0) 1.9003 (3.62) 0.0000 (1.0) 0;0 0.5262 (0.28) 1 1 test_partial_remove-add[main] 2.5656 (4.89) 2.5656 (4.89) 2.5656 (4.89) 0.0000 (1.0) 2.5656 (4.89) 0.0000 (1.0) 0;0 0.3898 (0.20) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.11.0] 405.2262 (1.0) 405.2262 (1.0) 405.2262 (1.0) 0.0000 (1.0) 405.2262 (1.0) 0.0000 (1.0) 0;0 2.4678 (1.0) 1 1 test_partial_remove-gc[2.18.1] 466.2599 (1.15) 466.2599 (1.15) 466.2599 (1.15) 0.0000 (1.0) 466.2599 (1.15) 0.0000 (1.0) 0;0 2.1447 (0.87) 1 1 test_partial_remove-gc[2.39.0] 489.3846 (1.21) 489.3846 (1.21) 489.3846 (1.21) 0.0000 (1.0) 489.3846 (1.21) 0.0000 (1.0) 0;0 2.0434 (0.83) 1 1 test_partial_remove-gc[2.40.0] 483.9722 (1.19) 483.9722 (1.19) 483.9722 (1.19) 0.0000 (1.0) 483.9722 (1.19) 0.0000 (1.0) 0;0 2.0662 (0.84) 1 1 test_partial_remove-gc[2.41.1] 490.5001 (1.21) 490.5001 (1.21) 490.5001 (1.21) 0.0000 (1.0) 490.5001 (1.21) 0.0000 (1.0) 0;0 2.0387 (0.83) 1 1 test_partial_remove-gc[2.45.0] 496.9766 (1.23) 496.9766 (1.23) 496.9766 (1.23) 0.0000 (1.0) 496.9766 (1.23) 0.0000 (1.0) 0;0 2.0122 (0.82) 1 1 test_partial_remove-gc[main] 551.5606 (1.36) 551.5606 (1.36) 551.5606 (1.36) 0.0000 (1.0) 551.5606 (1.36) 0.0000 (1.0) 0;0 1.8130 (0.73) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.11.0] 438.8855 (1.0) 438.8855 (1.0) 438.8855 (1.0) 0.0000 (1.0) 438.8855 (1.0) 0.0000 (1.0) 0;0 2.2785 (1.0) 1 1 test_partial_remove-gc-cloud[2.18.1] 477.7091 (1.09) 477.7091 (1.09) 477.7091 (1.09) 0.0000 (1.0) 477.7091 (1.09) 0.0000 (1.0) 0;0 2.0933 (0.92) 1 1 test_partial_remove-gc-cloud[2.39.0] 525.2709 (1.20) 525.2709 (1.20) 525.2709 (1.20) 0.0000 (1.0) 525.2709 (1.20) 0.0000 (1.0) 0;0 1.9038 (0.84) 1 1 test_partial_remove-gc-cloud[2.40.0] 515.0646 (1.17) 515.0646 (1.17) 515.0646 (1.17) 0.0000 (1.0) 515.0646 (1.17) 0.0000 (1.0) 0;0 1.9415 (0.85) 1 1 test_partial_remove-gc-cloud[2.41.1] 530.3865 (1.21) 530.3865 (1.21) 530.3865 (1.21) 0.0000 (1.0) 530.3865 (1.21) 0.0000 (1.0) 0;0 1.8854 (0.83) 1 1 test_partial_remove-gc-cloud[2.45.0] 529.7048 (1.21) 529.7048 (1.21) 529.7048 (1.21) 0.0000 (1.0) 529.7048 (1.21) 0.0000 (1.0) 0;0 1.8878 (0.83) 1 1 test_partial_remove-gc-cloud[main] 628.0002 (1.43) 628.0002 (1.43) 628.0002 (1.43) 0.0000 (1.0) 628.0002 (1.43) 0.0000 (1.0) 0;0 1.5924 (0.70) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.11.0] 456.5125 (1.22) 456.5125 (1.22) 456.5125 (1.22) 0.0000 (1.0) 456.5125 (1.22) 0.0000 (1.0) 0;0 2.1905 (0.82) 1 1 test_partial_remove-push[2.18.1] 374.5520 (1.0) 374.5520 (1.0) 374.5520 (1.0) 0.0000 (1.0) 374.5520 (1.0) 0.0000 (1.0) 0;0 2.6699 (1.0) 1 1 test_partial_remove-push[2.39.0] 471.6541 (1.26) 471.6541 (1.26) 471.6541 (1.26) 0.0000 (1.0) 471.6541 (1.26) 0.0000 (1.0) 0;0 2.1202 (0.79) 1 1 test_partial_remove-push[2.40.0] 494.3313 (1.32) 494.3313 (1.32) 494.3313 (1.32) 0.0000 (1.0) 494.3313 (1.32) 0.0000 (1.0) 0;0 2.0229 (0.76) 1 1 test_partial_remove-push[2.41.1] 476.3028 (1.27) 476.3028 (1.27) 476.3028 (1.27) 0.0000 (1.0) 476.3028 (1.27) 0.0000 (1.0) 0;0 2.0995 (0.79) 1 1 test_partial_remove-push[2.45.0] 484.3426 (1.29) 484.3426 (1.29) 484.3426 (1.29) 0.0000 (1.0) 484.3426 (1.29) 0.0000 (1.0) 0;0 2.0647 (0.77) 1 1 test_partial_remove-push[main] 544.6808 (1.45) 544.6808 (1.45) 544.6808 (1.45) 0.0000 (1.0) 544.6808 (1.45) 0.0000 (1.0) 0;0 1.8359 (0.69) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial-add[2.11.0] 5.5941 (1.82) 5.5941 (1.82) 5.5941 (1.82) 0.0000 (1.0) 5.5941 (1.82) 0.0000 (1.0) 0;0 0.1788 (0.55) 1 1 test_partial_add-add-partial-add[2.18.1] 4.8231 (1.57) 4.8231 (1.57) 4.8231 (1.57) 0.0000 (1.0) 4.8231 (1.57) 0.0000 (1.0) 0;0 0.2073 (0.64) 1 1 test_partial_add-add-partial-add[2.39.0] 4.1689 (1.35) 4.1689 (1.35) 4.1689 (1.35) 0.0000 (1.0) 4.1689 (1.35) 0.0000 (1.0) 0;0 0.2399 (0.74) 1 1 test_partial_add-add-partial-add[2.40.0] 5.3558 (1.74) 5.3558 (1.74) 5.3558 (1.74) 0.0000 (1.0) 5.3558 (1.74) 0.0000 (1.0) 0;0 0.1867 (0.57) 1 1 test_partial_add-add-partial-add[2.41.1] 5.3748 (1.75) 5.3748 (1.75) 5.3748 (1.75) 0.0000 (1.0) 5.3748 (1.75) 0.0000 (1.0) 0;0 0.1861 (0.57) 1 1 test_partial_add-add-partial-add[2.45.0] 3.4317 (1.11) 3.4317 (1.11) 3.4317 (1.11) 0.0000 (1.0) 3.4317 (1.11) 0.0000 (1.0) 0;0 0.2914 (0.90) 1 1 test_partial_add-add-partial-add[main] 3.0788 (1.0) 3.0788 (1.0) 3.0788 (1.0) 0.0000 (1.0) 3.0788 (1.0) 0.0000 (1.0) 0;0 0.3248 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.11.0] 459.2322 (1.0) 459.2322 (1.0) 459.2322 (1.0) 0.0000 (1.0) 459.2322 (1.0) 0.0000 (1.0) 0;0 2.1775 (1.0) 1 1 test_partial_add-gc-cloud-noop[2.18.1] 504.3341 (1.10) 504.3341 (1.10) 504.3341 (1.10) 0.0000 (1.0) 504.3341 (1.10) 0.0000 (1.0) 0;0 1.9828 (0.91) 1 1 test_partial_add-gc-cloud-noop[2.39.0] 538.2322 (1.17) 538.2322 (1.17) 538.2322 (1.17) 0.0000 (1.0) 538.2322 (1.17) 0.0000 (1.0) 0;0 1.8579 (0.85) 1 1 test_partial_add-gc-cloud-noop[2.40.0] 536.3609 (1.17) 536.3609 (1.17) 536.3609 (1.17) 0.0000 (1.0) 536.3609 (1.17) 0.0000 (1.0) 0;0 1.8644 (0.86) 1 1 test_partial_add-gc-cloud-noop[2.41.1] 542.7957 (1.18) 542.7957 (1.18) 542.7957 (1.18) 0.0000 (1.0) 542.7957 (1.18) 0.0000 (1.0) 0;0 1.8423 (0.85) 1 1 test_partial_add-gc-cloud-noop[2.45.0] 527.1060 (1.15) 527.1060 (1.15) 527.1060 (1.15) 0.0000 (1.0) 527.1060 (1.15) 0.0000 (1.0) 0;0 1.8972 (0.87) 1 1 test_partial_add-gc-cloud-noop[main] 609.7310 (1.33) 609.7310 (1.33) 609.7310 (1.33) 0.0000 (1.0) 609.7310 (1.33) 0.0000 (1.0) 0;0 1.6401 (0.75) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.11.0] 404.1660 (1.0) 404.1660 (1.0) 404.1660 (1.0) 0.0000 (1.0) 404.1660 (1.0) 0.0000 (1.0) 0;0 2.4742 (1.0) 1 1 test_partial_add-gc-noop[2.18.1] 447.0912 (1.11) 447.0912 (1.11) 447.0912 (1.11) 0.0000 (1.0) 447.0912 (1.11) 0.0000 (1.0) 0;0 2.2367 (0.90) 1 1 test_partial_add-gc-noop[2.39.0] 478.2156 (1.18) 478.2156 (1.18) 478.2156 (1.18) 0.0000 (1.0) 478.2156 (1.18) 0.0000 (1.0) 0;0 2.0911 (0.85) 1 1 test_partial_add-gc-noop[2.40.0] 483.0726 (1.20) 483.0726 (1.20) 483.0726 (1.20) 0.0000 (1.0) 483.0726 (1.20) 0.0000 (1.0) 0;0 2.0701 (0.84) 1 1 test_partial_add-gc-noop[2.41.1] 488.4514 (1.21) 488.4514 (1.21) 488.4514 (1.21) 0.0000 (1.0) 488.4514 (1.21) 0.0000 (1.0) 0;0 2.0473 (0.83) 1 1 test_partial_add-gc-noop[2.45.0] 471.9748 (1.17) 471.9748 (1.17) 471.9748 (1.17) 0.0000 (1.0) 471.9748 (1.17) 0.0000 (1.0) 0;0 2.1188 (0.86) 1 1 test_partial_add-gc-noop[main] 543.3436 (1.34) 543.3436 (1.34) 543.3436 (1.34) 0.0000 (1.0) 543.3436 (1.34) 0.0000 (1.0) 0;0 1.8405 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial-add[2.11.0] 2.0670 (1.07) 2.0670 (1.07) 2.0670 (1.07) 0.0000 (1.0) 2.0670 (1.07) 0.0000 (1.0) 0;0 0.4838 (0.93) 1 1 test_partial_add-push-partial-add[2.18.1] 2.0506 (1.06) 2.0506 (1.06) 2.0506 (1.06) 0.0000 (1.0) 2.0506 (1.06) 0.0000 (1.0) 0;0 0.4877 (0.94) 1 1 test_partial_add-push-partial-add[2.39.0] 2.5664 (1.33) 2.5664 (1.33) 2.5664 (1.33) 0.0000 (1.0) 2.5664 (1.33) 0.0000 (1.0) 0;0 0.3897 (0.75) 1 1 test_partial_add-push-partial-add[2.40.0] 4.6778 (2.43) 4.6778 (2.43) 4.6778 (2.43) 0.0000 (1.0) 4.6778 (2.43) 0.0000 (1.0) 0;0 0.2138 (0.41) 1 1 test_partial_add-push-partial-add[2.41.1] 4.7065 (2.44) 4.7065 (2.44) 4.7065 (2.44) 0.0000 (1.0) 4.7065 (2.44) 0.0000 (1.0) 0;0 0.2125 (0.41) 1 1 test_partial_add-push-partial-add[2.45.0] 3.1578 (1.64) 3.1578 (1.64) 3.1578 (1.64) 0.0000 (1.0) 3.1578 (1.64) 0.0000 (1.0) 0;0 0.3167 (0.61) 1 1 test_partial_add-push-partial-add[main] 1.9274 (1.0) 1.9274 (1.0) 1.9274 (1.0) 0.0000 (1.0) 1.9274 (1.0) 0.0000 (1.0) 0;0 0.5188 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 year ago 
github-actions[bot]
commented
1 year ago