Closed dberenbaum closed 1 year ago
Mon Aug 21 19:32:38 UTC 2023 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[2.11.0] 6.8143 (1.79) 6.8143 (1.79) 6.8143 (1.79) 0.0000 (1.0) 6.8143 (1.79) 0.0000 (1.0) 0;0 0.1468 (0.56) 1 1 test_add-add[2.40.0] 5.6027 (1.47) 5.6027 (1.47) 5.6027 (1.47) 0.0000 (1.0) 5.6027 (1.47) 0.0000 (1.0) 0;0 0.1785 (0.68) 1 1 test_add-add[2.58.2] 3.8027 (1.0) 3.8027 (1.0) 3.8027 (1.0) 0.0000 (1.0) 3.8027 (1.0) 0.0000 (1.0) 0;0 0.2630 (1.0) 1 1 test_add-add[3.0.0] 3.9058 (1.03) 3.9058 (1.03) 3.9058 (1.03) 0.0000 (1.0) 3.9058 (1.03) 0.0000 (1.0) 0;0 0.2560 (0.97) 1 1 test_add-add[main] 3.8477 (1.01) 3.8477 (1.01) 3.8477 (1.01) 0.0000 (1.0) 3.8477 (1.01) 0.0000 (1.0) 0;0 0.2599 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.40.0] 693.3352 (1.01) 693.3352 (1.01) 693.3352 (1.01) 0.0000 (1.0) 693.3352 (1.01) 0.0000 (1.0) 0;0 1.4423 (0.99) 1 1 test_data_status-data-changed[2.58.2] 730.3386 (1.06) 730.3386 (1.06) 730.3386 (1.06) 0.0000 (1.0) 730.3386 (1.06) 0.0000 (1.0) 0;0 1.3692 (0.94) 1 1 test_data_status-data-changed[3.0.0] 723.2169 (1.05) 723.2169 (1.05) 723.2169 (1.05) 0.0000 (1.0) 723.2169 (1.05) 0.0000 (1.0) 0;0 1.3827 (0.95) 1 1 test_data_status-data-changed[main] 685.9446 (1.0) 685.9446 (1.0) 685.9446 (1.0) 0.0000 (1.0) 685.9446 (1.0) 0.0000 (1.0) 0;0 1.4578 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.40.0] 683.0003 (1.0) 683.0003 (1.0) 683.0003 (1.0) 0.0000 (1.0) 683.0003 (1.0) 0.0000 (1.0) 0;0 1.4641 (1.0) 1 1 test_data_status-data-changed-noop[2.58.2] 728.8225 (1.07) 728.8225 (1.07) 728.8225 (1.07) 0.0000 (1.0) 728.8225 (1.07) 0.0000 (1.0) 0;0 1.3721 (0.94) 1 1 test_data_status-data-changed-noop[3.0.0] 725.1633 (1.06) 725.1633 (1.06) 725.1633 (1.06) 0.0000 (1.0) 725.1633 (1.06) 0.0000 (1.0) 0;0 1.3790 (0.94) 1 1 test_data_status-data-changed-noop[main] 683.6247 (1.00) 683.6247 (1.00) 683.6247 (1.00) 0.0000 (1.0) 683.6247 (1.00) 0.0000 (1.0) 0;0 1.4628 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.40.0] 1.5563 (1.13) 1.5563 (1.13) 1.5563 (1.13) 0.0000 (1.0) 1.5563 (1.13) 0.0000 (1.0) 0;0 0.6426 (0.89) 1 1 test_data_status-data-new[2.58.2] 1.4378 (1.04) 1.4378 (1.04) 1.4378 (1.04) 0.0000 (1.0) 1.4378 (1.04) 0.0000 (1.0) 0;0 0.6955 (0.96) 1 1 test_data_status-data-new[3.0.0] 1.4434 (1.04) 1.4434 (1.04) 1.4434 (1.04) 0.0000 (1.0) 1.4434 (1.04) 0.0000 (1.0) 0;0 0.6928 (0.96) 1 1 test_data_status-data-new[main] 1.3833 (1.0) 1.3833 (1.0) 1.3833 (1.0) 0.0000 (1.0) 1.3833 (1.0) 0.0000 (1.0) 0;0 0.7229 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.40.0] 686.9767 (1.0) 686.9767 (1.0) 686.9767 (1.0) 0.0000 (1.0) 686.9767 (1.0) 0.0000 (1.0) 0;0 1.4557 (1.0) 1 1 test_data_status-data-noop[2.58.2] 716.9066 (1.04) 716.9066 (1.04) 716.9066 (1.04) 0.0000 (1.0) 716.9066 (1.04) 0.0000 (1.0) 0;0 1.3949 (0.96) 1 1 test_data_status-data-noop[3.0.0] 721.8712 (1.05) 721.8712 (1.05) 721.8712 (1.05) 0.0000 (1.0) 721.8712 (1.05) 0.0000 (1.0) 0;0 1.3853 (0.95) 1 1 test_data_status-data-noop[main] 765.2769 (1.11) 765.2769 (1.11) 765.2769 (1.11) 0.0000 (1.0) 765.2769 (1.11) 0.0000 (1.0) 0;0 1.3067 (0.90) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.11.0] 6.7993 (1.33) 6.7993 (1.33) 6.7993 (1.33) 0.0000 (1.0) 6.7993 (1.33) 0.0000 (1.0) 0;0 0.1471 (0.75) 1 1 test_get-get[2.40.0] 5.1233 (1.0) 5.1233 (1.0) 5.1233 (1.0) 0.0000 (1.0) 5.1233 (1.0) 0.0000 (1.0) 0;0 0.1952 (1.0) 1 1 test_get-get[2.58.2] 8.4169 (1.64) 8.4169 (1.64) 8.4169 (1.64) 0.0000 (1.0) 8.4169 (1.64) 0.0000 (1.0) 0;0 0.1188 (0.61) 1 1 test_get-get[3.0.0] 8.3884 (1.64) 8.3884 (1.64) 8.3884 (1.64) 0.0000 (1.0) 8.3884 (1.64) 0.0000 (1.0) 0;0 0.1192 (0.61) 1 1 test_get-get[main] 10.1168 (1.97) 10.1168 (1.97) 10.1168 (1.97) 0.0000 (1.0) 10.1168 (1.97) 0.0000 (1.0) 0;0 0.0988 (0.51) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.11.0] 3.8851 (1.54) 3.8851 (1.54) 3.8851 (1.54) 0.0000 (1.0) 3.8851 (1.54) 0.0000 (1.0) 0;0 0.2574 (0.65) 1 1 test_checkout_copy-checkout[2.40.0] 3.9954 (1.59) 3.9954 (1.59) 3.9954 (1.59) 0.0000 (1.0) 3.9954 (1.59) 0.0000 (1.0) 0;0 0.2503 (0.63) 1 1 test_checkout_copy-checkout[2.58.2] 2.5149 (1.0) 2.5149 (1.0) 2.5149 (1.0) 0.0000 (1.0) 2.5149 (1.0) 0.0000 (1.0) 0;0 0.3976 (1.0) 1 1 test_checkout_copy-checkout[3.0.0] 5.1156 (2.03) 5.1156 (2.03) 5.1156 (2.03) 0.0000 (1.0) 5.1156 (2.03) 0.0000 (1.0) 0;0 0.1955 (0.49) 1 1 test_checkout_copy-checkout[main] 5.1069 (2.03) 5.1069 (2.03) 5.1069 (2.03) 0.0000 (1.0) 5.1069 (2.03) 0.0000 (1.0) 0;0 0.1958 (0.49) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.11.0] 590.0024 (1.0) 590.0024 (1.0) 590.0024 (1.0) 0.0000 (1.0) 590.0024 (1.0) 0.0000 (1.0) 0;0 1.6949 (1.0) 1 1 test_checkout_copy-checkout-noop[2.40.0] 746.1057 (1.26) 746.1057 (1.26) 746.1057 (1.26) 0.0000 (1.0) 746.1057 (1.26) 0.0000 (1.0) 0;0 1.3403 (0.79) 1 1 test_checkout_copy-checkout-noop[2.58.2] 826.4620 (1.40) 826.4620 (1.40) 826.4620 (1.40) 0.0000 (1.0) 826.4620 (1.40) 0.0000 (1.0) 0;0 1.2100 (0.71) 1 1 test_checkout_copy-checkout-noop[3.0.0] 905.6912 (1.54) 905.6912 (1.54) 905.6912 (1.54) 0.0000 (1.0) 905.6912 (1.54) 0.0000 (1.0) 0;0 1.1041 (0.65) 1 1 test_checkout_copy-checkout-noop[main] 887.8172 (1.50) 887.8172 (1.50) 887.8172 (1.50) 0.0000 (1.0) 887.8172 (1.50) 0.0000 (1.0) 0;0 1.1264 (0.66) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.11.0] 1.6097 (1.91) 1.6097 (1.91) 1.6097 (1.91) 0.0000 (1.0) 1.6097 (1.91) 0.0000 (1.0) 0;0 0.6212 (0.52) 1 1 test_checkout_copy-checkout-update[2.40.0] 0.8408 (1.0) 0.8408 (1.0) 0.8408 (1.0) 0.0000 (1.0) 0.8408 (1.0) 0.0000 (1.0) 0;0 1.1893 (1.0) 1 1 test_checkout_copy-checkout-update[2.58.2] 1.1618 (1.38) 1.1618 (1.38) 1.1618 (1.38) 0.0000 (1.0) 1.1618 (1.38) 0.0000 (1.0) 0;0 0.8607 (0.72) 1 1 test_checkout_copy-checkout-update[3.0.0] 0.9875 (1.17) 0.9875 (1.17) 0.9875 (1.17) 0.0000 (1.0) 0.9875 (1.17) 0.0000 (1.0) 0;0 1.0127 (0.85) 1 1 test_checkout_copy-checkout-update[main] 0.9587 (1.14) 0.9587 (1.14) 0.9587 (1.14) 0.0000 (1.0) 0.9587 (1.14) 0.0000 (1.0) 0;0 1.0430 (0.88) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.11.0] 459.8648 (1.0) 459.8648 (1.0) 459.8648 (1.0) 0.0000 (1.0) 459.8648 (1.0) 0.0000 (1.0) 0;0 2.1746 (1.0) 1 1 test_gc-gc[2.40.0] 514.0225 (1.12) 514.0225 (1.12) 514.0225 (1.12) 0.0000 (1.0) 514.0225 (1.12) 0.0000 (1.0) 0;0 1.9454 (0.89) 1 1 test_gc-gc[2.58.2] 640.6238 (1.39) 640.6238 (1.39) 640.6238 (1.39) 0.0000 (1.0) 640.6238 (1.39) 0.0000 (1.0) 0;0 1.5610 (0.72) 1 1 test_gc-gc[3.0.0] 607.7000 (1.32) 607.7000 (1.32) 607.7000 (1.32) 0.0000 (1.0) 607.7000 (1.32) 0.0000 (1.0) 0;0 1.6455 (0.76) 1 1 test_gc-gc[main] 616.1039 (1.34) 616.1039 (1.34) 616.1039 (1.34) 0.0000 (1.0) 616.1039 (1.34) 0.0000 (1.0) 0;0 1.6231 (0.75) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.11.0] 1.7155 (1.12) 1.7155 (1.12) 1.7155 (1.12) 0.0000 (1.0) 1.7155 (1.12) 0.0000 (1.0) 0;0 0.5829 (0.90) 1 1 test_checkout_symlink-checkout[2.40.0] 1.6129 (1.05) 1.6129 (1.05) 1.6129 (1.05) 0.0000 (1.0) 1.6129 (1.05) 0.0000 (1.0) 0;0 0.6200 (0.95) 1 1 test_checkout_symlink-checkout[2.58.2] 1.8208 (1.19) 1.8208 (1.19) 1.8208 (1.19) 0.0000 (1.0) 1.8208 (1.19) 0.0000 (1.0) 0;0 0.5492 (0.84) 1 1 test_checkout_symlink-checkout[3.0.0] 1.6400 (1.07) 1.6400 (1.07) 1.6400 (1.07) 0.0000 (1.0) 1.6400 (1.07) 0.0000 (1.0) 0;0 0.6097 (0.94) 1 1 test_checkout_symlink-checkout[main] 1.5365 (1.0) 1.5365 (1.0) 1.5365 (1.0) 0.0000 (1.0) 1.5365 (1.0) 0.0000 (1.0) 0;0 0.6508 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.11.0] 627.5145 (1.0) 627.5145 (1.0) 627.5145 (1.0) 0.0000 (1.0) 627.5145 (1.0) 0.0000 (1.0) 0;0 1.5936 (1.0) 1 1 test_checkout_symlink-checkout-noop[2.40.0] 717.9159 (1.14) 717.9159 (1.14) 717.9159 (1.14) 0.0000 (1.0) 717.9159 (1.14) 0.0000 (1.0) 0;0 1.3929 (0.87) 1 1 test_checkout_symlink-checkout-noop[2.58.2] 816.7434 (1.30) 816.7434 (1.30) 816.7434 (1.30) 0.0000 (1.0) 816.7434 (1.30) 0.0000 (1.0) 0;0 1.2244 (0.77) 1 1 test_checkout_symlink-checkout-noop[3.0.0] 865.2626 (1.38) 865.2626 (1.38) 865.2626 (1.38) 0.0000 (1.0) 865.2626 (1.38) 0.0000 (1.0) 0;0 1.1557 (0.73) 1 1 test_checkout_symlink-checkout-noop[main] 852.9530 (1.36) 852.9530 (1.36) 852.9530 (1.36) 0.0000 (1.0) 852.9530 (1.36) 0.0000 (1.0) 0;0 1.1724 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-update[2.11.0] 1.7244 (2.08) 1.7244 (2.08) 1.7244 (2.08) 0.0000 (1.0) 1.7244 (2.08) 0.0000 (1.0) 0;0 0.5799 (0.48) 1 1 test_checkout_symlink-checkout-update[2.40.0] 0.8284 (1.0) 0.8284 (1.0) 0.8284 (1.0) 0.0000 (1.0) 0.8284 (1.0) 0.0000 (1.0) 0;0 1.2071 (1.0) 1 1 test_checkout_symlink-checkout-update[2.58.2] 1.1029 (1.33) 1.1029 (1.33) 1.1029 (1.33) 0.0000 (1.0) 1.1029 (1.33) 0.0000 (1.0) 0;0 0.9067 (0.75) 1 1 test_checkout_symlink-checkout-update[3.0.0] 0.9880 (1.19) 0.9880 (1.19) 0.9880 (1.19) 0.0000 (1.0) 0.9880 (1.19) 0.0000 (1.0) 0;0 1.0122 (0.84) 1 1 test_checkout_symlink-checkout-update[main] 0.9666 (1.17) 0.9666 (1.17) 0.9666 (1.17) 0.0000 (1.0) 0.9666 (1.17) 0.0000 (1.0) 0;0 1.0345 (0.86) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_pull-pull': 5 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_pull-pull[2.11.0] 10.5711 (1.31) 10.5711 (1.31) 10.5711 (1.31) 0.0000 (1.0) 10.5711 (1.31) 0.0000 (1.0) 0;0 0.0946 (0.77) 1 1 test_pull-pull[2.40.0] 12.5771 (1.55) 12.5771 (1.55) 12.5771 (1.55) 0.0000 (1.0) 12.5771 (1.55) 0.0000 (1.0) 0;0 0.0795 (0.64) 1 1 test_pull-pull[2.58.2] 8.0909 (1.0) 8.0909 (1.0) 8.0909 (1.0) 0.0000 (1.0) 8.0909 (1.0) 0.0000 (1.0) 0;0 0.1236 (1.0) 1 1 test_pull-pull[3.0.0] 12.2652 (1.52) 12.2652 (1.52) 12.2652 (1.52) 0.0000 (1.0) 12.2652 (1.52) 0.0000 (1.0) 0;0 0.0815 (0.66) 1 1 test_pull-pull[main] 11.5502 (1.43) 11.5502 (1.43) 11.5502 (1.43) 0.0000 (1.0) 11.5502 (1.43) 0.0000 (1.0) 0;0 0.0866 (0.70) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.11.0] 8.5856 (1.87) 8.5856 (1.87) 8.5856 (1.87) 0.0000 (1.0) 8.5856 (1.87) 0.0000 (1.0) 0;0 0.1165 (0.53) 1 1 test_sharing-add[2.40.0] 6.8109 (1.48) 6.8109 (1.48) 6.8109 (1.48) 0.0000 (1.0) 6.8109 (1.48) 0.0000 (1.0) 0;0 0.1468 (0.67) 1 1 test_sharing-add[2.58.2] 4.7026 (1.03) 4.7026 (1.03) 4.7026 (1.03) 0.0000 (1.0) 4.7026 (1.03) 0.0000 (1.0) 0;0 0.2126 (0.98) 1 1 test_sharing-add[3.0.0] 4.5877 (1.0) 4.5877 (1.0) 4.5877 (1.0) 0.0000 (1.0) 4.5877 (1.0) 0.0000 (1.0) 0;0 0.2180 (1.0) 1 1 test_sharing-add[main] 4.6718 (1.02) 4.6718 (1.02) 4.6718 (1.02) 0.0000 (1.0) 4.6718 (1.02) 0.0000 (1.0) 0;0 0.2141 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.11.0] 4.0198 (1.41) 4.0198 (1.41) 4.0198 (1.41) 0.0000 (1.0) 4.0198 (1.41) 0.0000 (1.0) 0;0 0.2488 (0.71) 1 1 test_sharing-add-noop[2.40.0] 2.8601 (1.0) 2.8601 (1.0) 2.8601 (1.0) 0.0000 (1.0) 2.8601 (1.0) 0.0000 (1.0) 0;0 0.3496 (1.0) 1 1 test_sharing-add-noop[2.58.2] 3.1123 (1.09) 3.1123 (1.09) 3.1123 (1.09) 0.0000 (1.0) 3.1123 (1.09) 0.0000 (1.0) 0;0 0.3213 (0.92) 1 1 test_sharing-add-noop[3.0.0] 3.1109 (1.09) 3.1109 (1.09) 3.1109 (1.09) 0.0000 (1.0) 3.1109 (1.09) 0.0000 (1.0) 0;0 0.3215 (0.92) 1 1 test_sharing-add-noop[main] 3.1451 (1.10) 3.1451 (1.10) 3.1451 (1.10) 0.0000 (1.0) 3.1451 (1.10) 0.0000 (1.0) 0;0 0.3180 (0.91) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.11.0] 555.2222 (1.0) 555.2222 (1.0) 555.2222 (1.0) 0.0000 (1.0) 555.2222 (1.0) 0.0000 (1.0) 0;0 1.8011 (1.0) 1 1 test_sharing-checkout-noop[2.40.0] 661.0521 (1.19) 661.0521 (1.19) 661.0521 (1.19) 0.0000 (1.0) 661.0521 (1.19) 0.0000 (1.0) 0;0 1.5127 (0.84) 1 1 test_sharing-checkout-noop[2.58.2] 759.3240 (1.37) 759.3240 (1.37) 759.3240 (1.37) 0.0000 (1.0) 759.3240 (1.37) 0.0000 (1.0) 0;0 1.3170 (0.73) 1 1 test_sharing-checkout-noop[3.0.0] 780.0192 (1.40) 780.0192 (1.40) 780.0192 (1.40) 0.0000 (1.0) 780.0192 (1.40) 0.0000 (1.0) 0;0 1.2820 (0.71) 1 1 test_sharing-checkout-noop[main] 799.4039 (1.44) 799.4039 (1.44) 799.4039 (1.44) 0.0000 (1.0) 799.4039 (1.44) 0.0000 (1.0) 0;0 1.2509 (0.69) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-pull': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[2.11.0] 8.3096 (1.34) 8.3096 (1.34) 8.3096 (1.34) 0.0000 (1.0) 8.3096 (1.34) 0.0000 (1.0) 0;0 0.1203 (0.74) 1 1 test_sharing-pull[2.40.0] 9.7191 (1.57) 9.7191 (1.57) 9.7191 (1.57) 0.0000 (1.0) 9.7191 (1.57) 0.0000 (1.0) 0;0 0.1029 (0.64) 1 1 test_sharing-pull[2.58.2] 6.1852 (1.0) 6.1852 (1.0) 6.1852 (1.0) 0.0000 (1.0) 6.1852 (1.0) 0.0000 (1.0) 0;0 0.1617 (1.0) 1 1 test_sharing-pull[3.0.0] 8.7723 (1.42) 8.7723 (1.42) 8.7723 (1.42) 0.0000 (1.0) 8.7723 (1.42) 0.0000 (1.0) 0;0 0.1140 (0.71) 1 1 test_sharing-pull[main] 8.9151 (1.44) 8.9151 (1.44) 8.9151 (1.44) 0.0000 (1.0) 8.9151 (1.44) 0.0000 (1.0) 0;0 0.1122 (0.69) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[2.11.0] 598.2856 (1.0) 598.2856 (1.0) 598.2856 (1.0) 0.0000 (1.0) 598.2856 (1.0) 0.0000 (1.0) 0;0 1.6714 (1.0) 1 1 test_sharing-pull-noop[2.40.0] 711.0888 (1.19) 711.0888 (1.19) 711.0888 (1.19) 0.0000 (1.0) 711.0888 (1.19) 0.0000 (1.0) 0;0 1.4063 (0.84) 1 1 test_sharing-pull-noop[2.58.2] 816.1054 (1.36) 816.1054 (1.36) 816.1054 (1.36) 0.0000 (1.0) 816.1054 (1.36) 0.0000 (1.0) 0;0 1.2253 (0.73) 1 1 test_sharing-pull-noop[3.0.0] 947.7387 (1.58) 947.7387 (1.58) 947.7387 (1.58) 0.0000 (1.0) 947.7387 (1.58) 0.0000 (1.0) 0;0 1.0551 (0.63) 1 1 test_sharing-pull-noop[main] 967.0345 (1.62) 967.0345 (1.62) 967.0345 (1.62) 0.0000 (1.0) 967.0345 (1.62) 0.0000 (1.0) 0;0 1.0341 (0.62) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.11.0] 4.5588 (2.32) 4.5588 (2.32) 4.5588 (2.32) 0.0000 (1.0) 4.5588 (2.32) 0.0000 (1.0) 0;0 0.2194 (0.43) 1 1 test_sharing-push[2.40.0] 5.6920 (2.90) 5.6920 (2.90) 5.6920 (2.90) 0.0000 (1.0) 5.6920 (2.90) 0.0000 (1.0) 0;0 0.1757 (0.34) 1 1 test_sharing-push[2.58.2] 4.0339 (2.06) 4.0339 (2.06) 4.0339 (2.06) 0.0000 (1.0) 4.0339 (2.06) 0.0000 (1.0) 0;0 0.2479 (0.49) 1 1 test_sharing-push[3.0.0] 1.9612 (1.0) 1.9612 (1.0) 1.9612 (1.0) 0.0000 (1.0) 1.9612 (1.0) 0.0000 (1.0) 0;0 0.5099 (1.0) 1 1 test_sharing-push[main] 4.0645 (2.07) 4.0645 (2.07) 4.0645 (2.07) 0.0000 (1.0) 4.0645 (2.07) 0.0000 (1.0) 0;0 0.2460 (0.48) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.11.0] 512.1252 (1.0) 512.1252 (1.0) 512.1252 (1.0) 0.0000 (1.0) 512.1252 (1.0) 0.0000 (1.0) 0;0 1.9526 (1.0) 1 1 test_sharing-push-noop[2.40.0] 552.7121 (1.08) 552.7121 (1.08) 552.7121 (1.08) 0.0000 (1.0) 552.7121 (1.08) 0.0000 (1.0) 0;0 1.8093 (0.93) 1 1 test_sharing-push-noop[2.58.2] 649.7622 (1.27) 649.7622 (1.27) 649.7622 (1.27) 0.0000 (1.0) 649.7622 (1.27) 0.0000 (1.0) 0;0 1.5390 (0.79) 1 1 test_sharing-push-noop[3.0.0] 633.6377 (1.24) 633.6377 (1.24) 633.6377 (1.24) 0.0000 (1.0) 633.6377 (1.24) 0.0000 (1.0) 0;0 1.5782 (0.81) 1 1 test_sharing-push-noop[main] 645.4661 (1.26) 645.4661 (1.26) 645.4661 (1.26) 0.0000 (1.0) 645.4661 (1.26) 0.0000 (1.0) 0;0 1.5493 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.11.0] 1.6912 (1.18) 1.6912 (1.18) 1.6912 (1.18) 0.0000 (1.0) 1.6912 (1.18) 0.0000 (1.0) 0;0 0.5913 (0.84) 1 1 test_diff-diff[2.40.0] 1.4753 (1.03) 1.4753 (1.03) 1.4753 (1.03) 0.0000 (1.0) 1.4753 (1.03) 0.0000 (1.0) 0;0 0.6778 (0.97) 1 1 test_diff-diff[2.58.2] 1.4552 (1.02) 1.4552 (1.02) 1.4552 (1.02) 0.0000 (1.0) 1.4552 (1.02) 0.0000 (1.0) 0;0 0.6872 (0.98) 1 1 test_diff-diff[3.0.0] 1.4390 (1.01) 1.4390 (1.01) 1.4390 (1.01) 0.0000 (1.0) 1.4390 (1.01) 0.0000 (1.0) 0;0 0.6949 (0.99) 1 1 test_diff-diff[main] 1.4279 (1.0) 1.4279 (1.0) 1.4279 (1.0) 0.0000 (1.0) 1.4279 (1.0) 0.0000 (1.0) 0;0 0.7003 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.11.0] 1.1562 (1.67) 1.1562 (1.67) 1.1562 (1.67) 0.0000 (1.0) 1.1562 (1.67) 0.0000 (1.0) 0;0 0.8649 (0.60) 1 1 test_diff-diff-changed[2.40.0] 0.6923 (1.0) 0.6923 (1.0) 0.6923 (1.0) 0.0000 (1.0) 0.6923 (1.0) 0.0000 (1.0) 0;0 1.4446 (1.0) 1 1 test_diff-diff-changed[2.58.2] 0.8606 (1.24) 0.8606 (1.24) 0.8606 (1.24) 0.0000 (1.0) 0.8606 (1.24) 0.0000 (1.0) 0;0 1.1620 (0.80) 1 1 test_diff-diff-changed[3.0.0] 0.8148 (1.18) 0.8148 (1.18) 0.8148 (1.18) 0.0000 (1.0) 0.8148 (1.18) 0.0000 (1.0) 0;0 1.2274 (0.85) 1 1 test_diff-diff-changed[main] 0.8323 (1.20) 0.8323 (1.20) 0.8323 (1.20) 0.0000 (1.0) 0.8323 (1.20) 0.0000 (1.0) 0;0 1.2015 (0.83) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.11.0] 531.5085 (1.0) 531.5085 (1.0) 531.5085 (1.0) 0.0000 (1.0) 531.5085 (1.0) 0.0000 (1.0) 0;0 1.8814 (1.0) 1 1 test_diff-diff-changed-noop[2.40.0] 740.8241 (1.39) 740.8241 (1.39) 740.8241 (1.39) 0.0000 (1.0) 740.8241 (1.39) 0.0000 (1.0) 0;0 1.3498 (0.72) 1 1 test_diff-diff-changed-noop[2.58.2] 781.5397 (1.47) 781.5397 (1.47) 781.5397 (1.47) 0.0000 (1.0) 781.5397 (1.47) 0.0000 (1.0) 0;0 1.2795 (0.68) 1 1 test_diff-diff-changed-noop[3.0.0] 788.9112 (1.48) 788.9112 (1.48) 788.9112 (1.48) 0.0000 (1.0) 788.9112 (1.48) 0.0000 (1.0) 0;0 1.2676 (0.67) 1 1 test_diff-diff-changed-noop[main] 795.7995 (1.50) 795.7995 (1.50) 795.7995 (1.50) 0.0000 (1.0) 795.7995 (1.50) 0.0000 (1.0) 0;0 1.2566 (0.67) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.11.0] 480.1191 (1.0) 480.1191 (1.0) 480.1191 (1.0) 0.0000 (1.0) 480.1191 (1.0) 0.0000 (1.0) 0;0 2.0828 (1.0) 1 1 test_diff-diff-noop[2.40.0] 664.9937 (1.39) 664.9937 (1.39) 664.9937 (1.39) 0.0000 (1.0) 664.9937 (1.39) 0.0000 (1.0) 0;0 1.5038 (0.72) 1 1 test_diff-diff-noop[2.58.2] 733.8438 (1.53) 733.8438 (1.53) 733.8438 (1.53) 0.0000 (1.0) 733.8438 (1.53) 0.0000 (1.0) 0;0 1.3627 (0.65) 1 1 test_diff-diff-noop[3.0.0] 740.5205 (1.54) 740.5205 (1.54) 740.5205 (1.54) 0.0000 (1.0) 740.5205 (1.54) 0.0000 (1.0) 0;0 1.3504 (0.65) 1 1 test_diff-diff-noop[main] 739.4204 (1.54) 739.4204 (1.54) 739.4204 (1.54) 0.0000 (1.0) 739.4204 (1.54) 0.0000 (1.0) 0;0 1.3524 (0.65) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.11.0] 11.7578 (1.41) 11.7578 (1.41) 11.7578 (1.41) 0.0000 (1.0) 11.7578 (1.41) 0.0000 (1.0) 0;0 0.0851 (0.71) 1 1 test_import_url-import-url[2.40.0] 9.9640 (1.20) 9.9640 (1.20) 9.9640 (1.20) 0.0000 (1.0) 9.9640 (1.20) 0.0000 (1.0) 0;0 0.1004 (0.83) 1 1 test_import_url-import-url[2.58.2] 8.6509 (1.04) 8.6509 (1.04) 8.6509 (1.04) 0.0000 (1.0) 8.6509 (1.04) 0.0000 (1.0) 0;0 0.1156 (0.96) 1 1 test_import_url-import-url[3.0.0] 8.6298 (1.04) 8.6298 (1.04) 8.6298 (1.04) 0.0000 (1.0) 8.6298 (1.04) 0.0000 (1.0) 0;0 0.1159 (0.96) 1 1 test_import_url-import-url[main] 8.3126 (1.0) 8.3126 (1.0) 8.3126 (1.0) 0.0000 (1.0) 8.3126 (1.0) 0.0000 (1.0) 0;0 0.1203 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.40.0] 733.9268 (1.0) 761.8982 (1.0) 745.8095 (1.0) 10.5355 (1.56) 744.9120 (1.0) 13.5026 (1.81) 2;0 1.3408 (1.0) 5 3 test_plots-plots-diff[2.58.2] 788.6551 (1.07) 807.2754 (1.06) 797.1316 (1.07) 6.7603 (1.0) 796.8523 (1.07) 7.4646 (1.0) 2;0 1.2545 (0.94) 5 3 test_plots-plots-diff[3.0.0] 1,358.8221 (1.85) 1,377.6357 (1.81) 1,368.0403 (1.83) 8.1286 (1.20) 1,367.3153 (1.84) 14.5773 (1.95) 2;0 0.7310 (0.55) 5 3 test_plots-plots-diff[main] 1,329.0543 (1.81) 1,379.6316 (1.81) 1,347.2719 (1.81) 20.6217 (3.05) 1,340.1798 (1.80) 29.3086 (3.93) 1;0 0.7422 (0.55) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.40.0] 800.8941 (1.01) 826.8832 (1.0) 813.0945 (1.00) 10.6216 (1.0) 811.9280 (1.0) 17.6641 (1.0) 2;0 1.2299 (1.00) 5 3 test_plots-plots-diff-json[2.58.2] 792.1228 (1.0) 834.5490 (1.01) 812.2124 (1.0) 16.4428 (1.55) 813.0229 (1.00) 24.5820 (1.39) 2;0 1.2312 (1.0) 5 3 test_plots-plots-diff-json[3.0.0] 1,686.7853 (2.13) 1,780.2395 (2.15) 1,739.5697 (2.14) 37.9440 (3.57) 1,733.3828 (2.13) 58.7493 (3.33) 2;0 0.5749 (0.47) 5 3 test_plots-plots-diff-json[main] 1,735.0747 (2.19) 1,796.7617 (2.17) 1,756.4444 (2.16) 24.4199 (2.30) 1,753.0423 (2.16) 29.2827 (1.66) 1;0 0.5693 (0.46) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show[2.40.0] 572.4606 (1.0) 607.9750 (1.0) 594.7748 (1.0) 15.0975 (2.78) 602.7883 (1.0) 22.8996 (4.85) 1;0 1.6813 (1.0) 5 3 test_plots-plots-show[2.58.2] 721.3216 (1.26) 734.7483 (1.21) 725.2554 (1.22) 5.4220 (1.0) 723.5797 (1.20) 4.7221 (1.0) 1;1 1.3788 (0.82) 5 3 test_plots-plots-show[3.0.0] 1,119.5183 (1.96) 1,144.8133 (1.88) 1,130.0979 (1.90) 9.9973 (1.84) 1,126.2737 (1.87) 14.3065 (3.03) 2;0 0.8849 (0.53) 5 3 test_plots-plots-show[main] 1,098.1629 (1.92) 1,151.6058 (1.89) 1,136.1501 (1.91) 21.7301 (4.01) 1,144.0241 (1.90) 19.8528 (4.20) 1;1 0.8802 (0.52) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.40.0] 629.6076 (1.0) 652.4906 (1.0) 638.9162 (1.0) 8.9083 (1.05) 638.4154 (1.0) 12.3600 (1.31) 2;0 1.5652 (1.0) 5 3 test_plots-plots-show-json[2.58.2] 738.1480 (1.17) 769.4902 (1.18) 757.9253 (1.19) 11.7254 (1.39) 760.1590 (1.19) 9.4073 (1.0) 1;1 1.3194 (0.84) 5 3 test_plots-plots-show-json[3.0.0] 1,352.1876 (2.15) 1,373.4144 (2.10) 1,359.9229 (2.13) 8.4641 (1.0) 1,358.3294 (2.13) 11.4462 (1.22) 1;0 0.7353 (0.47) 5 3 test_plots-plots-show-json[main] 1,343.5474 (2.13) 1,378.1148 (2.11) 1,366.4690 (2.14) 14.3383 (1.69) 1,373.6251 (2.15) 19.3341 (2.06) 1;0 0.7318 (0.47) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_gs-add[2.11.0] 9.0014 (1.83) 9.0014 (1.83) 9.0014 (1.83) 0.0000 (1.0) 9.0014 (1.83) 0.0000 (1.0) 0;0 0.1111 (0.55) 1 1 test_sharing_gs-add[2.11.0] 9.2475 (1.88) 9.2475 (1.88) 9.2475 (1.88) 0.0000 (1.0) 9.2475 (1.88) 0.0000 (1.0) 0;0 0.1081 (0.53) 1 1 test_sharing_gs-add[2.40.0] 7.8665 (1.60) 7.8665 (1.60) 7.8665 (1.60) 0.0000 (1.0) 7.8665 (1.60) 0.0000 (1.0) 0;0 0.1271 (0.63) 1 1 test_sharing_gs-add[2.40.0] 7.3771 (1.50) 7.3771 (1.50) 7.3771 (1.50) 0.0000 (1.0) 7.3771 (1.50) 0.0000 (1.0) 0;0 0.1356 (0.67) 1 1 test_sharing_gs-add[2.58.2] 5.0383 (1.02) 5.0383 (1.02) 5.0383 (1.02) 0.0000 (1.0) 5.0383 (1.02) 0.0000 (1.0) 0;0 0.1985 (0.98) 1 1 test_sharing_gs-add[2.58.2] 5.0923 (1.03) 5.0923 (1.03) 5.0923 (1.03) 0.0000 (1.0) 5.0923 (1.03) 0.0000 (1.0) 0;0 0.1964 (0.97) 1 1 test_sharing_gs-add[3.0.0] 5.1148 (1.04) 5.1148 (1.04) 5.1148 (1.04) 0.0000 (1.0) 5.1148 (1.04) 0.0000 (1.0) 0;0 0.1955 (0.96) 1 1 test_sharing_gs-add[3.0.0] 5.0479 (1.02) 5.0479 (1.02) 5.0479 (1.02) 0.0000 (1.0) 5.0479 (1.02) 0.0000 (1.0) 0;0 0.1981 (0.98) 1 1 test_sharing_gs-add[main] 4.9271 (1.0) 4.9271 (1.0) 4.9271 (1.0) 0.0000 (1.0) 4.9271 (1.0) 0.0000 (1.0) 0;0 0.2030 (1.0) 1 1 test_sharing_gs-add[main] 5.1558 (1.05) 5.1558 (1.05) 5.1558 (1.05) 0.0000 (1.0) 5.1558 (1.05) 0.0000 (1.0) 0;0 0.1940 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-add-noop[2.11.0] 4.1631 (1.39) 4.1631 (1.39) 4.1631 (1.39) 0.0000 (1.0) 4.1631 (1.39) 0.0000 (1.0) 0;0 0.2402 (0.72) 1 1 test_sharing_gs-add-noop[2.11.0] 4.1218 (1.37) 4.1218 (1.37) 4.1218 (1.37) 0.0000 (1.0) 4.1218 (1.37) 0.0000 (1.0) 0;0 0.2426 (0.73) 1 1 test_sharing_gs-add-noop[2.40.0] 3.1519 (1.05) 3.1519 (1.05) 3.1519 (1.05) 0.0000 (1.0) 3.1519 (1.05) 0.0000 (1.0) 0;0 0.3173 (0.95) 1 1 test_sharing_gs-add-noop[2.40.0] 2.9998 (1.0) 2.9998 (1.0) 2.9998 (1.0) 0.0000 (1.0) 2.9998 (1.0) 0.0000 (1.0) 0;0 0.3334 (1.0) 1 1 test_sharing_gs-add-noop[2.58.2] 3.2719 (1.09) 3.2719 (1.09) 3.2719 (1.09) 0.0000 (1.0) 3.2719 (1.09) 0.0000 (1.0) 0;0 0.3056 (0.92) 1 1 test_sharing_gs-add-noop[2.58.2] 3.3042 (1.10) 3.3042 (1.10) 3.3042 (1.10) 0.0000 (1.0) 3.3042 (1.10) 0.0000 (1.0) 0;0 0.3026 (0.91) 1 1 test_sharing_gs-add-noop[3.0.0] 3.3113 (1.10) 3.3113 (1.10) 3.3113 (1.10) 0.0000 (1.0) 3.3113 (1.10) 0.0000 (1.0) 0;0 0.3020 (0.91) 1 1 test_sharing_gs-add-noop[3.0.0] 3.2924 (1.10) 3.2924 (1.10) 3.2924 (1.10) 0.0000 (1.0) 3.2924 (1.10) 0.0000 (1.0) 0;0 0.3037 (0.91) 1 1 test_sharing_gs-add-noop[main] 3.2259 (1.08) 3.2259 (1.08) 3.2259 (1.08) 0.0000 (1.0) 3.2259 (1.08) 0.0000 (1.0) 0;0 0.3100 (0.93) 1 1 test_sharing_gs-add-noop[main] 3.4940 (1.16) 3.4940 (1.16) 3.4940 (1.16) 0.0000 (1.0) 3.4940 (1.16) 0.0000 (1.0) 0;0 0.2862 (0.86) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_gs-checkout-noop[2.11.0] 557.9433 (1.01) 557.9433 (1.01) 557.9433 (1.01) 0.0000 (1.0) 557.9433 (1.01) 0.0000 (1.0) 0;0 1.7923 (0.99) 1 1 test_sharing_gs-checkout-noop[2.11.0] 549.7940 (1.0) 549.7940 (1.0) 549.7940 (1.0) 0.0000 (1.0) 549.7940 (1.0) 0.0000 (1.0) 0;0 1.8189 (1.0) 1 1 test_sharing_gs-checkout-noop[2.40.0] 692.9592 (1.26) 692.9592 (1.26) 692.9592 (1.26) 0.0000 (1.0) 692.9592 (1.26) 0.0000 (1.0) 0;0 1.4431 (0.79) 1 1 test_sharing_gs-checkout-noop[2.40.0] 701.9042 (1.28) 701.9042 (1.28) 701.9042 (1.28) 0.0000 (1.0) 701.9042 (1.28) 0.0000 (1.0) 0;0 1.4247 (0.78) 1 1 test_sharing_gs-checkout-noop[2.58.2] 835.5048 (1.52) 835.5048 (1.52) 835.5048 (1.52) 0.0000 (1.0) 835.5048 (1.52) 0.0000 (1.0) 0;0 1.1969 (0.66) 1 1 test_sharing_gs-checkout-noop[2.58.2] 869.7971 (1.58) 869.7971 (1.58) 869.7971 (1.58) 0.0000 (1.0) 869.7971 (1.58) 0.0000 (1.0) 0;0 1.1497 (0.63) 1 1 test_sharing_gs-checkout-noop[3.0.0] 862.0913 (1.57) 862.0913 (1.57) 862.0913 (1.57) 0.0000 (1.0) 862.0913 (1.57) 0.0000 (1.0) 0;0 1.1600 (0.64) 1 1 test_sharing_gs-checkout-noop[3.0.0] 873.3092 (1.59) 873.3092 (1.59) 873.3092 (1.59) 0.0000 (1.0) 873.3092 (1.59) 0.0000 (1.0) 0;0 1.1451 (0.63) 1 1 test_sharing_gs-checkout-noop[main] 842.3364 (1.53) 842.3364 (1.53) 842.3364 (1.53) 0.0000 (1.0) 842.3364 (1.53) 0.0000 (1.0) 0;0 1.1872 (0.65) 1 1 test_sharing_gs-checkout-noop[main] 906.6590 (1.65) 906.6590 (1.65) 906.6590 (1.65) 0.0000 (1.0) 906.6590 (1.65) 0.0000 (1.0) 0;0 1.1030 (0.61) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-pull[2.11.0] 9.3943 (1.37) 9.3943 (1.37) 9.3943 (1.37) 0.0000 (1.0) 9.3943 (1.37) 0.0000 (1.0) 0;0 0.1064 (0.73) 1 1 test_sharing_gs-pull[2.11.0] 9.4001 (1.37) 9.4001 (1.37) 9.4001 (1.37) 0.0000 (1.0) 9.4001 (1.37) 0.0000 (1.0) 0;0 0.1064 (0.73) 1 1 test_sharing_gs-pull[2.40.0] 10.5667 (1.54) 10.5667 (1.54) 10.5667 (1.54) 0.0000 (1.0) 10.5667 (1.54) 0.0000 (1.0) 0;0 0.0946 (0.65) 1 1 test_sharing_gs-pull[2.40.0] 11.0265 (1.61) 11.0265 (1.61) 11.0265 (1.61) 0.0000 (1.0) 11.0265 (1.61) 0.0000 (1.0) 0;0 0.0907 (0.62) 1 1 test_sharing_gs-pull[2.58.2] 6.8583 (1.0) 6.8583 (1.0) 6.8583 (1.0) 0.0000 (1.0) 6.8583 (1.0) 0.0000 (1.0) 0;0 0.1458 (1.0) 1 1 test_sharing_gs-pull[2.58.2] 7.3542 (1.07) 7.3542 (1.07) 7.3542 (1.07) 0.0000 (1.0) 7.3542 (1.07) 0.0000 (1.0) 0;0 0.1360 (0.93) 1 1 test_sharing_gs-pull[3.0.0] 9.7598 (1.42) 9.7598 (1.42) 9.7598 (1.42) 0.0000 (1.0) 9.7598 (1.42) 0.0000 (1.0) 0;0 0.1025 (0.70) 1 1 test_sharing_gs-pull[3.0.0] 10.0289 (1.46) 10.0289 (1.46) 10.0289 (1.46) 0.0000 (1.0) 10.0289 (1.46) 0.0000 (1.0) 0;0 0.0997 (0.68) 1 1 test_sharing_gs-pull[main] 9.7679 (1.42) 9.7679 (1.42) 9.7679 (1.42) 0.0000 (1.0) 9.7679 (1.42) 0.0000 (1.0) 0;0 0.1024 (0.70) 1 1 test_sharing_gs-pull[main] 10.0020 (1.46) 10.0020 (1.46) 10.0020 (1.46) 0.0000 (1.0) 10.0020 (1.46) 0.0000 (1.0) 0;0 0.1000 (0.69) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-pull-noop[2.11.0] 591.8860 (1.02) 591.8860 (1.02) 591.8860 (1.02) 0.0000 (1.0) 591.8860 (1.02) 0.0000 (1.0) 0;0 1.6895 (0.98) 1 1 test_sharing_gs-pull-noop[2.11.0] 582.6331 (1.0) 582.6331 (1.0) 582.6331 (1.0) 0.0000 (1.0) 582.6331 (1.0) 0.0000 (1.0) 0;0 1.7163 (1.0) 1 1 test_sharing_gs-pull-noop[2.40.0] 771.7318 (1.32) 771.7318 (1.32) 771.7318 (1.32) 0.0000 (1.0) 771.7318 (1.32) 0.0000 (1.0) 0;0 1.2958 (0.75) 1 1 test_sharing_gs-pull-noop[2.40.0] 737.3011 (1.27) 737.3011 (1.27) 737.3011 (1.27) 0.0000 (1.0) 737.3011 (1.27) 0.0000 (1.0) 0;0 1.3563 (0.79) 1 1 test_sharing_gs-pull-noop[2.58.2] 887.9332 (1.52) 887.9332 (1.52) 887.9332 (1.52) 0.0000 (1.0) 887.9332 (1.52) 0.0000 (1.0) 0;0 1.1262 (0.66) 1 1 test_sharing_gs-pull-noop[2.58.2] 905.7884 (1.55) 905.7884 (1.55) 905.7884 (1.55) 0.0000 (1.0) 905.7884 (1.55) 0.0000 (1.0) 0;0 1.1040 (0.64) 1 1 test_sharing_gs-pull-noop[3.0.0] 1,036.6057 (1.78) 1,036.6057 (1.78) 1,036.6057 (1.78) 0.0000 (1.0) 1,036.6057 (1.78) 0.0000 (1.0) 0;0 0.9647 (0.56) 1 1 test_sharing_gs-pull-noop[3.0.0] 1,030.5132 (1.77) 1,030.5132 (1.77) 1,030.5132 (1.77) 0.0000 (1.0) 1,030.5132 (1.77) 0.0000 (1.0) 0;0 0.9704 (0.57) 1 1 test_sharing_gs-pull-noop[main] 1,005.6093 (1.73) 1,005.6093 (1.73) 1,005.6093 (1.73) 0.0000 (1.0) 1,005.6093 (1.73) 0.0000 (1.0) 0;0 0.9944 (0.58) 1 1 test_sharing_gs-pull-noop[main] 1,022.9344 (1.76) 1,022.9344 (1.76) 1,022.9344 (1.76) 0.0000 (1.0) 1,022.9344 (1.76) 0.0000 (1.0) 0;0 0.9776 (0.57) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-push[2.11.0] 4.9907 (2.29) 4.9907 (2.29) 4.9907 (2.29) 0.0000 (1.0) 4.9907 (2.29) 0.0000 (1.0) 0;0 0.2004 (0.44) 1 1 test_sharing_gs-push[2.11.0] 4.8612 (2.23) 4.8612 (2.23) 4.8612 (2.23) 0.0000 (1.0) 4.8612 (2.23) 0.0000 (1.0) 0;0 0.2057 (0.45) 1 1 test_sharing_gs-push[2.40.0] 6.0183 (2.76) 6.0183 (2.76) 6.0183 (2.76) 0.0000 (1.0) 6.0183 (2.76) 0.0000 (1.0) 0;0 0.1662 (0.36) 1 1 test_sharing_gs-push[2.40.0] 6.0365 (2.76) 6.0365 (2.76) 6.0365 (2.76) 0.0000 (1.0) 6.0365 (2.76) 0.0000 (1.0) 0;0 0.1657 (0.36) 1 1 test_sharing_gs-push[2.58.2] 4.3289 (1.98) 4.3289 (1.98) 4.3289 (1.98) 0.0000 (1.0) 4.3289 (1.98) 0.0000 (1.0) 0;0 0.2310 (0.50) 1 1 test_sharing_gs-push[2.58.2] 4.2290 (1.94) 4.2290 (1.94) 4.2290 (1.94) 0.0000 (1.0) 4.2290 (1.94) 0.0000 (1.0) 0;0 0.2365 (0.52) 1 1 test_sharing_gs-push[3.0.0] 2.1984 (1.01) 2.1984 (1.01) 2.1984 (1.01) 0.0000 (1.0) 2.1984 (1.01) 0.0000 (1.0) 0;0 0.4549 (0.99) 1 1 test_sharing_gs-push[3.0.0] 2.1836 (1.0) 2.1836 (1.0) 2.1836 (1.0) 0.0000 (1.0) 2.1836 (1.0) 0.0000 (1.0) 0;0 0.4580 (1.0) 1 1 test_sharing_gs-push[main] 4.2929 (1.97) 4.2929 (1.97) 4.2929 (1.97) 0.0000 (1.0) 4.2929 (1.97) 0.0000 (1.0) 0;0 0.2329 (0.51) 1 1 test_sharing_gs-push[main] 4.3597 (2.00) 4.3597 (2.00) 4.3597 (2.00) 0.0000 (1.0) 4.3597 (2.00) 0.0000 (1.0) 0;0 0.2294 (0.50) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-push-noop[2.11.0] 510.9450 (1.06) 510.9450 (1.06) 510.9450 (1.06) 0.0000 (1.0) 510.9450 (1.06) 0.0000 (1.0) 0;0 1.9572 (0.94) 1 1 test_sharing_gs-push-noop[2.11.0] 482.2326 (1.0) 482.2326 (1.0) 482.2326 (1.0) 0.0000 (1.0) 482.2326 (1.0) 0.0000 (1.0) 0;0 2.0737 (1.0) 1 1 test_sharing_gs-push-noop[2.40.0] 522.7429 (1.08) 522.7429 (1.08) 522.7429 (1.08) 0.0000 (1.0) 522.7429 (1.08) 0.0000 (1.0) 0;0 1.9130 (0.92) 1 1 test_sharing_gs-push-noop[2.40.0] 534.1739 (1.11) 534.1739 (1.11) 534.1739 (1.11) 0.0000 (1.0) 534.1739 (1.11) 0.0000 (1.0) 0;0 1.8720 (0.90) 1 1 test_sharing_gs-push-noop[2.58.2] 656.2168 (1.36) 656.2168 (1.36) 656.2168 (1.36) 0.0000 (1.0) 656.2168 (1.36) 0.0000 (1.0) 0;0 1.5239 (0.73) 1 1 test_sharing_gs-push-noop[2.58.2] 649.3991 (1.35) 649.3991 (1.35) 649.3991 (1.35) 0.0000 (1.0) 649.3991 (1.35) 0.0000 (1.0) 0;0 1.5399 (0.74) 1 1 test_sharing_gs-push-noop[3.0.0] 638.8804 (1.32) 638.8804 (1.32) 638.8804 (1.32) 0.0000 (1.0) 638.8804 (1.32) 0.0000 (1.0) 0;0 1.5652 (0.75) 1 1 test_sharing_gs-push-noop[3.0.0] 683.1774 (1.42) 683.1774 (1.42) 683.1774 (1.42) 0.0000 (1.0) 683.1774 (1.42) 0.0000 (1.0) 0;0 1.4637 (0.71) 1 1 test_sharing_gs-push-noop[main] 636.8704 (1.32) 636.8704 (1.32) 636.8704 (1.32) 0.0000 (1.0) 636.8704 (1.32) 0.0000 (1.0) 0;0 1.5702 (0.76) 1 1 test_sharing_gs-push-noop[main] 636.6926 (1.32) 636.6926 (1.32) 636.6926 (1.32) 0.0000 (1.0) 636.6926 (1.32) 0.0000 (1.0) 0;0 1.5706 (0.76) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.11.0] 321.1401 (1.0) 377.9929 (1.0) 324.5047 (1.0) 5.5773 (2.41) 323.7148 (1.0) 1.6441 (1.0) 1;4 3.0816 (1.0) 100 1 test_init-init[2.40.0] 379.4739 (1.18) 392.1003 (1.04) 383.8747 (1.18) 2.3171 (1.0) 383.6856 (1.19) 3.2534 (1.98) 33;1 2.6050 (0.85) 100 1 test_init-init[2.58.2] 471.3357 (1.47) 486.3709 (1.29) 476.7339 (1.47) 2.8856 (1.25) 476.9188 (1.47) 3.7329 (2.27) 30;2 2.0976 (0.68) 100 1 test_init-init[3.0.0] 464.9797 (1.45) 482.8517 (1.28) 470.2658 (1.45) 2.9048 (1.25) 469.6462 (1.45) 3.3301 (2.03) 25;3 2.1265 (0.69) 100 1 test_init-init[main] 477.4993 (1.49) 539.5263 (1.43) 482.2776 (1.49) 6.3206 (2.73) 481.4343 (1.49) 2.7062 (1.65) 4;5 2.0735 (0.67) 100 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.11.0] 521.4972 (1.03) 521.4972 (1.03) 521.4972 (1.03) 0.0000 (1.0) 521.4972 (1.03) 0.0000 (1.0) 0;0 1.9176 (0.97) 1 1 test_list-list[2.40.0] 506.8324 (1.0) 506.8324 (1.0) 506.8324 (1.0) 0.0000 (1.0) 506.8324 (1.0) 0.0000 (1.0) 0;0 1.9730 (1.0) 1 1 test_list-list[2.58.2] 652.9370 (1.29) 652.9370 (1.29) 652.9370 (1.29) 0.0000 (1.0) 652.9370 (1.29) 0.0000 (1.0) 0;0 1.5315 (0.78) 1 1 test_list-list[3.0.0] 662.4328 (1.31) 662.4328 (1.31) 662.4328 (1.31) 0.0000 (1.0) 662.4328 (1.31) 0.0000 (1.0) 0;0 1.5096 (0.77) 1 1 test_list-list[main] 632.8084 (1.25) 632.8084 (1.25) 632.8084 (1.25) 0.0000 (1.0) 632.8084 (1.25) 0.0000 (1.0) 0;0 1.5803 (0.80) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.11.0] 509.6581 (1.04) 509.6581 (1.04) 509.6581 (1.04) 0.0000 (1.0) 509.6581 (1.04) 0.0000 (1.0) 0;0 1.9621 (0.96) 1 1 test_list-list-dvc-only[2.40.0] 489.4852 (1.0) 489.4852 (1.0) 489.4852 (1.0) 0.0000 (1.0) 489.4852 (1.0) 0.0000 (1.0) 0;0 2.0430 (1.0) 1 1 test_list-list-dvc-only[2.58.2] 626.8087 (1.28) 626.8087 (1.28) 626.8087 (1.28) 0.0000 (1.0) 626.8087 (1.28) 0.0000 (1.0) 0;0 1.5954 (0.78) 1 1 test_list-list-dvc-only[3.0.0] 651.9073 (1.33) 651.9073 (1.33) 651.9073 (1.33) 0.0000 (1.0) 651.9073 (1.33) 0.0000 (1.0) 0;0 1.5340 (0.75) 1 1 test_list-list-dvc-only[main] 632.1910 (1.29) 632.1910 (1.29) 632.1910 (1.29) 0.0000 (1.0) 632.1910 (1.29) 0.0000 (1.0) 0;0 1.5818 (0.77) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.11.0] 2.2018 (3.80) 2.2018 (3.80) 2.2018 (3.80) 0.0000 (1.0) 2.2018 (3.80) 0.0000 (1.0) 0;0 0.4542 (0.26) 1 1 test_list-list-recursive[2.40.0] 0.5799 (1.0) 0.5799 (1.0) 0.5799 (1.0) 0.0000 (1.0) 0.5799 (1.0) 0.0000 (1.0) 0;0 1.7245 (1.0) 1 1 test_list-list-recursive[2.58.2] 0.7697 (1.33) 0.7697 (1.33) 0.7697 (1.33) 0.0000 (1.0) 0.7697 (1.33) 0.0000 (1.0) 0;0 1.2992 (0.75) 1 1 test_list-list-recursive[3.0.0] 0.7877 (1.36) 0.7877 (1.36) 0.7877 (1.36) 0.0000 (1.0) 0.7877 (1.36) 0.0000 (1.0) 0;0 1.2695 (0.74) 1 1 test_list-list-recursive[main] 0.7489 (1.29) 0.7489 (1.29) 0.7489 (1.29) 0.0000 (1.0) 0.7489 (1.29) 0.0000 (1.0) 0;0 1.3352 (0.77) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.11.0] 524.1569 (1.0) 524.1569 (1.0) 524.1569 (1.0) 0.0000 (1.0) 524.1569 (1.0) 0.0000 (1.0) 0;0 1.9078 (1.0) 1 1 test_list-list-shallow[2.40.0] 533.8802 (1.02) 533.8802 (1.02) 533.8802 (1.02) 0.0000 (1.0) 533.8802 (1.02) 0.0000 (1.0) 0;0 1.8731 (0.98) 1 1 test_list-list-shallow[2.58.2] 629.0556 (1.20) 629.0556 (1.20) 629.0556 (1.20) 0.0000 (1.0) 629.0556 (1.20) 0.0000 (1.0) 0;0 1.5897 (0.83) 1 1 test_list-list-shallow[3.0.0] 642.8362 (1.23) 642.8362 (1.23) 642.8362 (1.23) 0.0000 (1.0) 642.8362 (1.23) 0.0000 (1.0) 0;0 1.5556 (0.82) 1 1 test_list-list-shallow[main] 643.8278 (1.23) 643.8278 (1.23) 643.8278 (1.23) 0.0000 (1.0) 643.8278 (1.23) 0.0000 (1.0) 0;0 1.5532 (0.81) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_partial_remove-add': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.11.0] 7.4601 (4.84) 7.4601 (4.84) 7.4601 (4.84) 0.0000 (1.0) 7.4601 (4.84) 0.0000 (1.0) 0;0 0.1340 (0.21) 1 1 test_partial_remove-add[2.11.0] 2.7570 (1.79) 2.7570 (1.79) 2.7570 (1.79) 0.0000 (1.0) 2.7570 (1.79) 0.0000 (1.0) 0;0 0.3627 (0.56) 1 1 test_partial_remove-add[2.40.0] 6.2072 (4.02) 6.2072 (4.02) 6.2072 (4.02) 0.0000 (1.0) 6.2072 (4.02) 0.0000 (1.0) 0;0 0.1611 (0.25) 1 1 test_partial_remove-add[2.40.0] 1.5427 (1.0) 1.5427 (1.0) 1.5427 (1.0) 0.0000 (1.0) 1.5427 (1.0) 0.0000 (1.0) 0;0 0.6482 (1.0) 1 1 test_partial_remove-add[2.58.2] 4.1579 (2.70) 4.1579 (2.70) 4.1579 (2.70) 0.0000 (1.0) 4.1579 (2.70) 0.0000 (1.0) 0;0 0.2405 (0.37) 1 1 test_partial_remove-add[2.58.2] 1.6982 (1.10) 1.6982 (1.10) 1.6982 (1.10) 0.0000 (1.0) 1.6982 (1.10) 0.0000 (1.0) 0;0 0.5888 (0.91) 1 1 test_partial_remove-add[3.0.0] 4.1378 (2.68) 4.1378 (2.68) 4.1378 (2.68) 0.0000 (1.0) 4.1378 (2.68) 0.0000 (1.0) 0;0 0.2417 (0.37) 1 1 test_partial_remove-add[3.0.0] 1.7098 (1.11) 1.7098 (1.11) 1.7098 (1.11) 0.0000 (1.0) 1.7098 (1.11) 0.0000 (1.0) 0;0 0.5849 (0.90) 1 1 test_partial_remove-add[main] 4.1065 (2.66) 4.1065 (2.66) 4.1065 (2.66) 0.0000 (1.0) 4.1065 (2.66) 0.0000 (1.0) 0;0 0.2435 (0.38) 1 1 test_partial_remove-add[main] 1.6958 (1.10) 1.6958 (1.10) 1.6958 (1.10) 0.0000 (1.0) 1.6958 (1.10) 0.0000 (1.0) 0;0 0.5897 (0.91) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.11.0] 461.2037 (1.0) 461.2037 (1.0) 461.2037 (1.0) 0.0000 (1.0) 461.2037 (1.0) 0.0000 (1.0) 0;0 2.1682 (1.0) 1 1 test_partial_remove-gc[2.40.0] 511.6853 (1.11) 511.6853 (1.11) 511.6853 (1.11) 0.0000 (1.0) 511.6853 (1.11) 0.0000 (1.0) 0;0 1.9543 (0.90) 1 1 test_partial_remove-gc[2.58.2] 645.1255 (1.40) 645.1255 (1.40) 645.1255 (1.40) 0.0000 (1.0) 645.1255 (1.40) 0.0000 (1.0) 0;0 1.5501 (0.71) 1 1 test_partial_remove-gc[3.0.0] 689.8069 (1.50) 689.8069 (1.50) 689.8069 (1.50) 0.0000 (1.0) 689.8069 (1.50) 0.0000 (1.0) 0;0 1.4497 (0.67) 1 1 test_partial_remove-gc[main] 690.2798 (1.50) 690.2798 (1.50) 690.2798 (1.50) 0.0000 (1.0) 690.2798 (1.50) 0.0000 (1.0) 0;0 1.4487 (0.67) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.11.0] 515.2854 (1.0) 515.2854 (1.0) 515.2854 (1.0) 0.0000 (1.0) 515.2854 (1.0) 0.0000 (1.0) 0;0 1.9407 (1.0) 1 1 test_partial_remove-gc-cloud[2.40.0] 561.2925 (1.09) 561.2925 (1.09) 561.2925 (1.09) 0.0000 (1.0) 561.2925 (1.09) 0.0000 (1.0) 0;0 1.7816 (0.92) 1 1 test_partial_remove-gc-cloud[2.58.2] 709.2021 (1.38) 709.2021 (1.38) 709.2021 (1.38) 0.0000 (1.0) 709.2021 (1.38) 0.0000 (1.0) 0;0 1.4100 (0.73) 1 1 test_partial_remove-gc-cloud[3.0.0] 777.7975 (1.51) 777.7975 (1.51) 777.7975 (1.51) 0.0000 (1.0) 777.7975 (1.51) 0.0000 (1.0) 0;0 1.2857 (0.66) 1 1 test_partial_remove-gc-cloud[main] 753.6203 (1.46) 753.6203 (1.46) 753.6203 (1.46) 0.0000 (1.0) 753.6203 (1.46) 0.0000 (1.0) 0;0 1.3269 (0.68) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.11.0] 4.0275 (8.01) 4.0275 (8.01) 4.0275 (8.01) 0.0000 (1.0) 4.0275 (8.01) 0.0000 (1.0) 0;0 0.2483 (0.12) 1 1 test_partial_remove-push[2.11.0] 0.5027 (1.0) 0.5027 (1.0) 0.5027 (1.0) 0.0000 (1.0) 0.5027 (1.0) 0.0000 (1.0) 0;0 1.9892 (1.0) 1 1 test_partial_remove-push[2.40.0] 5.1617 (10.27) 5.1617 (10.27) 5.1617 (10.27) 0.0000 (1.0) 5.1617 (10.27) 0.0000 (1.0) 0;0 0.1937 (0.10) 1 1 test_partial_remove-push[2.40.0] 0.5342 (1.06) 0.5342 (1.06) 0.5342 (1.06) 0.0000 (1.0) 0.5342 (1.06) 0.0000 (1.0) 0;0 1.8718 (0.94) 1 1 test_partial_remove-push[2.58.2] 3.5606 (7.08) 3.5606 (7.08) 3.5606 (7.08) 0.0000 (1.0) 3.5606 (7.08) 0.0000 (1.0) 0;0 0.2809 (0.14) 1 1 test_partial_remove-push[2.58.2] 0.6292 (1.25) 0.6292 (1.25) 0.6292 (1.25) 0.0000 (1.0) 0.6292 (1.25) 0.0000 (1.0) 0;0 1.5893 (0.80) 1 1 test_partial_remove-push[3.0.0] 1.7774 (3.54) 1.7774 (3.54) 1.7774 (3.54) 0.0000 (1.0) 1.7774 (3.54) 0.0000 (1.0) 0;0 0.5626 (0.28) 1 1 test_partial_remove-push[3.0.0] 0.6419 (1.28) 0.6419 (1.28) 0.6419 (1.28) 0.0000 (1.0) 0.6419 (1.28) 0.0000 (1.0) 0;0 1.5578 (0.78) 1 1 test_partial_remove-push[main] 3.5616 (7.08) 3.5616 (7.08) 3.5616 (7.08) 0.0000 (1.0) 3.5616 (7.08) 0.0000 (1.0) 0;0 0.2808 (0.14) 1 1 test_partial_remove-push[main] 0.6175 (1.23) 0.6175 (1.23) 0.6175 (1.23) 0.0000 (1.0) 0.6175 (1.23) 0.0000 (1.0) 0;0 1.6195 (0.81) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.11.0] 191.9346 (1.0) 234.9751 (1.02) 205.0972 (1.0) 7.1163 (1.00) 204.4001 (1.0) 9.6125 (1.09) 33;2 4.8757 (1.0) 100 1 test_help---help[2.40.0] 247.4574 (1.29) 320.2810 (1.39) 269.7948 (1.32) 11.1142 (1.57) 269.3827 (1.32) 13.4856 (1.53) 27;1 3.7065 (0.76) 100 1 test_help---help[2.58.2] 197.5076 (1.03) 242.5230 (1.06) 215.4706 (1.05) 8.2764 (1.17) 215.4527 (1.05) 11.1329 (1.27) 32;1 4.6410 (0.95) 100 1 test_help---help[3.0.0] 194.4013 (1.01) 245.7513 (1.07) 215.1818 (1.05) 7.6450 (1.08) 214.6182 (1.05) 8.7893 (1.0) 29;4 4.6472 (0.95) 100 1 test_help---help[main] 192.8894 (1.00) 229.6298 (1.0) 207.4933 (1.01) 7.0957 (1.0) 208.1933 (1.02) 10.1000 (1.15) 29;1 4.8194 (0.99) 100 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.11.0] 2.8130 (1.0) 2.8130 (1.0) 2.8130 (1.0) 0.0000 (1.0) 2.8130 (1.0) 0.0000 (1.0) 0;0 0.3555 (1.0) 1 1 test_get_url-get-url[2.40.0] 2.8285 (1.01) 2.8285 (1.01) 2.8285 (1.01) 0.0000 (1.0) 2.8285 (1.01) 0.0000 (1.0) 0;0 0.3535 (0.99) 1 1 test_get_url-get-url[2.58.2] 2.9311 (1.04) 2.9311 (1.04) 2.9311 (1.04) 0.0000 (1.0) 2.9311 (1.04) 0.0000 (1.0) 0;0 0.3412 (0.96) 1 1 test_get_url-get-url[3.0.0] 2.9526 (1.05) 2.9526 (1.05) 2.9526 (1.05) 0.0000 (1.0) 2.9526 (1.05) 0.0000 (1.0) 0;0 0.3387 (0.95) 1 1 test_get_url-get-url[main] 3.0691 (1.09) 3.0691 (1.09) 3.0691 (1.09) 0.0000 (1.0) 3.0691 (1.09) 0.0000 (1.0) 0;0 0.3258 (0.92) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.40.0] 1.0403 (1.0) 1.0403 (1.0) 1.0403 (1.0) 0.0000 (1.0) 1.0403 (1.0) 0.0000 (1.0) 0;0 0.9612 (1.0) 1 1 test_exp_show-exp[2.58.2] 1.2610 (1.21) 1.2610 (1.21) 1.2610 (1.21) 0.0000 (1.0) 1.2610 (1.21) 0.0000 (1.0) 0;0 0.7930 (0.83) 1 1 test_exp_show-exp[3.0.0] 1.8546 (1.78) 1.8546 (1.78) 1.8546 (1.78) 0.0000 (1.0) 1.8546 (1.78) 0.0000 (1.0) 0;0 0.5392 (0.56) 1 1 test_exp_show-exp[main] 2.0382 (1.96) 2.0382 (1.96) 2.0382 (1.96) 0.0000 (1.0) 2.0382 (1.96) 0.0000 (1.0) 0;0 0.4906 (0.51) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.11.0] 1.4692 (1.18) 1.4692 (1.18) 1.4692 (1.18) 0.0000 (1.0) 1.4692 (1.18) 0.0000 (1.0) 0;0 0.6807 (0.84) 1 1 test_checkout_hardlink-checkout[2.40.0] 1.3430 (1.08) 1.3430 (1.08) 1.3430 (1.08) 0.0000 (1.0) 1.3430 (1.08) 0.0000 (1.0) 0;0 0.7446 (0.92) 1 1 test_checkout_hardlink-checkout[2.58.2] 1.5958 (1.29) 1.5958 (1.29) 1.5958 (1.29) 0.0000 (1.0) 1.5958 (1.29) 0.0000 (1.0) 0;0 0.6267 (0.78) 1 1 test_checkout_hardlink-checkout[3.0.0] 1.3246 (1.07) 1.3246 (1.07) 1.3246 (1.07) 0.0000 (1.0) 1.3246 (1.07) 0.0000 (1.0) 0;0 0.7550 (0.94) 1 1 test_checkout_hardlink-checkout[main] 1.2410 (1.0) 1.2410 (1.0) 1.2410 (1.0) 0.0000 (1.0) 1.2410 (1.0) 0.0000 (1.0) 0;0 0.8058 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.11.0] 541.9759 (1.0) 541.9759 (1.0) 541.9759 (1.0) 0.0000 (1.0) 541.9759 (1.0) 0.0000 (1.0) 0;0 1.8451 (1.0) 1 1 test_checkout_hardlink-checkout-noop[2.40.0] 632.8066 (1.17) 632.8066 (1.17) 632.8066 (1.17) 0.0000 (1.0) 632.8066 (1.17) 0.0000 (1.0) 0;0 1.5803 (0.86) 1 1 test_checkout_hardlink-checkout-noop[2.58.2] 753.4638 (1.39) 753.4638 (1.39) 753.4638 (1.39) 0.0000 (1.0) 753.4638 (1.39) 0.0000 (1.0) 0;0 1.3272 (0.72) 1 1 test_checkout_hardlink-checkout-noop[3.0.0] 730.1221 (1.35) 730.1221 (1.35) 730.1221 (1.35) 0.0000 (1.0) 730.1221 (1.35) 0.0000 (1.0) 0;0 1.3696 (0.74) 1 1 test_checkout_hardlink-checkout-noop[main] 689.3488 (1.27) 689.3488 (1.27) 689.3488 (1.27) 0.0000 (1.0) 689.3488 (1.27) 0.0000 (1.0) 0;0 1.4506 (0.79) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.11.0] 1.4208 (1.89) 1.4208 (1.89) 1.4208 (1.89) 0.0000 (1.0) 1.4208 (1.89) 0.0000 (1.0) 0;0 0.7038 (0.53) 1 1 test_checkout_hardlink-checkout-update[2.40.0] 0.7603 (1.01) 0.7603 (1.01) 0.7603 (1.01) 0.0000 (1.0) 0.7603 (1.01) 0.0000 (1.0) 0;0 1.3152 (0.99) 1 1 test_checkout_hardlink-checkout-update[2.58.2] 1.0269 (1.36) 1.0269 (1.36) 1.0269 (1.36) 0.0000 (1.0) 1.0269 (1.36) 0.0000 (1.0) 0;0 0.9738 (0.73) 1 1 test_checkout_hardlink-checkout-update[3.0.0] 0.9345 (1.24) 0.9345 (1.24) 0.9345 (1.24) 0.0000 (1.0) 0.9345 (1.24) 0.0000 (1.0) 0;0 1.0700 (0.81) 1 1 test_checkout_hardlink-checkout-update[main] 0.7535 (1.0) 0.7535 (1.0) 0.7535 (1.0) 0.0000 (1.0) 0.7535 (1.0) 0.0000 (1.0) 0;0 1.3272 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add[2.11.0] 4.0855 (1.70) 4.0855 (1.70) 4.0855 (1.70) 0.0000 (1.0) 4.0855 (1.70) 0.0000 (1.0) 0;0 0.2448 (0.59) 1 1 test_partial_add-add[2.40.0] 3.3372 (1.39) 3.3372 (1.39) 3.3372 (1.39) 0.0000 (1.0) 3.3372 (1.39) 0.0000 (1.0) 0;0 0.2996 (0.72) 1 1 test_partial_add-add[2.58.2] 2.7118 (1.13) 2.7118 (1.13) 2.7118 (1.13) 0.0000 (1.0) 2.7118 (1.13) 0.0000 (1.0) 0;0 0.3688 (0.89) 1 1 test_partial_add-add[3.0.0] 2.4055 (1.0) 2.4055 (1.0) 2.4055 (1.0) 0.0000 (1.0) 2.4055 (1.0) 0.0000 (1.0) 0;0 0.4157 (1.0) 1 1 test_partial_add-add[main] 2.4142 (1.00) 2.4142 (1.00) 2.4142 (1.00) 0.0000 (1.0) 2.4142 (1.00) 0.0000 (1.0) 0;0 0.4142 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial-add[2.11.0] 6.2650 (1.77) 6.2650 (1.77) 6.2650 (1.77) 0.0000 (1.0) 6.2650 (1.77) 0.0000 (1.0) 0;0 0.1596 (0.56) 1 1 test_partial_add-add-partial-add[2.40.0] 4.2894 (1.21) 4.2894 (1.21) 4.2894 (1.21) 0.0000 (1.0) 4.2894 (1.21) 0.0000 (1.0) 0;0 0.2331 (0.83) 1 1 test_partial_add-add-partial-add[2.58.2] 3.6080 (1.02) 3.6080 (1.02) 3.6080 (1.02) 0.0000 (1.0) 3.6080 (1.02) 0.0000 (1.0) 0;0 0.2772 (0.98) 1 1 test_partial_add-add-partial-add[3.0.0] 3.5626 (1.01) 3.5626 (1.01) 3.5626 (1.01) 0.0000 (1.0) 3.5626 (1.01) 0.0000 (1.0) 0;0 0.2807 (0.99) 1 1 test_partial_add-add-partial-add[main] 3.5394 (1.0) 3.5394 (1.0) 3.5394 (1.0) 0.0000 (1.0) 3.5394 (1.0) 0.0000 (1.0) 0;0 0.2825 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.11.0] 524.4277 (1.0) 524.4277 (1.0) 524.4277 (1.0) 0.0000 (1.0) 524.4277 (1.0) 0.0000 (1.0) 0;0 1.9068 (1.0) 1 1 test_partial_add-gc-cloud-noop[2.40.0] 585.6738 (1.12) 585.6738 (1.12) 585.6738 (1.12) 0.0000 (1.0) 585.6738 (1.12) 0.0000 (1.0) 0;0 1.7074 (0.90) 1 1 test_partial_add-gc-cloud-noop[2.58.2] 751.3702 (1.43) 751.3702 (1.43) 751.3702 (1.43) 0.0000 (1.0) 751.3702 (1.43) 0.0000 (1.0) 0;0 1.3309 (0.70) 1 1 test_partial_add-gc-cloud-noop[3.0.0] 843.4731 (1.61) 843.4731 (1.61) 843.4731 (1.61) 0.0000 (1.0) 843.4731 (1.61) 0.0000 (1.0) 0;0 1.1856 (0.62) 1 1 test_partial_add-gc-cloud-noop[main] 843.4589 (1.61) 843.4589 (1.61) 843.4589 (1.61) 0.0000 (1.0) 843.4589 (1.61) 0.0000 (1.0) 0;0 1.1856 (0.62) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.11.0] 441.9783 (1.0) 441.9783 (1.0) 441.9783 (1.0) 0.0000 (1.0) 441.9783 (1.0) 0.0000 (1.0) 0;0 2.2626 (1.0) 1 1 test_partial_add-gc-noop[2.40.0] 517.0129 (1.17) 517.0129 (1.17) 517.0129 (1.17) 0.0000 (1.0) 517.0129 (1.17) 0.0000 (1.0) 0;0 1.9342 (0.85) 1 1 test_partial_add-gc-noop[2.58.2] 657.4974 (1.49) 657.4974 (1.49) 657.4974 (1.49) 0.0000 (1.0) 657.4974 (1.49) 0.0000 (1.0) 0;0 1.5209 (0.67) 1 1 test_partial_add-gc-noop[3.0.0] 736.3609 (1.67) 736.3609 (1.67) 736.3609 (1.67) 0.0000 (1.0) 736.3609 (1.67) 0.0000 (1.0) 0;0 1.3580 (0.60) 1 1 test_partial_add-gc-noop[main] 747.5306 (1.69) 747.5306 (1.69) 747.5306 (1.69) 0.0000 (1.0) 747.5306 (1.69) 0.0000 (1.0) 0;0 1.3377 (0.59) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push[2.11.0] 2.2428 (1.81) 2.2428 (1.81) 2.2428 (1.81) 0.0000 (1.0) 2.2428 (1.81) 0.0000 (1.0) 0;0 0.4459 (0.55) 1 1 test_partial_add-push[2.40.0] 2.7602 (2.23) 2.7602 (2.23) 2.7602 (2.23) 0.0000 (1.0) 2.7602 (2.23) 0.0000 (1.0) 0;0 0.3623 (0.45) 1 1 test_partial_add-push[2.58.2] 2.0896 (1.69) 2.0896 (1.69) 2.0896 (1.69) 0.0000 (1.0) 2.0896 (1.69) 0.0000 (1.0) 0;0 0.4786 (0.59) 1 1 test_partial_add-push[3.0.0] 1.2383 (1.0) 1.2383 (1.0) 1.2383 (1.0) 0.0000 (1.0) 1.2383 (1.0) 0.0000 (1.0) 0;0 0.8076 (1.0) 1 1 test_partial_add-push[main] 2.0943 (1.69) 2.0943 (1.69) 2.0943 (1.69) 0.0000 (1.0) 2.0943 (1.69) 0.0000 (1.0) 0;0 0.4775 (0.59) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial-add[2.11.0] 2.3314 (1.88) 2.3314 (1.88) 2.3314 (1.88) 0.0000 (1.0) 2.3314 (1.88) 0.0000 (1.0) 0;0 0.4289 (0.53) 1 1 test_partial_add-push-partial-add[2.40.0] 2.8746 (2.32) 2.8746 (2.32) 2.8746 (2.32) 0.0000 (1.0) 2.8746 (2.32) 0.0000 (1.0) 0;0 0.3479 (0.43) 1 1 test_partial_add-push-partial-add[2.58.2] 2.1398 (1.73) 2.1398 (1.73) 2.1398 (1.73) 0.0000 (1.0) 2.1398 (1.73) 0.0000 (1.0) 0;0 0.4673 (0.58) 1 1 test_partial_add-push-partial-add[3.0.0] 1.2393 (1.0) 1.2393 (1.0) 1.2393 (1.0) 0.0000 (1.0) 1.2393 (1.0) 0.0000 (1.0) 0;0 0.8069 (1.0) 1 1 test_partial_add-push-partial-add[main] 2.1140 (1.71) 2.1140 (1.71) 2.1140 (1.71) 0.0000 (1.0) 2.1140 (1.71) 0.0000 (1.0) 0;0 0.4730 (0.59) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add[2.11.0] 7.3231 (1.79) 7.3231 (1.79) 7.3231 (1.79) 0.0000 (1.0) 7.3231 (1.79) 0.0000 (1.0) 0;0 0.1366 (0.56) 1 1 test_sharing_azure-add[2.11.0] 7.3964 (1.80) 7.3964 (1.80) 7.3964 (1.80) 0.0000 (1.0) 7.3964 (1.80) 0.0000 (1.0) 0;0 0.1352 (0.55) 1 1 test_sharing_azure-add[2.40.0] 5.9428 (1.45) 5.9428 (1.45) 5.9428 (1.45) 0.0000 (1.0) 5.9428 (1.45) 0.0000 (1.0) 0;0 0.1683 (0.69) 1 1 test_sharing_azure-add[2.40.0] 5.9596 (1.45) 5.9596 (1.45) 5.9596 (1.45) 0.0000 (1.0) 5.9596 (1.45) 0.0000 (1.0) 0;0 0.1678 (0.69) 1 1 test_sharing_azure-add[2.58.2] 4.1227 (1.01) 4.1227 (1.01) 4.1227 (1.01) 0.0000 (1.0) 4.1227 (1.01) 0.0000 (1.0) 0;0 0.2426 (0.99) 1 1 test_sharing_azure-add[2.58.2] 4.1300 (1.01) 4.1300 (1.01) 4.1300 (1.01) 0.0000 (1.0) 4.1300 (1.01) 0.0000 (1.0) 0;0 0.2421 (0.99) 1 1 test_sharing_azure-add[3.0.0] 4.1261 (1.01) 4.1261 (1.01) 4.1261 (1.01) 0.0000 (1.0) 4.1261 (1.01) 0.0000 (1.0) 0;0 0.2424 (0.99) 1 1 test_sharing_azure-add[3.0.0] 4.2108 (1.03) 4.2108 (1.03) 4.2108 (1.03) 0.0000 (1.0) 4.2108 (1.03) 0.0000 (1.0) 0;0 0.2375 (0.97) 1 1 test_sharing_azure-add[main] 4.1018 (1.0) 4.1018 (1.0) 4.1018 (1.0) 0.0000 (1.0) 4.1018 (1.0) 0.0000 (1.0) 0;0 0.2438 (1.0) 1 1 test_sharing_azure-add[main] 4.1373 (1.01) 4.1373 (1.01) 4.1373 (1.01) 0.0000 (1.0) 4.1373 (1.01) 0.0000 (1.0) 0;0 0.2417 (0.99) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add-noop[2.11.0] 3.5353 (1.44) 3.5353 (1.44) 3.5353 (1.44) 0.0000 (1.0) 3.5353 (1.44) 0.0000 (1.0) 0;0 0.2829 (0.70) 1 1 test_sharing_azure-add-noop[2.11.0] 3.5033 (1.42) 3.5033 (1.42) 3.5033 (1.42) 0.0000 (1.0) 3.5033 (1.42) 0.0000 (1.0) 0;0 0.2854 (0.70) 1 1 test_sharing_azure-add-noop[2.40.0] 2.4931 (1.01) 2.4931 (1.01) 2.4931 (1.01) 0.0000 (1.0) 2.4931 (1.01) 0.0000 (1.0) 0;0 0.4011 (0.99) 1 1 test_sharing_azure-add-noop[2.40.0] 2.4601 (1.0) 2.4601 (1.0) 2.4601 (1.0) 0.0000 (1.0) 2.4601 (1.0) 0.0000 (1.0) 0;0 0.4065 (1.0) 1 1 test_sharing_azure-add-noop[2.58.2] 2.7455 (1.12) 2.7455 (1.12) 2.7455 (1.12) 0.0000 (1.0) 2.7455 (1.12) 0.0000 (1.0) 0;0 0.3642 (0.90) 1 1 test_sharing_azure-add-noop[2.58.2] 2.7468 (1.12) 2.7468 (1.12) 2.7468 (1.12) 0.0000 (1.0) 2.7468 (1.12) 0.0000 (1.0) 0;0 0.3641 (0.90) 1 1 test_sharing_azure-add-noop[3.0.0] 2.7598 (1.12) 2.7598 (1.12) 2.7598 (1.12) 0.0000 (1.0) 2.7598 (1.12) 0.0000 (1.0) 0;0 0.3623 (0.89) 1 1 test_sharing_azure-add-noop[3.0.0] 2.7930 (1.14) 2.7930 (1.14) 2.7930 (1.14) 0.0000 (1.0) 2.7930 (1.14) 0.0000 (1.0) 0;0 0.3580 (0.88) 1 1 test_sharing_azure-add-noop[main] 2.7552 (1.12) 2.7552 (1.12) 2.7552 (1.12) 0.0000 (1.0) 2.7552 (1.12) 0.0000 (1.0) 0;0 0.3630 (0.89) 1 1 test_sharing_azure-add-noop[main] 2.7418 (1.11) 2.7418 (1.11) 2.7418 (1.11) 0.0000 (1.0) 2.7418 (1.11) 0.0000 (1.0) 0;0 0.3647 (0.90) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-checkout-noop[2.11.0] 502.4825 (1.00) 502.4825 (1.00) 502.4825 (1.00) 0.0000 (1.0) 502.4825 (1.00) 0.0000 (1.0) 0;0 1.9901 (1.00) 1 1 test_sharing_azure-checkout-noop[2.11.0] 500.4116 (1.0) 500.4116 (1.0) 500.4116 (1.0) 0.0000 (1.0) 500.4116 (1.0) 0.0000 (1.0) 0;0 1.9984 (1.0) 1 1 test_sharing_azure-checkout-noop[2.40.0] 586.3542 (1.17) 586.3542 (1.17) 586.3542 (1.17) 0.0000 (1.0) 586.3542 (1.17) 0.0000 (1.0) 0;0 1.7055 (0.85) 1 1 test_sharing_azure-checkout-noop[2.40.0] 592.7948 (1.18) 592.7948 (1.18) 592.7948 (1.18) 0.0000 (1.0) 592.7948 (1.18) 0.0000 (1.0) 0;0 1.6869 (0.84) 1 1 test_sharing_azure-checkout-noop[2.58.2] 700.8884 (1.40) 700.8884 (1.40) 700.8884 (1.40) 0.0000 (1.0) 700.8884 (1.40) 0.0000 (1.0) 0;0 1.4268 (0.71) 1 1 test_sharing_azure-checkout-noop[2.58.2] 699.6235 (1.40) 699.6235 (1.40) 699.6235 (1.40) 0.0000 (1.0) 699.6235 (1.40) 0.0000 (1.0) 0;0 1.4293 (0.72) 1 1 test_sharing_azure-checkout-noop[3.0.0] 719.0771 (1.44) 719.0771 (1.44) 719.0771 (1.44) 0.0000 (1.0) 719.0771 (1.44) 0.0000 (1.0) 0;0 1.3907 (0.70) 1 1 test_sharing_azure-checkout-noop[3.0.0] 721.1347 (1.44) 721.1347 (1.44) 721.1347 (1.44) 0.0000 (1.0) 721.1347 (1.44) 0.0000 (1.0) 0;0 1.3867 (0.69) 1 1 test_sharing_azure-checkout-noop[main] 710.8400 (1.42) 710.8400 (1.42) 710.8400 (1.42) 0.0000 (1.0) 710.8400 (1.42) 0.0000 (1.0) 0;0 1.4068 (0.70) 1 1 test_sharing_azure-checkout-noop[main] 717.6983 (1.43) 717.6983 (1.43) 717.6983 (1.43) 0.0000 (1.0) 717.6983 (1.43) 0.0000 (1.0) 0;0 1.3933 (0.70) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull[2.11.0] 7.3069 (1.32) 7.3069 (1.32) 7.3069 (1.32) 0.0000 (1.0) 7.3069 (1.32) 0.0000 (1.0) 0;0 0.1369 (0.76) 1 1 test_sharing_azure-pull[2.11.0] 7.3429 (1.33) 7.3429 (1.33) 7.3429 (1.33) 0.0000 (1.0) 7.3429 (1.33) 0.0000 (1.0) 0;0 0.1362 (0.75) 1 1 test_sharing_azure-pull[2.40.0] 8.6357 (1.56) 8.6357 (1.56) 8.6357 (1.56) 0.0000 (1.0) 8.6357 (1.56) 0.0000 (1.0) 0;0 0.1158 (0.64) 1 1 test_sharing_azure-pull[2.40.0] 8.9879 (1.63) 8.9879 (1.63) 8.9879 (1.63) 0.0000 (1.0) 8.9879 (1.63) 0.0000 (1.0) 0;0 0.1113 (0.62) 1 1 test_sharing_azure-pull[2.58.2] 5.5785 (1.01) 5.5785 (1.01) 5.5785 (1.01) 0.0000 (1.0) 5.5785 (1.01) 0.0000 (1.0) 0;0 0.1793 (0.99) 1 1 test_sharing_azure-pull[2.58.2] 5.5299 (1.0) 5.5299 (1.0) 5.5299 (1.0) 0.0000 (1.0) 5.5299 (1.0) 0.0000 (1.0) 0;0 0.1808 (1.0) 1 1 test_sharing_azure-pull[3.0.0] 7.8841 (1.43) 7.8841 (1.43) 7.8841 (1.43) 0.0000 (1.0) 7.8841 (1.43) 0.0000 (1.0) 0;0 0.1268 (0.70) 1 1 test_sharing_azure-pull[3.0.0] 7.8204 (1.41) 7.8204 (1.41) 7.8204 (1.41) 0.0000 (1.0) 7.8204 (1.41) 0.0000 (1.0) 0;0 0.1279 (0.71) 1 1 test_sharing_azure-pull[main] 7.7783 (1.41) 7.7783 (1.41) 7.7783 (1.41) 0.0000 (1.0) 7.7783 (1.41) 0.0000 (1.0) 0;0 0.1286 (0.71) 1 1 test_sharing_azure-pull[main] 7.8114 (1.41) 7.8114 (1.41) 7.8114 (1.41) 0.0000 (1.0) 7.8114 (1.41) 0.0000 (1.0) 0;0 0.1280 (0.71) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull-noop[2.11.0] 524.2633 (1.0) 524.2633 (1.0) 524.2633 (1.0) 0.0000 (1.0) 524.2633 (1.0) 0.0000 (1.0) 0;0 1.9074 (1.0) 1 1 test_sharing_azure-pull-noop[2.11.0] 527.3088 (1.01) 527.3088 (1.01) 527.3088 (1.01) 0.0000 (1.0) 527.3088 (1.01) 0.0000 (1.0) 0;0 1.8964 (0.99) 1 1 test_sharing_azure-pull-noop[2.40.0] 623.0316 (1.19) 623.0316 (1.19) 623.0316 (1.19) 0.0000 (1.0) 623.0316 (1.19) 0.0000 (1.0) 0;0 1.6051 (0.84) 1 1 test_sharing_azure-pull-noop[2.40.0] 625.5847 (1.19) 625.5847 (1.19) 625.5847 (1.19) 0.0000 (1.0) 625.5847 (1.19) 0.0000 (1.0) 0;0 1.5985 (0.84) 1 1 test_sharing_azure-pull-noop[2.58.2] 743.2459 (1.42) 743.2459 (1.42) 743.2459 (1.42) 0.0000 (1.0) 743.2459 (1.42) 0.0000 (1.0) 0;0 1.3454 (0.71) 1 1 test_sharing_azure-pull-noop[2.58.2] 747.3507 (1.43) 747.3507 (1.43) 747.3507 (1.43) 0.0000 (1.0) 747.3507 (1.43) 0.0000 (1.0) 0;0 1.3381 (0.70) 1 1 test_sharing_azure-pull-noop[3.0.0] 865.9207 (1.65) 865.9207 (1.65) 865.9207 (1.65) 0.0000 (1.0) 865.9207 (1.65) 0.0000 (1.0) 0;0 1.1548 (0.61) 1 1 test_sharing_azure-pull-noop[3.0.0] 858.5219 (1.64) 858.5219 (1.64) 858.5219 (1.64) 0.0000 (1.0) 858.5219 (1.64) 0.0000 (1.0) 0;0 1.1648 (0.61) 1 1 test_sharing_azure-pull-noop[main] 850.8015 (1.62) 850.8015 (1.62) 850.8015 (1.62) 0.0000 (1.0) 850.8015 (1.62) 0.0000 (1.0) 0;0 1.1754 (0.62) 1 1 test_sharing_azure-pull-noop[main] 849.6509 (1.62) 849.6509 (1.62) 849.6509 (1.62) 0.0000 (1.0) 849.6509 (1.62) 0.0000 (1.0) 0;0 1.1770 (0.62) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push[2.11.0] 4.0796 (2.36) 4.0796 (2.36) 4.0796 (2.36) 0.0000 (1.0) 4.0796 (2.36) 0.0000 (1.0) 0;0 0.2451 (0.42) 1 1 test_sharing_azure-push[2.11.0] 4.0328 (2.33) 4.0328 (2.33) 4.0328 (2.33) 0.0000 (1.0) 4.0328 (2.33) 0.0000 (1.0) 0;0 0.2480 (0.43) 1 1 test_sharing_azure-push[2.40.0] 5.0690 (2.93) 5.0690 (2.93) 5.0690 (2.93) 0.0000 (1.0) 5.0690 (2.93) 0.0000 (1.0) 0;0 0.1973 (0.34) 1 1 test_sharing_azure-push[2.40.0] 5.0515 (2.92) 5.0515 (2.92) 5.0515 (2.92) 0.0000 (1.0) 5.0515 (2.92) 0.0000 (1.0) 0;0 0.1980 (0.34) 1 1 test_sharing_azure-push[2.58.2] 3.5716 (2.06) 3.5716 (2.06) 3.5716 (2.06) 0.0000 (1.0) 3.5716 (2.06) 0.0000 (1.0) 0;0 0.2800 (0.48) 1 1 test_sharing_azure-push[2.58.2] 3.6287 (2.10) 3.6287 (2.10) 3.6287 (2.10) 0.0000 (1.0) 3.6287 (2.10) 0.0000 (1.0) 0;0 0.2756 (0.48) 1 1 test_sharing_azure-push[3.0.0] 1.7302 (1.0) 1.7302 (1.0) 1.7302 (1.0) 0.0000 (1.0) 1.7302 (1.0) 0.0000 (1.0) 0;0 0.5780 (1.0) 1 1 test_sharing_azure-push[3.0.0] 2.1281 (1.23) 2.1281 (1.23) 2.1281 (1.23) 0.0000 (1.0) 2.1281 (1.23) 0.0000 (1.0) 0;0 0.4699 (0.81) 1 1 test_sharing_azure-push[main] 3.5545 (2.05) 3.5545 (2.05) 3.5545 (2.05) 0.0000 (1.0) 3.5545 (2.05) 0.0000 (1.0) 0;0 0.2813 (0.49) 1 1 test_sharing_azure-push[main] 3.6738 (2.12) 3.6738 (2.12) 3.6738 (2.12) 0.0000 (1.0) 3.6738 (2.12) 0.0000 (1.0) 0;0 0.2722 (0.47) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests ------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push-noop[2.11.0] 451.3230 (1.02) 451.3230 (1.02) 451.3230 (1.02) 0.0000 (1.0) 451.3230 (1.02) 0.0000 (1.0) 0;0 2.2157 (0.98) 1 1 test_sharing_azure-push-noop[2.11.0] 440.9324 (1.0) 440.9324 (1.0) 440.9324 (1.0) 0.0000 (1.0) 440.9324 (1.0) 0.0000 (1.0) 0;0 2.2679 (1.0) 1 1 test_sharing_azure-push-noop[2.40.0] 482.0906 (1.09) 482.0906 (1.09) 482.0906 (1.09) 0.0000 (1.0) 482.0906 (1.09) 0.0000 (1.0) 0;0 2.0743 (0.91) 1 1 test_sharing_azure-push-noop[2.40.0] 480.7079 (1.09) 480.7079 (1.09) 480.7079 (1.09) 0.0000 (1.0) 480.7079 (1.09) 0.0000 (1.0) 0;0 2.0803 (0.92) 1 1 test_sharing_azure-push-noop[2.58.2] 573.9689 (1.30) 573.9689 (1.30) 573.9689 (1.30) 0.0000 (1.0) 573.9689 (1.30) 0.0000 (1.0) 0;0 1.7423 (0.77) 1 1 test_sharing_azure-push-noop[2.58.2] 578.0379 (1.31) 578.0379 (1.31) 578.0379 (1.31) 0.0000 (1.0) 578.0379 (1.31) 0.0000 (1.0) 0;0 1.7300 (0.76) 1 1 test_sharing_azure-push-noop[3.0.0] 573.4696 (1.30) 573.4696 (1.30) 573.4696 (1.30) 0.0000 (1.0) 573.4696 (1.30) 0.0000 (1.0) 0;0 1.7438 (0.77) 1 1 test_sharing_azure-push-noop[3.0.0] 1,084.7666 (2.46) 1,084.7666 (2.46) 1,084.7666 (2.46) 0.0000 (1.0) 1,084.7666 (2.46) 0.0000 (1.0) 0;0 0.9219 (0.41) 1 1 test_sharing_azure-push-noop[main] 565.5505 (1.28) 565.5505 (1.28) 565.5505 (1.28) 0.0000 (1.0) 565.5505 (1.28) 0.0000 (1.0) 0;0 1.7682 (0.78) 1 1 test_sharing_azure-push-noop[main] 568.1460 (1.29) 568.1460 (1.29) 568.1460 (1.29) 0.0000 (1.0) 568.1460 (1.29) 0.0000 (1.0) 0;0 1.7601 (0.78) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.40.0] 1.2312 (1.0) 1.2312 (1.0) 1.2312 (1.0) 0.0000 (1.0) 1.2312 (1.0) 0.0000 (1.0) 0;0 0.8122 (1.0) 1 1 test_data_status_all_flags-data-changed[2.58.2] 1.2895 (1.05) 1.2895 (1.05) 1.2895 (1.05) 0.0000 (1.0) 1.2895 (1.05) 0.0000 (1.0) 0;0 0.7755 (0.95) 1 1 test_data_status_all_flags-data-changed[3.0.0] 1.2930 (1.05) 1.2930 (1.05) 1.2930 (1.05) 0.0000 (1.0) 1.2930 (1.05) 0.0000 (1.0) 0;0 0.7734 (0.95) 1 1 test_data_status_all_flags-data-changed[main] 1.2591 (1.02) 1.2591 (1.02) 1.2591 (1.02) 0.0000 (1.0) 1.2591 (1.02) 0.0000 (1.0) 0;0 0.7942 (0.98) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.40.0] 1.2435 (1.0) 1.2435 (1.0) 1.2435 (1.0) 0.0000 (1.0) 1.2435 (1.0) 0.0000 (1.0) 0;0 0.8042 (1.0) 1 1 test_data_status_all_flags-data-changed-noop[2.58.2] 1.2898 (1.04) 1.2898 (1.04) 1.2898 (1.04) 0.0000 (1.0) 1.2898 (1.04) 0.0000 (1.0) 0;0 0.7753 (0.96) 1 1 test_data_status_all_flags-data-changed-noop[3.0.0] 1.2930 (1.04) 1.2930 (1.04) 1.2930 (1.04) 0.0000 (1.0) 1.2930 (1.04) 0.0000 (1.0) 0;0 0.7734 (0.96) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.2523 (1.01) 1.2523 (1.01) 1.2523 (1.01) 0.0000 (1.0) 1.2523 (1.01) 0.0000 (1.0) 0;0 0.7985 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.40.0] 2.1099 (1.03) 2.1099 (1.03) 2.1099 (1.03) 0.0000 (1.0) 2.1099 (1.03) 0.0000 (1.0) 0;0 0.4740 (0.97) 1 1 test_data_status_all_flags-data-new[2.58.2] 2.1042 (1.03) 2.1042 (1.03) 2.1042 (1.03) 0.0000 (1.0) 2.1042 (1.03) 0.0000 (1.0) 0;0 0.4753 (0.97) 1 1 test_data_status_all_flags-data-new[3.0.0] 2.1201 (1.04) 2.1201 (1.04) 2.1201 (1.04) 0.0000 (1.0) 2.1201 (1.04) 0.0000 (1.0) 0;0 0.4717 (0.96) 1 1 test_data_status_all_flags-data-new[main] 2.0441 (1.0) 2.0441 (1.0) 2.0441 (1.0) 0.0000 (1.0) 2.0441 (1.0) 0.0000 (1.0) 0;0 0.4892 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.40.0] 1.1805 (1.0) 1.1805 (1.0) 1.1805 (1.0) 0.0000 (1.0) 1.1805 (1.0) 0.0000 (1.0) 0;0 0.8471 (1.0) 1 1 test_data_status_all_flags-data-noop[2.58.2] 1.4051 (1.19) 1.4051 (1.19) 1.4051 (1.19) 0.0000 (1.0) 1.4051 (1.19) 0.0000 (1.0) 0;0 0.7117 (0.84) 1 1 test_data_status_all_flags-data-noop[3.0.0] 1.2412 (1.05) 1.2412 (1.05) 1.2412 (1.05) 0.0000 (1.0) 1.2412 (1.05) 0.0000 (1.0) 0;0 0.8057 (0.95) 1 1 test_data_status_all_flags-data-noop[main] 1.2165 (1.03) 1.2165 (1.03) 1.2165 (1.03) 0.0000 (1.0) 1.2165 (1.03) 0.0000 (1.0) 0;0 0.8220 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.11.0] 11.0582 (1.22) 11.0582 (1.22) 11.0582 (1.22) 0.0000 (1.0) 11.0582 (1.22) 0.0000 (1.0) 0;0 0.0904 (0.82) 1 1 test_import-import[2.40.0] 9.0627 (1.0) 9.0627 (1.0) 9.0627 (1.0) 0.0000 (1.0) 9.0627 (1.0) 0.0000 (1.0) 0;0 0.1103 (1.0) 1 1 test_import-import[2.58.2] 9.5532 (1.05) 9.5532 (1.05) 9.5532 (1.05) 0.0000 (1.0) 9.5532 (1.05) 0.0000 (1.0) 0;0 0.1047 (0.95) 1 1 test_import-import[3.0.0] 9.5974 (1.06) 9.5974 (1.06) 9.5974 (1.06) 0.0000 (1.0) 9.5974 (1.06) 0.0000 (1.0) 0;0 0.1042 (0.94) 1 1 test_import-import[main] 10.3129 (1.14) 10.3129 (1.14) 10.3129 (1.14) 0.0000 (1.0) 10.3129 (1.14) 0.0000 (1.0) 0;0 0.0970 (0.88) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.11.0] 6.2218 (2.47) 6.2218 (2.47) 6.2218 (2.47) 0.0000 (1.0) 6.2218 (2.47) 0.0000 (1.0) 0;0 0.1607 (0.40) 1 1 test_push-push[2.40.0] 7.4856 (2.97) 7.4856 (2.97) 7.4856 (2.97) 0.0000 (1.0) 7.4856 (2.97) 0.0000 (1.0) 0;0 0.1336 (0.34) 1 1 test_push-push[2.58.2] 5.1533 (2.05) 5.1533 (2.05) 5.1533 (2.05) 0.0000 (1.0) 5.1533 (2.05) 0.0000 (1.0) 0;0 0.1940 (0.49) 1 1 test_push-push[3.0.0] 2.5176 (1.0) 2.5176 (1.0) 2.5176 (1.0) 0.0000 (1.0) 2.5176 (1.0) 0.0000 (1.0) 0;0 0.3972 (1.0) 1 1 test_push-push[main] 5.3807 (2.14) 5.3807 (2.14) 5.3807 (2.14) 0.0000 (1.0) 5.3807 (2.14) 0.0000 (1.0) 0;0 0.1859 (0.47) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.11.0] 9.1456 (1.85) 9.1456 (1.85) 9.1456 (1.85) 0.0000 (1.0) 9.1456 (1.85) 0.0000 (1.0) 0;0 0.1093 (0.54) 1 1 test_sharing_s3-add[2.11.0] 8.4558 (1.71) 8.4558 (1.71) 8.4558 (1.71) 0.0000 (1.0) 8.4558 (1.71) 0.0000 (1.0) 0;0 0.1183 (0.58) 1 1 test_sharing_s3-add[2.40.0] 6.9243 (1.40) 6.9243 (1.40) 6.9243 (1.40) 0.0000 (1.0) 6.9243 (1.40) 0.0000 (1.0) 0;0 0.1444 (0.71) 1 1 test_sharing_s3-add[2.40.0] 7.4214 (1.51) 7.4214 (1.51) 7.4214 (1.51) 0.0000 (1.0) 7.4214 (1.51) 0.0000 (1.0) 0;0 0.1347 (0.66) 1 1 test_sharing_s3-add[2.58.2] 5.1919 (1.05) 5.1919 (1.05) 5.1919 (1.05) 0.0000 (1.0) 5.1919 (1.05) 0.0000 (1.0) 0;0 0.1926 (0.95) 1 1 test_sharing_s3-add[2.58.2] 5.0739 (1.03) 5.0739 (1.03) 5.0739 (1.03) 0.0000 (1.0) 5.0739 (1.03) 0.0000 (1.0) 0;0 0.1971 (0.97) 1 1 test_sharing_s3-add[3.0.0] 4.9892 (1.01) 4.9892 (1.01) 4.9892 (1.01) 0.0000 (1.0) 4.9892 (1.01) 0.0000 (1.0) 0;0 0.2004 (0.99) 1 1 test_sharing_s3-add[3.0.0] 4.9794 (1.01) 4.9794 (1.01) 4.9794 (1.01) 0.0000 (1.0) 4.9794 (1.01) 0.0000 (1.0) 0;0 0.2008 (0.99) 1 1 test_sharing_s3-add[main] 4.9308 (1.0) 4.9308 (1.0) 4.9308 (1.0) 0.0000 (1.0) 4.9308 (1.0) 0.0000 (1.0) 0;0 0.2028 (1.0) 1 1 test_sharing_s3-add[main] 4.9769 (1.01) 4.9769 (1.01) 4.9769 (1.01) 0.0000 (1.0) 4.9769 (1.01) 0.0000 (1.0) 0;0 0.2009 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.11.0] 4.2097 (1.40) 4.2097 (1.40) 4.2097 (1.40) 0.0000 (1.0) 4.2097 (1.40) 0.0000 (1.0) 0;0 0.2375 (0.72) 1 1 test_sharing_s3-add-noop[2.11.0] 4.2680 (1.41) 4.2680 (1.41) 4.2680 (1.41) 0.0000 (1.0) 4.2680 (1.41) 0.0000 (1.0) 0;0 0.2343 (0.71) 1 1 test_sharing_s3-add-noop[2.40.0] 3.0313 (1.00) 3.0313 (1.00) 3.0313 (1.00) 0.0000 (1.0) 3.0313 (1.00) 0.0000 (1.0) 0;0 0.3299 (1.00) 1 1 test_sharing_s3-add-noop[2.40.0] 3.0170 (1.0) 3.0170 (1.0) 3.0170 (1.0) 0.0000 (1.0) 3.0170 (1.0) 0.0000 (1.0) 0;0 0.3315 (1.0) 1 1 test_sharing_s3-add-noop[2.58.2] 3.3280 (1.10) 3.3280 (1.10) 3.3280 (1.10) 0.0000 (1.0) 3.3280 (1.10) 0.0000 (1.0) 0;0 0.3005 (0.91) 1 1 test_sharing_s3-add-noop[2.58.2] 3.3254 (1.10) 3.3254 (1.10) 3.3254 (1.10) 0.0000 (1.0) 3.3254 (1.10) 0.0000 (1.0) 0;0 0.3007 (0.91) 1 1 test_sharing_s3-add-noop[3.0.0] 3.3037 (1.10) 3.3037 (1.10) 3.3037 (1.10) 0.0000 (1.0) 3.3037 (1.10) 0.0000 (1.0) 0;0 0.3027 (0.91) 1 1 test_sharing_s3-add-noop[3.0.0] 3.3599 (1.11) 3.3599 (1.11) 3.3599 (1.11) 0.0000 (1.0) 3.3599 (1.11) 0.0000 (1.0) 0;0 0.2976 (0.90) 1 1 test_sharing_s3-add-noop[main] 3.2970 (1.09) 3.2970 (1.09) 3.2970 (1.09) 0.0000 (1.0) 3.2970 (1.09) 0.0000 (1.0) 0;0 0.3033 (0.92) 1 1 test_sharing_s3-add-noop[main] 3.3290 (1.10) 3.3290 (1.10) 3.3290 (1.10) 0.0000 (1.0) 3.3290 (1.10) 0.0000 (1.0) 0;0 0.3004 (0.91) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-checkout-noop[2.11.0] 601.2349 (1.00) 601.2349 (1.00) 601.2349 (1.00) 0.0000 (1.0) 601.2349 (1.00) 0.0000 (1.0) 0;0 1.6632 (1.00) 1 1 test_sharing_s3-checkout-noop[2.11.0] 599.2149 (1.0) 599.2149 (1.0) 599.2149 (1.0) 0.0000 (1.0) 599.2149 (1.0) 0.0000 (1.0) 0;0 1.6689 (1.0) 1 1 test_sharing_s3-checkout-noop[2.40.0] 704.3395 (1.18) 704.3395 (1.18) 704.3395 (1.18) 0.0000 (1.0) 704.3395 (1.18) 0.0000 (1.0) 0;0 1.4198 (0.85) 1 1 test_sharing_s3-checkout-noop[2.40.0] 680.8463 (1.14) 680.8463 (1.14) 680.8463 (1.14) 0.0000 (1.0) 680.8463 (1.14) 0.0000 (1.0) 0;0 1.4688 (0.88) 1 1 test_sharing_s3-checkout-noop[2.58.2] 825.4687 (1.38) 825.4687 (1.38) 825.4687 (1.38) 0.0000 (1.0) 825.4687 (1.38) 0.0000 (1.0) 0;0 1.2114 (0.73) 1 1 test_sharing_s3-checkout-noop[2.58.2] 835.2175 (1.39) 835.2175 (1.39) 835.2175 (1.39) 0.0000 (1.0) 835.2175 (1.39) 0.0000 (1.0) 0;0 1.1973 (0.72) 1 1 test_sharing_s3-checkout-noop[3.0.0] 1,119.2216 (1.87) 1,119.2216 (1.87) 1,119.2216 (1.87) 0.0000 (1.0) 1,119.2216 (1.87) 0.0000 (1.0) 0;0 0.8935 (0.54) 1 1 test_sharing_s3-checkout-noop[3.0.0] 1,112.1888 (1.86) 1,112.1888 (1.86) 1,112.1888 (1.86) 0.0000 (1.0) 1,112.1888 (1.86) 0.0000 (1.0) 0;0 0.8991 (0.54) 1 1 test_sharing_s3-checkout-noop[main] 840.3676 (1.40) 840.3676 (1.40) 840.3676 (1.40) 0.0000 (1.0) 840.3676 (1.40) 0.0000 (1.0) 0;0 1.1900 (0.71) 1 1 test_sharing_s3-checkout-noop[main] 866.1095 (1.45) 866.1095 (1.45) 866.1095 (1.45) 0.0000 (1.0) 866.1095 (1.45) 0.0000 (1.0) 0;0 1.1546 (0.69) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.11.0] 18.1143 (1.28) 18.1143 (1.28) 18.1143 (1.28) 0.0000 (1.0) 18.1143 (1.28) 0.0000 (1.0) 0;0 0.0552 (0.78) 1 1 test_sharing_s3-pull[2.11.0] 18.2152 (1.29) 18.2152 (1.29) 18.2152 (1.29) 0.0000 (1.0) 18.2152 (1.29) 0.0000 (1.0) 0;0 0.0549 (0.77) 1 1 test_sharing_s3-pull[2.40.0] 18.5828 (1.32) 18.5828 (1.32) 18.5828 (1.32) 0.0000 (1.0) 18.5828 (1.32) 0.0000 (1.0) 0;0 0.0538 (0.76) 1 1 test_sharing_s3-pull[2.40.0] 18.7888 (1.33) 18.7888 (1.33) 18.7888 (1.33) 0.0000 (1.0) 18.7888 (1.33) 0.0000 (1.0) 0;0 0.0532 (0.75) 1 1 test_sharing_s3-pull[2.58.2] 14.1093 (1.0) 14.1093 (1.0) 14.1093 (1.0) 0.0000 (1.0) 14.1093 (1.0) 0.0000 (1.0) 0;0 0.0709 (1.0) 1 1 test_sharing_s3-pull[2.58.2] 14.1355 (1.00) 14.1355 (1.00) 14.1355 (1.00) 0.0000 (1.0) 14.1355 (1.00) 0.0000 (1.0) 0;0 0.0707 (1.00) 1 1 test_sharing_s3-pull[3.0.0] 15.5503 (1.10) 15.5503 (1.10) 15.5503 (1.10) 0.0000 (1.0) 15.5503 (1.10) 0.0000 (1.0) 0;0 0.0643 (0.91) 1 1 test_sharing_s3-pull[3.0.0] 15.5008 (1.10) 15.5008 (1.10) 15.5008 (1.10) 0.0000 (1.0) 15.5008 (1.10) 0.0000 (1.0) 0;0 0.0645 (0.91) 1 1 test_sharing_s3-pull[main] 15.4575 (1.10) 15.4575 (1.10) 15.4575 (1.10) 0.0000 (1.0) 15.4575 (1.10) 0.0000 (1.0) 0;0 0.0647 (0.91) 1 1 test_sharing_s3-pull[main] 15.6941 (1.11) 15.6941 (1.11) 15.6941 (1.11) 0.0000 (1.0) 15.6941 (1.11) 0.0000 (1.0) 0;0 0.0637 (0.90) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.11.0] 878.1746 (1.0) 878.1746 (1.0) 878.1746 (1.0) 0.0000 (1.0) 878.1746 (1.0) 0.0000 (1.0) 0;0 1.1387 (1.0) 1 1 test_sharing_s3-pull-noop[2.11.0] 882.3240 (1.00) 882.3240 (1.00) 882.3240 (1.00) 0.0000 (1.0) 882.3240 (1.00) 0.0000 (1.0) 0;0 1.1334 (1.00) 1 1 test_sharing_s3-pull-noop[2.40.0] 971.9150 (1.11) 971.9150 (1.11) 971.9150 (1.11) 0.0000 (1.0) 971.9150 (1.11) 0.0000 (1.0) 0;0 1.0289 (0.90) 1 1 test_sharing_s3-pull-noop[2.40.0] 978.6173 (1.11) 978.6173 (1.11) 978.6173 (1.11) 0.0000 (1.0) 978.6173 (1.11) 0.0000 (1.0) 0;0 1.0218 (0.90) 1 1 test_sharing_s3-pull-noop[2.58.2] 1,133.0332 (1.29) 1,133.0332 (1.29) 1,133.0332 (1.29) 0.0000 (1.0) 1,133.0332 (1.29) 0.0000 (1.0) 0;0 0.8826 (0.78) 1 1 test_sharing_s3-pull-noop[2.58.2] 1,120.3237 (1.28) 1,120.3237 (1.28) 1,120.3237 (1.28) 0.0000 (1.0) 1,120.3237 (1.28) 0.0000 (1.0) 0;0 0.8926 (0.78) 1 1 test_sharing_s3-pull-noop[3.0.0] 1,297.4558 (1.48) 1,297.4558 (1.48) 1,297.4558 (1.48) 0.0000 (1.0) 1,297.4558 (1.48) 0.0000 (1.0) 0;0 0.7707 (0.68) 1 1 test_sharing_s3-pull-noop[3.0.0] 1,280.2393 (1.46) 1,280.2393 (1.46) 1,280.2393 (1.46) 0.0000 (1.0) 1,280.2393 (1.46) 0.0000 (1.0) 0;0 0.7811 (0.69) 1 1 test_sharing_s3-pull-noop[main] 1,642.9050 (1.87) 1,642.9050 (1.87) 1,642.9050 (1.87) 0.0000 (1.0) 1,642.9050 (1.87) 0.0000 (1.0) 0;0 0.6087 (0.53) 1 1 test_sharing_s3-pull-noop[main] 1,663.0974 (1.89) 1,663.0974 (1.89) 1,663.0974 (1.89) 0.0000 (1.0) 1,663.0974 (1.89) 0.0000 (1.0) 0;0 0.6013 (0.53) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.11.0] 26.3191 (2.60) 26.3191 (2.60) 26.3191 (2.60) 0.0000 (1.0) 26.3191 (2.60) 0.0000 (1.0) 0;0 0.0380 (0.38) 1 1 test_sharing_s3-push[2.11.0] 26.0679 (2.58) 26.0679 (2.58) 26.0679 (2.58) 0.0000 (1.0) 26.0679 (2.58) 0.0000 (1.0) 0;0 0.0384 (0.39) 1 1 test_sharing_s3-push[2.40.0] 28.1417 (2.78) 28.1417 (2.78) 28.1417 (2.78) 0.0000 (1.0) 28.1417 (2.78) 0.0000 (1.0) 0;0 0.0355 (0.36) 1 1 test_sharing_s3-push[2.40.0] 27.9029 (2.76) 27.9029 (2.76) 27.9029 (2.76) 0.0000 (1.0) 27.9029 (2.76) 0.0000 (1.0) 0;0 0.0358 (0.36) 1 1 test_sharing_s3-push[2.58.2] 11.5393 (1.14) 11.5393 (1.14) 11.5393 (1.14) 0.0000 (1.0) 11.5393 (1.14) 0.0000 (1.0) 0;0 0.0867 (0.88) 1 1 test_sharing_s3-push[2.58.2] 11.5462 (1.14) 11.5462 (1.14) 11.5462 (1.14) 0.0000 (1.0) 11.5462 (1.14) 0.0000 (1.0) 0;0 0.0866 (0.88) 1 1 test_sharing_s3-push[3.0.0] 10.1083 (1.0) 10.1083 (1.0) 10.1083 (1.0) 0.0000 (1.0) 10.1083 (1.0) 0.0000 (1.0) 0;0 0.0989 (1.0) 1 1 test_sharing_s3-push[3.0.0] 10.1749 (1.01) 10.1749 (1.01) 10.1749 (1.01) 0.0000 (1.0) 10.1749 (1.01) 0.0000 (1.0) 0;0 0.0983 (0.99) 1 1 test_sharing_s3-push[main] 11.4585 (1.13) 11.4585 (1.13) 11.4585 (1.13) 0.0000 (1.0) 11.4585 (1.13) 0.0000 (1.0) 0;0 0.0873 (0.88) 1 1 test_sharing_s3-push[main] 11.5034 (1.14) 11.5034 (1.14) 11.5034 (1.14) 0.0000 (1.0) 11.5034 (1.14) 0.0000 (1.0) 0;0 0.0869 (0.88) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-push-noop[2.11.0] 1.1660 (1.01) 1.1660 (1.01) 1.1660 (1.01) 0.0000 (1.0) 1.1660 (1.01) 0.0000 (1.0) 0;0 0.8576 (0.99) 1 1 test_sharing_s3-push-noop[2.11.0] 1.1586 (1.0) 1.1586 (1.0) 1.1586 (1.0) 0.0000 (1.0) 1.1586 (1.0) 0.0000 (1.0) 0;0 0.8631 (1.0) 1 1 test_sharing_s3-push-noop[2.40.0] 1.1896 (1.03) 1.1896 (1.03) 1.1896 (1.03) 0.0000 (1.0) 1.1896 (1.03) 0.0000 (1.0) 0;0 0.8406 (0.97) 1 1 test_sharing_s3-push-noop[2.40.0] 1.1897 (1.03) 1.1897 (1.03) 1.1897 (1.03) 0.0000 (1.0) 1.1897 (1.03) 0.0000 (1.0) 0;0 0.8405 (0.97) 1 1 test_sharing_s3-push-noop[2.58.2] 1.3112 (1.13) 1.3112 (1.13) 1.3112 (1.13) 0.0000 (1.0) 1.3112 (1.13) 0.0000 (1.0) 0;0 0.7626 (0.88) 1 1 test_sharing_s3-push-noop[2.58.2] 1.3290 (1.15) 1.3290 (1.15) 1.3290 (1.15) 0.0000 (1.0) 1.3290 (1.15) 0.0000 (1.0) 0;0 0.7524 (0.87) 1 1 test_sharing_s3-push-noop[3.0.0] 1.3131 (1.13) 1.3131 (1.13) 1.3131 (1.13) 0.0000 (1.0) 1.3131 (1.13) 0.0000 (1.0) 0;0 0.7616 (0.88) 1 1 test_sharing_s3-push-noop[3.0.0] 1.3031 (1.12) 1.3031 (1.12) 1.3031 (1.12) 0.0000 (1.0) 1.3031 (1.12) 0.0000 (1.0) 0;0 0.7674 (0.89) 1 1 test_sharing_s3-push-noop[main] 1.2853 (1.11) 1.2853 (1.11) 1.2853 (1.11) 0.0000 (1.0) 1.2853 (1.11) 0.0000 (1.0) 0;0 0.7780 (0.90) 1 1 test_sharing_s3-push-noop[main] 1.2848 (1.11) 1.2848 (1.11) 1.2848 (1.11) 0.0000 (1.0) 1.2848 (1.11) 0.0000 (1.0) 0;0 0.7783 (0.90) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.11.0] 2.5372 (1.53) 2.5372 (1.53) 2.5372 (1.53) 0.0000 (1.0) 2.5372 (1.53) 0.0000 (1.0) 0;0 0.3941 (0.65) 1 1 test_status-status[2.40.0] 1.6588 (1.0) 1.6588 (1.0) 1.6588 (1.0) 0.0000 (1.0) 1.6588 (1.0) 0.0000 (1.0) 0;0 0.6029 (1.0) 1 1 test_status-status[2.58.2] 1.7462 (1.05) 1.7462 (1.05) 1.7462 (1.05) 0.0000 (1.0) 1.7462 (1.05) 0.0000 (1.0) 0;0 0.5727 (0.95) 1 1 test_status-status[3.0.0] 1.7542 (1.06) 1.7542 (1.06) 1.7542 (1.06) 0.0000 (1.0) 1.7542 (1.06) 0.0000 (1.0) 0;0 0.5701 (0.95) 1 1 test_status-status[main] 1.7502 (1.06) 1.7502 (1.06) 1.7502 (1.06) 0.0000 (1.0) 1.7502 (1.06) 0.0000 (1.0) 0;0 0.5714 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.11.0] 1.8819 (2.86) 1.8819 (2.86) 1.8819 (2.86) 0.0000 (1.0) 1.8819 (2.86) 0.0000 (1.0) 0;0 0.5314 (0.35) 1 1 test_status-status-changed[2.40.0] 0.6571 (1.0) 0.6571 (1.0) 0.6571 (1.0) 0.0000 (1.0) 0.6571 (1.0) 0.0000 (1.0) 0;0 1.5217 (1.0) 1 1 test_status-status-changed[2.58.2] 0.7895 (1.20) 0.7895 (1.20) 0.7895 (1.20) 0.0000 (1.0) 0.7895 (1.20) 0.0000 (1.0) 0;0 1.2667 (0.83) 1 1 test_status-status-changed[3.0.0] 0.7694 (1.17) 0.7694 (1.17) 0.7694 (1.17) 0.0000 (1.0) 0.7694 (1.17) 0.0000 (1.0) 0;0 1.2998 (0.85) 1 1 test_status-status-changed[main] 0.7404 (1.13) 0.7404 (1.13) 0.7404 (1.13) 0.0000 (1.0) 0.7404 (1.13) 0.0000 (1.0) 0;0 1.3507 (0.89) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.11.0] 818.4812 (1.29) 818.4812 (1.29) 818.4812 (1.29) 0.0000 (1.0) 818.4812 (1.29) 0.0000 (1.0) 0;0 1.2218 (0.77) 1 1 test_status-status-changed-noop[2.40.0] 633.5036 (1.0) 633.5036 (1.0) 633.5036 (1.0) 0.0000 (1.0) 633.5036 (1.0) 0.0000 (1.0) 0;0 1.5785 (1.0) 1 1 test_status-status-changed-noop[2.58.2] 862.2554 (1.36) 862.2554 (1.36) 862.2554 (1.36) 0.0000 (1.0) 862.2554 (1.36) 0.0000 (1.0) 0;0 1.1597 (0.73) 1 1 test_status-status-changed-noop[3.0.0] 754.8912 (1.19) 754.8912 (1.19) 754.8912 (1.19) 0.0000 (1.0) 754.8912 (1.19) 0.0000 (1.0) 0;0 1.3247 (0.84) 1 1 test_status-status-changed-noop[main] 754.8560 (1.19) 754.8560 (1.19) 754.8560 (1.19) 0.0000 (1.0) 754.8560 (1.19) 0.0000 (1.0) 0;0 1.3248 (0.84) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.11.0] 515.7513 (1.0) 515.7513 (1.0) 515.7513 (1.0) 0.0000 (1.0) 515.7513 (1.0) 0.0000 (1.0) 0;0 1.9389 (1.0) 1 1 test_status-status-noop[2.40.0] 629.7099 (1.22) 629.7099 (1.22) 629.7099 (1.22) 0.0000 (1.0) 629.7099 (1.22) 0.0000 (1.0) 0;0 1.5880 (0.82) 1 1 test_status-status-noop[2.58.2] 795.1199 (1.54) 795.1199 (1.54) 795.1199 (1.54) 0.0000 (1.0) 795.1199 (1.54) 0.0000 (1.0) 0;0 1.2577 (0.65) 1 1 test_status-status-noop[3.0.0] 756.6822 (1.47) 756.6822 (1.47) 756.6822 (1.47) 0.0000 (1.0) 756.6822 (1.47) 0.0000 (1.0) 0;0 1.3216 (0.68) 1 1 test_status-status-noop[main] 736.7598 (1.43) 736.7598 (1.43) 736.7598 (1.43) 0.0000 (1.0) 736.7598 (1.43) 0.0000 (1.0) 0;0 1.3573 (0.70) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-import-url': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-import-url[2.11.0] 9.9626 (1.36) 9.9626 (1.36) 9.9626 (1.36) 0.0000 (1.0) 9.9626 (1.36) 0.0000 (1.0) 0;0 0.1004 (0.73) 1 1 test_update-import-url[2.40.0] 8.9775 (1.23) 8.9775 (1.23) 8.9775 (1.23) 0.0000 (1.0) 8.9775 (1.23) 0.0000 (1.0) 0;0 0.1114 (0.82) 1 1 test_update-import-url[2.58.2] 7.3209 (1.0) 7.3209 (1.0) 7.3209 (1.0) 0.0000 (1.0) 7.3209 (1.0) 0.0000 (1.0) 0;0 0.1366 (1.0) 1 1 test_update-import-url[3.0.0] 7.3879 (1.01) 7.3879 (1.01) 7.3879 (1.01) 0.0000 (1.0) 7.3879 (1.01) 0.0000 (1.0) 0;0 0.1354 (0.99) 1 1 test_update-import-url[main] 7.5404 (1.03) 7.5404 (1.03) 7.5404 (1.03) 0.0000 (1.0) 7.5404 (1.03) 0.0000 (1.0) 0;0 0.1326 (0.97) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.11.0] 8.0853 (1.34) 8.0853 (1.34) 8.0853 (1.34) 0.0000 (1.0) 8.0853 (1.34) 0.0000 (1.0) 0;0 0.1237 (0.74) 1 1 test_update-update[2.40.0] 6.0156 (1.0) 6.0156 (1.0) 6.0156 (1.0) 0.0000 (1.0) 6.0156 (1.0) 0.0000 (1.0) 0;0 0.1662 (1.0) 1 1 test_update-update[2.58.2] 6.5091 (1.08) 6.5091 (1.08) 6.5091 (1.08) 0.0000 (1.0) 6.5091 (1.08) 0.0000 (1.0) 0;0 0.1536 (0.92) 1 1 test_update-update[3.0.0] 6.5836 (1.09) 6.5836 (1.09) 6.5836 (1.09) 0.0000 (1.0) 6.5836 (1.09) 0.0000 (1.0) 0;0 0.1519 (0.91) 1 1 test_update-update[main] 6.7055 (1.11) 6.7055 (1.11) 6.7055 (1.11) 0.0000 (1.0) 6.7055 (1.11) 0.0000 (1.0) 0;0 0.1491 (0.90) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update-noop[2.11.0] 480.6041 (1.0) 480.6041 (1.0) 480.6041 (1.0) 0.0000 (1.0) 480.6041 (1.0) 0.0000 (1.0) 0;0 2.0807 (1.0) 1 1 test_update-update-noop[2.40.0] 898.6937 (1.87) 898.6937 (1.87) 898.6937 (1.87) 0.0000 (1.0) 898.6937 (1.87) 0.0000 (1.0) 0;0 1.1127 (0.53) 1 1 test_update-update-noop[2.58.2] 1,083.4347 (2.25) 1,083.4347 (2.25) 1,083.4347 (2.25) 0.0000 (1.0) 1,083.4347 (2.25) 0.0000 (1.0) 0;0 0.9230 (0.44) 1 1 test_update-update-noop[3.0.0] 1,094.9209 (2.28) 1,094.9209 (2.28) 1,094.9209 (2.28) 0.0000 (1.0) 1,094.9209 (2.28) 0.0000 (1.0) 0;0 0.9133 (0.44) 1 1 test_update-update-noop[main] 1,107.8950 (2.31) 1,107.8950 (2.31) 1,107.8950 (2.31) 0.0000 (1.0) 1,107.8950 (2.31) 0.0000 (1.0) 0;0 0.9026 (0.43) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 year ago 
github-actions[bot]
commented
1 year ago