Closed dberenbaum closed 10 months ago
Tue Oct 31 20:30:24 UTC 2023 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.58.2] 1.4818 (1.0) 1.4818 (1.0) 1.4818 (1.0) 0.0000 (1.0) 1.4818 (1.0) 0.0000 (1.0) 0;0 0.6748 (1.0) 1 1 test_status-status[3.0.0] 2.0423 (1.38) 2.0423 (1.38) 2.0423 (1.38) 0.0000 (1.0) 2.0423 (1.38) 0.0000 (1.0) 0;0 0.4896 (0.73) 1 1 test_status-status[3.10.0] 1.5477 (1.04) 1.5477 (1.04) 1.5477 (1.04) 0.0000 (1.0) 1.5477 (1.04) 0.0000 (1.0) 0;0 0.6461 (0.96) 1 1 test_status-status[3.20.0] 1.5074 (1.02) 1.5074 (1.02) 1.5074 (1.02) 0.0000 (1.0) 1.5074 (1.02) 0.0000 (1.0) 0;0 0.6634 (0.98) 1 1 test_status-status[main] 1.4925 (1.01) 1.4925 (1.01) 1.4925 (1.01) 0.0000 (1.0) 1.4925 (1.01) 0.0000 (1.0) 0;0 0.6700 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.58.2] 1.1548 (1.78) 1.1548 (1.78) 1.1548 (1.78) 0.0000 (1.0) 1.1548 (1.78) 0.0000 (1.0) 0;0 0.8660 (0.56) 1 1 test_status-status-changed[3.0.0] 0.6485 (1.0) 0.6485 (1.0) 0.6485 (1.0) 0.0000 (1.0) 0.6485 (1.0) 0.0000 (1.0) 0;0 1.5419 (1.0) 1 1 test_status-status-changed[3.10.0] 0.6687 (1.03) 0.6687 (1.03) 0.6687 (1.03) 0.0000 (1.0) 0.6687 (1.03) 0.0000 (1.0) 0;0 1.4955 (0.97) 1 1 test_status-status-changed[3.20.0] 0.6679 (1.03) 0.6679 (1.03) 0.6679 (1.03) 0.0000 (1.0) 0.6679 (1.03) 0.0000 (1.0) 0;0 1.4972 (0.97) 1 1 test_status-status-changed[main] 0.6529 (1.01) 0.6529 (1.01) 0.6529 (1.01) 0.0000 (1.0) 0.6529 (1.01) 0.0000 (1.0) 0;0 1.5317 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.58.2] 640.3542 (1.00) 640.3542 (1.00) 640.3542 (1.00) 0.0000 (1.0) 640.3542 (1.00) 0.0000 (1.0) 0;0 1.5616 (1.00) 1 1 test_status-status-changed-noop[3.0.0] 638.8938 (1.0) 638.8938 (1.0) 638.8938 (1.0) 0.0000 (1.0) 638.8938 (1.0) 0.0000 (1.0) 0;0 1.5652 (1.0) 1 1 test_status-status-changed-noop[3.10.0] 670.1799 (1.05) 670.1799 (1.05) 670.1799 (1.05) 0.0000 (1.0) 670.1799 (1.05) 0.0000 (1.0) 0;0 1.4921 (0.95) 1 1 test_status-status-changed-noop[3.20.0] 669.9017 (1.05) 669.9017 (1.05) 669.9017 (1.05) 0.0000 (1.0) 669.9017 (1.05) 0.0000 (1.0) 0;0 1.4928 (0.95) 1 1 test_status-status-changed-noop[main] 668.0116 (1.05) 668.0116 (1.05) 668.0116 (1.05) 0.0000 (1.0) 668.0116 (1.05) 0.0000 (1.0) 0;0 1.4970 (0.96) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.58.2] 646.9168 (1.00) 646.9168 (1.00) 646.9168 (1.00) 0.0000 (1.0) 646.9168 (1.00) 0.0000 (1.0) 0;0 1.5458 (1.00) 1 1 test_status-status-noop[3.0.0] 644.2204 (1.0) 644.2204 (1.0) 644.2204 (1.0) 0.0000 (1.0) 644.2204 (1.0) 0.0000 (1.0) 0;0 1.5523 (1.0) 1 1 test_status-status-noop[3.10.0] 664.2005 (1.03) 664.2005 (1.03) 664.2005 (1.03) 0.0000 (1.0) 664.2005 (1.03) 0.0000 (1.0) 0;0 1.5056 (0.97) 1 1 test_status-status-noop[3.20.0] 663.6152 (1.03) 663.6152 (1.03) 663.6152 (1.03) 0.0000 (1.0) 663.6152 (1.03) 0.0000 (1.0) 0;0 1.5069 (0.97) 1 1 test_status-status-noop[main] 661.4402 (1.03) 661.4402 (1.03) 661.4402 (1.03) 0.0000 (1.0) 661.4402 (1.03) 0.0000 (1.0) 0;0 1.5119 (0.97) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.58.2] 1.0313 (1.00) 1.0313 (1.00) 1.0313 (1.00) 0.0000 (1.0) 1.0313 (1.00) 0.0000 (1.0) 0;0 0.9697 (1.00) 1 1 test_data_status_all_flags-data-changed[3.0.0] 1.0274 (1.0) 1.0274 (1.0) 1.0274 (1.0) 0.0000 (1.0) 1.0274 (1.0) 0.0000 (1.0) 0;0 0.9733 (1.0) 1 1 test_data_status_all_flags-data-changed[3.10.0] 1.0428 (1.01) 1.0428 (1.01) 1.0428 (1.01) 0.0000 (1.0) 1.0428 (1.01) 0.0000 (1.0) 0;0 0.9590 (0.99) 1 1 test_data_status_all_flags-data-changed[3.20.0] 1.0340 (1.01) 1.0340 (1.01) 1.0340 (1.01) 0.0000 (1.0) 1.0340 (1.01) 0.0000 (1.0) 0;0 0.9671 (0.99) 1 1 test_data_status_all_flags-data-changed[main] 1.0425 (1.01) 1.0425 (1.01) 1.0425 (1.01) 0.0000 (1.0) 1.0425 (1.01) 0.0000 (1.0) 0;0 0.9593 (0.99) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.58.2] 1.0420 (1.01) 1.0420 (1.01) 1.0420 (1.01) 0.0000 (1.0) 1.0420 (1.01) 0.0000 (1.0) 0;0 0.9597 (0.99) 1 1 test_data_status_all_flags-data-changed-noop[3.0.0] 1.0592 (1.02) 1.0592 (1.02) 1.0592 (1.02) 0.0000 (1.0) 1.0592 (1.02) 0.0000 (1.0) 0;0 0.9441 (0.98) 1 1 test_data_status_all_flags-data-changed-noop[3.10.0] 1.0341 (1.0) 1.0341 (1.0) 1.0341 (1.0) 0.0000 (1.0) 1.0341 (1.0) 0.0000 (1.0) 0;0 0.9670 (1.0) 1 1 test_data_status_all_flags-data-changed-noop[3.20.0] 1.1041 (1.07) 1.1041 (1.07) 1.1041 (1.07) 0.0000 (1.0) 1.1041 (1.07) 0.0000 (1.0) 0;0 0.9057 (0.94) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.0365 (1.00) 1.0365 (1.00) 1.0365 (1.00) 0.0000 (1.0) 1.0365 (1.00) 0.0000 (1.0) 0;0 0.9648 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.58.2] 1.7283 (1.03) 1.7283 (1.03) 1.7283 (1.03) 0.0000 (1.0) 1.7283 (1.03) 0.0000 (1.0) 0;0 0.5786 (0.97) 1 1 test_data_status_all_flags-data-new[3.0.0] 1.7373 (1.03) 1.7373 (1.03) 1.7373 (1.03) 0.0000 (1.0) 1.7373 (1.03) 0.0000 (1.0) 0;0 0.5756 (0.97) 1 1 test_data_status_all_flags-data-new[3.10.0] 1.7015 (1.01) 1.7015 (1.01) 1.7015 (1.01) 0.0000 (1.0) 1.7015 (1.01) 0.0000 (1.0) 0;0 0.5877 (0.99) 1 1 test_data_status_all_flags-data-new[3.20.0] 1.6811 (1.0) 1.6811 (1.0) 1.6811 (1.0) 0.0000 (1.0) 1.6811 (1.0) 0.0000 (1.0) 0;0 0.5948 (1.0) 1 1 test_data_status_all_flags-data-new[main] 1.7049 (1.01) 1.7049 (1.01) 1.7049 (1.01) 0.0000 (1.0) 1.7049 (1.01) 0.0000 (1.0) 0;0 0.5865 (0.99) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.58.2] 1.0137 (1.0) 1.0137 (1.0) 1.0137 (1.0) 0.0000 (1.0) 1.0137 (1.0) 0.0000 (1.0) 0;0 0.9865 (1.0) 1 1 test_data_status_all_flags-data-noop[3.0.0] 1.0329 (1.02) 1.0329 (1.02) 1.0329 (1.02) 0.0000 (1.0) 1.0329 (1.02) 0.0000 (1.0) 0;0 0.9682 (0.98) 1 1 test_data_status_all_flags-data-noop[3.10.0] 1.0146 (1.00) 1.0146 (1.00) 1.0146 (1.00) 0.0000 (1.0) 1.0146 (1.00) 0.0000 (1.0) 0;0 0.9856 (1.00) 1 1 test_data_status_all_flags-data-noop[3.20.0] 1.0204 (1.01) 1.0204 (1.01) 1.0204 (1.01) 0.0000 (1.0) 1.0204 (1.01) 0.0000 (1.0) 0;0 0.9800 (0.99) 1 1 test_data_status_all_flags-data-noop[main] 1.0218 (1.01) 1.0218 (1.01) 1.0218 (1.01) 0.0000 (1.0) 1.0218 (1.01) 0.0000 (1.0) 0;0 0.9787 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[2.58.2] 3.5489 (1.01) 3.5489 (1.01) 3.5489 (1.01) 0.0000 (1.0) 3.5489 (1.01) 0.0000 (1.0) 0;0 0.2818 (0.99) 1 1 test_add-add[3.0.0] 3.5562 (1.01) 3.5562 (1.01) 3.5562 (1.01) 0.0000 (1.0) 3.5562 (1.01) 0.0000 (1.0) 0;0 0.2812 (0.99) 1 1 test_add-add[3.10.0] 3.5670 (1.01) 3.5670 (1.01) 3.5670 (1.01) 0.0000 (1.0) 3.5670 (1.01) 0.0000 (1.0) 0;0 0.2803 (0.99) 1 1 test_add-add[3.20.0] 3.5214 (1.0) 3.5214 (1.0) 3.5214 (1.0) 0.0000 (1.0) 3.5214 (1.0) 0.0000 (1.0) 0;0 0.2840 (1.0) 1 1 test_add-add[main] 3.5458 (1.01) 3.5458 (1.01) 3.5458 (1.01) 0.0000 (1.0) 3.5458 (1.01) 0.0000 (1.0) 0;0 0.2820 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.58.2] 1.6186 (1.0) 1.6186 (1.0) 1.6186 (1.0) 0.0000 (1.0) 1.6186 (1.0) 0.0000 (1.0) 0;0 0.6178 (1.0) 1 1 test_diff-diff[3.0.0] 1.8193 (1.12) 1.8193 (1.12) 1.8193 (1.12) 0.0000 (1.0) 1.8193 (1.12) 0.0000 (1.0) 0;0 0.5497 (0.89) 1 1 test_diff-diff[3.10.0] 2.3352 (1.44) 2.3352 (1.44) 2.3352 (1.44) 0.0000 (1.0) 2.3352 (1.44) 0.0000 (1.0) 0;0 0.4282 (0.69) 1 1 test_diff-diff[3.20.0] 1.9346 (1.20) 1.9346 (1.20) 1.9346 (1.20) 0.0000 (1.0) 1.9346 (1.20) 0.0000 (1.0) 0;0 0.5169 (0.84) 1 1 test_diff-diff[main] 1.7984 (1.11) 1.7984 (1.11) 1.7984 (1.11) 0.0000 (1.0) 1.7984 (1.11) 0.0000 (1.0) 0;0 0.5561 (0.90) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 5 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.58.2] 936.5704 (1.08) 936.5704 (1.08) 936.5704 (1.08) 0.0000 (1.0) 936.5704 (1.08) 0.0000 (1.0) 0;0 1.0677 (0.93) 1 1 test_diff-diff-changed[3.0.0] 986.0600 (1.14) 986.0600 (1.14) 986.0600 (1.14) 0.0000 (1.0) 986.0600 (1.14) 0.0000 (1.0) 0;0 1.0141 (0.88) 1 1 test_diff-diff-changed[3.10.0] 966.9238 (1.11) 966.9238 (1.11) 966.9238 (1.11) 0.0000 (1.0) 966.9238 (1.11) 0.0000 (1.0) 0;0 1.0342 (0.90) 1 1 test_diff-diff-changed[3.20.0] 1,057.4868 (1.22) 1,057.4868 (1.22) 1,057.4868 (1.22) 0.0000 (1.0) 1,057.4868 (1.22) 0.0000 (1.0) 0;0 0.9456 (0.82) 1 1 test_diff-diff-changed[main] 867.6917 (1.0) 867.6917 (1.0) 867.6917 (1.0) 0.0000 (1.0) 867.6917 (1.0) 0.0000 (1.0) 0;0 1.1525 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.58.2] 897.8214 (1.04) 897.8214 (1.04) 897.8214 (1.04) 0.0000 (1.0) 897.8214 (1.04) 0.0000 (1.0) 0;0 1.1138 (0.96) 1 1 test_diff-diff-changed-noop[3.0.0] 918.2536 (1.06) 918.2536 (1.06) 918.2536 (1.06) 0.0000 (1.0) 918.2536 (1.06) 0.0000 (1.0) 0;0 1.0890 (0.94) 1 1 test_diff-diff-changed-noop[3.10.0] 865.0685 (1.0) 865.0685 (1.0) 865.0685 (1.0) 0.0000 (1.0) 865.0685 (1.0) 0.0000 (1.0) 0;0 1.1560 (1.0) 1 1 test_diff-diff-changed-noop[3.20.0] 896.4601 (1.04) 896.4601 (1.04) 896.4601 (1.04) 0.0000 (1.0) 896.4601 (1.04) 0.0000 (1.0) 0;0 1.1155 (0.96) 1 1 test_diff-diff-changed-noop[main] 936.2298 (1.08) 936.2298 (1.08) 936.2298 (1.08) 0.0000 (1.0) 936.2298 (1.08) 0.0000 (1.0) 0;0 1.0681 (0.92) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.58.2] 806.0873 (1.0) 806.0873 (1.0) 806.0873 (1.0) 0.0000 (1.0) 806.0873 (1.0) 0.0000 (1.0) 0;0 1.2406 (1.0) 1 1 test_diff-diff-noop[3.0.0] 910.3842 (1.13) 910.3842 (1.13) 910.3842 (1.13) 0.0000 (1.0) 910.3842 (1.13) 0.0000 (1.0) 0;0 1.0984 (0.89) 1 1 test_diff-diff-noop[3.10.0] 822.2070 (1.02) 822.2070 (1.02) 822.2070 (1.02) 0.0000 (1.0) 822.2070 (1.02) 0.0000 (1.0) 0;0 1.2162 (0.98) 1 1 test_diff-diff-noop[3.20.0] 982.8208 (1.22) 982.8208 (1.22) 982.8208 (1.22) 0.0000 (1.0) 982.8208 (1.22) 0.0000 (1.0) 0;0 1.0175 (0.82) 1 1 test_diff-diff-noop[main] 876.6038 (1.09) 876.6038 (1.09) 876.6038 (1.09) 0.0000 (1.0) 876.6038 (1.09) 0.0000 (1.0) 0;0 1.1408 (0.92) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.58.2] 5.3366 (1.01) 5.3366 (1.01) 5.3366 (1.01) 0.0000 (1.0) 5.3366 (1.01) 0.0000 (1.0) 0;0 0.1874 (0.99) 1 1 test_partial_remove-add[3.0.0] 5.2930 (1.00) 5.2930 (1.00) 5.2930 (1.00) 0.0000 (1.0) 5.2930 (1.00) 0.0000 (1.0) 0;0 0.1889 (1.00) 1 1 test_partial_remove-add[3.10.0] 5.4098 (1.02) 5.4098 (1.02) 5.4098 (1.02) 0.0000 (1.0) 5.4098 (1.02) 0.0000 (1.0) 0;0 0.1849 (0.98) 1 1 test_partial_remove-add[3.20.0] 5.3926 (1.02) 5.3926 (1.02) 5.3926 (1.02) 0.0000 (1.0) 5.3926 (1.02) 0.0000 (1.0) 0;0 0.1854 (0.98) 1 1 test_partial_remove-add[main] 5.2923 (1.0) 5.2923 (1.0) 5.2923 (1.0) 0.0000 (1.0) 5.2923 (1.0) 0.0000 (1.0) 0;0 0.1890 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add-update[2.58.2] 2.1320 (1.02) 2.1320 (1.02) 2.1320 (1.02) 0.0000 (1.0) 2.1320 (1.02) 0.0000 (1.0) 0;0 0.4690 (0.98) 1 1 test_partial_remove-add-update[3.0.0] 2.1097 (1.01) 2.1097 (1.01) 2.1097 (1.01) 0.0000 (1.0) 2.1097 (1.01) 0.0000 (1.0) 0;0 0.4740 (0.99) 1 1 test_partial_remove-add-update[3.10.0] 2.1017 (1.01) 2.1017 (1.01) 2.1017 (1.01) 0.0000 (1.0) 2.1017 (1.01) 0.0000 (1.0) 0;0 0.4758 (0.99) 1 1 test_partial_remove-add-update[3.20.0] 2.0967 (1.01) 2.0967 (1.01) 2.0967 (1.01) 0.0000 (1.0) 2.0967 (1.01) 0.0000 (1.0) 0;0 0.4769 (0.99) 1 1 test_partial_remove-add-update[main] 2.0856 (1.0) 2.0856 (1.0) 2.0856 (1.0) 0.0000 (1.0) 2.0856 (1.0) 0.0000 (1.0) 0;0 0.4795 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.58.2] 675.0884 (1.0) 675.0884 (1.0) 675.0884 (1.0) 0.0000 (1.0) 675.0884 (1.0) 0.0000 (1.0) 0;0 1.4813 (1.0) 1 1 test_partial_remove-gc[3.0.0] 755.8577 (1.12) 755.8577 (1.12) 755.8577 (1.12) 0.0000 (1.0) 755.8577 (1.12) 0.0000 (1.0) 0;0 1.3230 (0.89) 1 1 test_partial_remove-gc[3.10.0] 736.8457 (1.09) 736.8457 (1.09) 736.8457 (1.09) 0.0000 (1.0) 736.8457 (1.09) 0.0000 (1.0) 0;0 1.3571 (0.92) 1 1 test_partial_remove-gc[3.20.0] 782.7492 (1.16) 782.7492 (1.16) 782.7492 (1.16) 0.0000 (1.0) 782.7492 (1.16) 0.0000 (1.0) 0;0 1.2775 (0.86) 1 1 test_partial_remove-gc[main] 761.6967 (1.13) 761.6967 (1.13) 761.6967 (1.13) 0.0000 (1.0) 761.6967 (1.13) 0.0000 (1.0) 0;0 1.3129 (0.89) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.58.2] 767.8621 (1.0) 767.8621 (1.0) 767.8621 (1.0) 0.0000 (1.0) 767.8621 (1.0) 0.0000 (1.0) 0;0 1.3023 (1.0) 1 1 test_partial_remove-gc-cloud[3.0.0] 844.4619 (1.10) 844.4619 (1.10) 844.4619 (1.10) 0.0000 (1.0) 844.4619 (1.10) 0.0000 (1.0) 0;0 1.1842 (0.91) 1 1 test_partial_remove-gc-cloud[3.10.0] 823.5025 (1.07) 823.5025 (1.07) 823.5025 (1.07) 0.0000 (1.0) 823.5025 (1.07) 0.0000 (1.0) 0;0 1.2143 (0.93) 1 1 test_partial_remove-gc-cloud[3.20.0] 869.1814 (1.13) 869.1814 (1.13) 869.1814 (1.13) 0.0000 (1.0) 869.1814 (1.13) 0.0000 (1.0) 0;0 1.1505 (0.88) 1 1 test_partial_remove-gc-cloud[main] 868.9656 (1.13) 868.9656 (1.13) 868.9656 (1.13) 0.0000 (1.0) 868.9656 (1.13) 0.0000 (1.0) 0;0 1.1508 (0.88) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.58.2] 4.4269 (1.96) 4.4269 (1.96) 4.4269 (1.96) 0.0000 (1.0) 4.4269 (1.96) 0.0000 (1.0) 0;0 0.2259 (0.51) 1 1 test_partial_remove-push[3.0.0] 2.2991 (1.02) 2.2991 (1.02) 2.2991 (1.02) 0.0000 (1.0) 2.2991 (1.02) 0.0000 (1.0) 0;0 0.4350 (0.98) 1 1 test_partial_remove-push[3.10.0] 2.2554 (1.0) 2.2554 (1.0) 2.2554 (1.0) 0.0000 (1.0) 2.2554 (1.0) 0.0000 (1.0) 0;0 0.4434 (1.0) 1 1 test_partial_remove-push[3.20.0] 4.3594 (1.93) 4.3594 (1.93) 4.3594 (1.93) 0.0000 (1.0) 4.3594 (1.93) 0.0000 (1.0) 0;0 0.2294 (0.52) 1 1 test_partial_remove-push[main] 5.2890 (2.34) 5.2890 (2.34) 5.2890 (2.34) 0.0000 (1.0) 5.2890 (2.34) 0.0000 (1.0) 0;0 0.1891 (0.43) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 5 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push-update[2.58.2] 679.4905 (1.02) 679.4905 (1.02) 679.4905 (1.02) 0.0000 (1.0) 679.4905 (1.02) 0.0000 (1.0) 0;0 1.4717 (0.98) 1 1 test_partial_remove-push-update[3.0.0] 704.3233 (1.06) 704.3233 (1.06) 704.3233 (1.06) 0.0000 (1.0) 704.3233 (1.06) 0.0000 (1.0) 0;0 1.4198 (0.94) 1 1 test_partial_remove-push-update[3.10.0] 678.9959 (1.02) 678.9959 (1.02) 678.9959 (1.02) 0.0000 (1.0) 678.9959 (1.02) 0.0000 (1.0) 0;0 1.4728 (0.98) 1 1 test_partial_remove-push-update[3.20.0] 665.4426 (1.0) 665.4426 (1.0) 665.4426 (1.0) 0.0000 (1.0) 665.4426 (1.0) 0.0000 (1.0) 0;0 1.5028 (1.0) 1 1 test_partial_remove-push-update[main] 1,393.8419 (2.09) 1,393.8419 (2.09) 1,393.8419 (2.09) 0.0000 (1.0) 1,393.8419 (2.09) 0.0000 (1.0) 0;0 0.7174 (0.48) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add[2.58.2] 2.6315 (1.06) 2.6315 (1.06) 2.6315 (1.06) 0.0000 (1.0) 2.6315 (1.06) 0.0000 (1.0) 0;0 0.3800 (0.94) 1 1 test_partial_add-add[3.0.0] 2.4937 (1.01) 2.4937 (1.01) 2.4937 (1.01) 0.0000 (1.0) 2.4937 (1.01) 0.0000 (1.0) 0;0 0.4010 (0.99) 1 1 test_partial_add-add[3.10.0] 2.9009 (1.17) 2.9009 (1.17) 2.9009 (1.17) 0.0000 (1.0) 2.9009 (1.17) 0.0000 (1.0) 0;0 0.3447 (0.85) 1 1 test_partial_add-add[3.20.0] 2.6629 (1.08) 2.6629 (1.08) 2.6629 (1.08) 0.0000 (1.0) 2.6629 (1.08) 0.0000 (1.0) 0;0 0.3755 (0.93) 1 1 test_partial_add-add[main] 2.4751 (1.0) 2.4751 (1.0) 2.4751 (1.0) 0.0000 (1.0) 2.4751 (1.0) 0.0000 (1.0) 0;0 0.4040 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial[2.58.2] 3.6313 (1.02) 3.6313 (1.02) 3.6313 (1.02) 0.0000 (1.0) 3.6313 (1.02) 0.0000 (1.0) 0;0 0.2754 (0.98) 1 1 test_partial_add-add-partial[3.0.0] 3.6121 (1.02) 3.6121 (1.02) 3.6121 (1.02) 0.0000 (1.0) 3.6121 (1.02) 0.0000 (1.0) 0;0 0.2768 (0.98) 1 1 test_partial_add-add-partial[3.10.0] 3.5479 (1.0) 3.5479 (1.0) 3.5479 (1.0) 0.0000 (1.0) 3.5479 (1.0) 0.0000 (1.0) 0;0 0.2819 (1.0) 1 1 test_partial_add-add-partial[3.20.0] 3.5794 (1.01) 3.5794 (1.01) 3.5794 (1.01) 0.0000 (1.0) 3.5794 (1.01) 0.0000 (1.0) 0;0 0.2794 (0.99) 1 1 test_partial_add-add-partial[main] 3.5730 (1.01) 3.5730 (1.01) 3.5730 (1.01) 0.0000 (1.0) 3.5730 (1.01) 0.0000 (1.0) 0;0 0.2799 (0.99) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.58.2] 737.2854 (1.0) 737.2854 (1.0) 737.2854 (1.0) 0.0000 (1.0) 737.2854 (1.0) 0.0000 (1.0) 0;0 1.3563 (1.0) 1 1 test_partial_add-gc-cloud-noop[3.0.0] 803.7167 (1.09) 803.7167 (1.09) 803.7167 (1.09) 0.0000 (1.0) 803.7167 (1.09) 0.0000 (1.0) 0;0 1.2442 (0.92) 1 1 test_partial_add-gc-cloud-noop[3.10.0] 818.4720 (1.11) 818.4720 (1.11) 818.4720 (1.11) 0.0000 (1.0) 818.4720 (1.11) 0.0000 (1.0) 0;0 1.2218 (0.90) 1 1 test_partial_add-gc-cloud-noop[3.20.0] 806.7739 (1.09) 806.7739 (1.09) 806.7739 (1.09) 0.0000 (1.0) 806.7739 (1.09) 0.0000 (1.0) 0;0 1.2395 (0.91) 1 1 test_partial_add-gc-cloud-noop[main] 865.3630 (1.17) 865.3630 (1.17) 865.3630 (1.17) 0.0000 (1.0) 865.3630 (1.17) 0.0000 (1.0) 0;0 1.1556 (0.85) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.58.2] 619.2731 (1.0) 619.2731 (1.0) 619.2731 (1.0) 0.0000 (1.0) 619.2731 (1.0) 0.0000 (1.0) 0;0 1.6148 (1.0) 1 1 test_partial_add-gc-noop[3.0.0] 718.9840 (1.16) 718.9840 (1.16) 718.9840 (1.16) 0.0000 (1.0) 718.9840 (1.16) 0.0000 (1.0) 0;0 1.3909 (0.86) 1 1 test_partial_add-gc-noop[3.10.0] 727.1888 (1.17) 727.1888 (1.17) 727.1888 (1.17) 0.0000 (1.0) 727.1888 (1.17) 0.0000 (1.0) 0;0 1.3752 (0.85) 1 1 test_partial_add-gc-noop[3.20.0] 712.6140 (1.15) 712.6140 (1.15) 712.6140 (1.15) 0.0000 (1.0) 712.6140 (1.15) 0.0000 (1.0) 0;0 1.4033 (0.87) 1 1 test_partial_add-gc-noop[main] 728.3233 (1.18) 728.3233 (1.18) 728.3233 (1.18) 0.0000 (1.0) 728.3233 (1.18) 0.0000 (1.0) 0;0 1.3730 (0.85) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push[2.58.2] 2.0420 (1.69) 2.0420 (1.69) 2.0420 (1.69) 0.0000 (1.0) 2.0420 (1.69) 0.0000 (1.0) 0;0 0.4897 (0.59) 1 1 test_partial_add-push[3.0.0] 1.2612 (1.04) 1.2612 (1.04) 1.2612 (1.04) 0.0000 (1.0) 1.2612 (1.04) 0.0000 (1.0) 0;0 0.7929 (0.96) 1 1 test_partial_add-push[3.10.0] 1.2103 (1.0) 1.2103 (1.0) 1.2103 (1.0) 0.0000 (1.0) 1.2103 (1.0) 0.0000 (1.0) 0;0 0.8263 (1.0) 1 1 test_partial_add-push[3.20.0] 2.0236 (1.67) 2.0236 (1.67) 2.0236 (1.67) 0.0000 (1.0) 2.0236 (1.67) 0.0000 (1.0) 0;0 0.4942 (0.60) 1 1 test_partial_add-push[main] 2.6331 (2.18) 2.6331 (2.18) 2.6331 (2.18) 0.0000 (1.0) 2.6331 (2.18) 0.0000 (1.0) 0;0 0.3798 (0.46) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial[2.58.2] 2.1318 (1.72) 2.1318 (1.72) 2.1318 (1.72) 0.0000 (1.0) 2.1318 (1.72) 0.0000 (1.0) 0;0 0.4691 (0.58) 1 1 test_partial_add-push-partial[3.0.0] 1.2374 (1.0) 1.2374 (1.0) 1.2374 (1.0) 0.0000 (1.0) 1.2374 (1.0) 0.0000 (1.0) 0;0 0.8081 (1.0) 1 1 test_partial_add-push-partial[3.10.0] 1.2554 (1.01) 1.2554 (1.01) 1.2554 (1.01) 0.0000 (1.0) 1.2554 (1.01) 0.0000 (1.0) 0;0 0.7966 (0.99) 1 1 test_partial_add-push-partial[3.20.0] 2.1003 (1.70) 2.1003 (1.70) 2.1003 (1.70) 0.0000 (1.0) 2.1003 (1.70) 0.0000 (1.0) 0;0 0.4761 (0.59) 1 1 test_partial_add-push-partial[main] 2.7124 (2.19) 2.7124 (2.19) 2.7124 (2.19) 0.0000 (1.0) 2.7124 (2.19) 0.0000 (1.0) 0;0 0.3687 (0.46) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.58.2] 701.3378 (1.03) 701.3378 (1.03) 701.3378 (1.03) 0.0000 (1.0) 701.3378 (1.03) 0.0000 (1.0) 0;0 1.4258 (0.97) 1 1 test_gc-gc[3.0.0] 681.9595 (1.0) 681.9595 (1.0) 681.9595 (1.0) 0.0000 (1.0) 681.9595 (1.0) 0.0000 (1.0) 0;0 1.4664 (1.0) 1 1 test_gc-gc[3.10.0] 698.2187 (1.02) 698.2187 (1.02) 698.2187 (1.02) 0.0000 (1.0) 698.2187 (1.02) 0.0000 (1.0) 0;0 1.4322 (0.98) 1 1 test_gc-gc[3.20.0] 715.6982 (1.05) 715.6982 (1.05) 715.6982 (1.05) 0.0000 (1.0) 715.6982 (1.05) 0.0000 (1.0) 0;0 1.3972 (0.95) 1 1 test_gc-gc[main] 684.5592 (1.00) 684.5592 (1.00) 684.5592 (1.00) 0.0000 (1.0) 684.5592 (1.00) 0.0000 (1.0) 0;0 1.4608 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.58.2] 8.3254 (1.03) 8.3254 (1.03) 8.3254 (1.03) 0.0000 (1.0) 8.3254 (1.03) 0.0000 (1.0) 0;0 0.1201 (0.97) 1 1 test_get-get[3.0.0] 8.0489 (1.0) 8.0489 (1.0) 8.0489 (1.0) 0.0000 (1.0) 8.0489 (1.0) 0.0000 (1.0) 0;0 0.1242 (1.0) 1 1 test_get-get[3.10.0] 9.2343 (1.15) 9.2343 (1.15) 9.2343 (1.15) 0.0000 (1.0) 9.2343 (1.15) 0.0000 (1.0) 0;0 0.1083 (0.87) 1 1 test_get-get[3.20.0] 9.1301 (1.13) 9.1301 (1.13) 9.1301 (1.13) 0.0000 (1.0) 9.1301 (1.13) 0.0000 (1.0) 0;0 0.1095 (0.88) 1 1 test_get-get[main] 9.2925 (1.15) 9.2925 (1.15) 9.2925 (1.15) 0.0000 (1.0) 9.2925 (1.15) 0.0000 (1.0) 0;0 0.1076 (0.87) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add[2.58.2] 4.1734 (1.00) 4.1734 (1.00) 4.1734 (1.00) 0.0000 (1.0) 4.1734 (1.00) 0.0000 (1.0) 0;0 0.2396 (1.00) 1 1 test_sharing_azure-add[2.58.2] 4.2537 (1.02) 4.2537 (1.02) 4.2537 (1.02) 0.0000 (1.0) 4.2537 (1.02) 0.0000 (1.0) 0;0 0.2351 (0.98) 1 1 test_sharing_azure-add[3.0.0] 4.1665 (1.0) 4.1665 (1.0) 4.1665 (1.0) 0.0000 (1.0) 4.1665 (1.0) 0.0000 (1.0) 0;0 0.2400 (1.0) 1 1 test_sharing_azure-add[3.0.0] 4.2038 (1.01) 4.2038 (1.01) 4.2038 (1.01) 0.0000 (1.0) 4.2038 (1.01) 0.0000 (1.0) 0;0 0.2379 (0.99) 1 1 test_sharing_azure-add[3.10.0] 4.2999 (1.03) 4.2999 (1.03) 4.2999 (1.03) 0.0000 (1.0) 4.2999 (1.03) 0.0000 (1.0) 0;0 0.2326 (0.97) 1 1 test_sharing_azure-add[3.10.0] 4.2518 (1.02) 4.2518 (1.02) 4.2518 (1.02) 0.0000 (1.0) 4.2518 (1.02) 0.0000 (1.0) 0;0 0.2352 (0.98) 1 1 test_sharing_azure-add[3.20.0] 4.4967 (1.08) 4.4967 (1.08) 4.4967 (1.08) 0.0000 (1.0) 4.4967 (1.08) 0.0000 (1.0) 0;0 0.2224 (0.93) 1 1 test_sharing_azure-add[3.20.0] 4.1779 (1.00) 4.1779 (1.00) 4.1779 (1.00) 0.0000 (1.0) 4.1779 (1.00) 0.0000 (1.0) 0;0 0.2394 (1.00) 1 1 test_sharing_azure-add[main] 4.2204 (1.01) 4.2204 (1.01) 4.2204 (1.01) 0.0000 (1.0) 4.2204 (1.01) 0.0000 (1.0) 0;0 0.2369 (0.99) 1 1 test_sharing_azure-add[main] 4.2466 (1.02) 4.2466 (1.02) 4.2466 (1.02) 0.0000 (1.0) 4.2466 (1.02) 0.0000 (1.0) 0;0 0.2355 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add-noop[2.58.2] 2.8493 (1.02) 2.8493 (1.02) 2.8493 (1.02) 0.0000 (1.0) 2.8493 (1.02) 0.0000 (1.0) 0;0 0.3510 (0.98) 1 1 test_sharing_azure-add-noop[2.58.2] 2.8475 (1.02) 2.8475 (1.02) 2.8475 (1.02) 0.0000 (1.0) 2.8475 (1.02) 0.0000 (1.0) 0;0 0.3512 (0.98) 1 1 test_sharing_azure-add-noop[3.0.0] 2.8264 (1.01) 2.8264 (1.01) 2.8264 (1.01) 0.0000 (1.0) 2.8264 (1.01) 0.0000 (1.0) 0;0 0.3538 (0.99) 1 1 test_sharing_azure-add-noop[3.0.0] 2.7852 (1.0) 2.7852 (1.0) 2.7852 (1.0) 0.0000 (1.0) 2.7852 (1.0) 0.0000 (1.0) 0;0 0.3590 (1.0) 1 1 test_sharing_azure-add-noop[3.10.0] 2.8421 (1.02) 2.8421 (1.02) 2.8421 (1.02) 0.0000 (1.0) 2.8421 (1.02) 0.0000 (1.0) 0;0 0.3519 (0.98) 1 1 test_sharing_azure-add-noop[3.10.0] 2.7951 (1.00) 2.7951 (1.00) 2.7951 (1.00) 0.0000 (1.0) 2.7951 (1.00) 0.0000 (1.0) 0;0 0.3578 (1.00) 1 1 test_sharing_azure-add-noop[3.20.0] 2.8377 (1.02) 2.8377 (1.02) 2.8377 (1.02) 0.0000 (1.0) 2.8377 (1.02) 0.0000 (1.0) 0;0 0.3524 (0.98) 1 1 test_sharing_azure-add-noop[3.20.0] 2.8005 (1.01) 2.8005 (1.01) 2.8005 (1.01) 0.0000 (1.0) 2.8005 (1.01) 0.0000 (1.0) 0;0 0.3571 (0.99) 1 1 test_sharing_azure-add-noop[main] 2.8452 (1.02) 2.8452 (1.02) 2.8452 (1.02) 0.0000 (1.0) 2.8452 (1.02) 0.0000 (1.0) 0;0 0.3515 (0.98) 1 1 test_sharing_azure-add-noop[main] 2.7883 (1.00) 2.7883 (1.00) 2.7883 (1.00) 0.0000 (1.0) 2.7883 (1.00) 0.0000 (1.0) 0;0 0.3586 (1.00) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-checkout-noop[2.58.2] 679.9151 (1.01) 679.9151 (1.01) 679.9151 (1.01) 0.0000 (1.0) 679.9151 (1.01) 0.0000 (1.0) 0;0 1.4708 (0.99) 1 1 test_sharing_azure-checkout-noop[2.58.2] 673.7450 (1.0) 673.7450 (1.0) 673.7450 (1.0) 0.0000 (1.0) 673.7450 (1.0) 0.0000 (1.0) 0;0 1.4842 (1.0) 1 1 test_sharing_azure-checkout-noop[3.0.0] 695.4122 (1.03) 695.4122 (1.03) 695.4122 (1.03) 0.0000 (1.0) 695.4122 (1.03) 0.0000 (1.0) 0;0 1.4380 (0.97) 1 1 test_sharing_azure-checkout-noop[3.0.0] 697.4558 (1.04) 697.4558 (1.04) 697.4558 (1.04) 0.0000 (1.0) 697.4558 (1.04) 0.0000 (1.0) 0;0 1.4338 (0.97) 1 1 test_sharing_azure-checkout-noop[3.10.0] 722.7299 (1.07) 722.7299 (1.07) 722.7299 (1.07) 0.0000 (1.0) 722.7299 (1.07) 0.0000 (1.0) 0;0 1.3836 (0.93) 1 1 test_sharing_azure-checkout-noop[3.10.0] 704.2032 (1.05) 704.2032 (1.05) 704.2032 (1.05) 0.0000 (1.0) 704.2032 (1.05) 0.0000 (1.0) 0;0 1.4200 (0.96) 1 1 test_sharing_azure-checkout-noop[3.20.0] 693.9165 (1.03) 693.9165 (1.03) 693.9165 (1.03) 0.0000 (1.0) 693.9165 (1.03) 0.0000 (1.0) 0;0 1.4411 (0.97) 1 1 test_sharing_azure-checkout-noop[3.20.0] 688.0587 (1.02) 688.0587 (1.02) 688.0587 (1.02) 0.0000 (1.0) 688.0587 (1.02) 0.0000 (1.0) 0;0 1.4534 (0.98) 1 1 test_sharing_azure-checkout-noop[main] 680.9089 (1.01) 680.9089 (1.01) 680.9089 (1.01) 0.0000 (1.0) 680.9089 (1.01) 0.0000 (1.0) 0;0 1.4686 (0.99) 1 1 test_sharing_azure-checkout-noop[main] 710.0427 (1.05) 710.0427 (1.05) 710.0427 (1.05) 0.0000 (1.0) 710.0427 (1.05) 0.0000 (1.0) 0;0 1.4084 (0.95) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull[2.58.2] 5.6074 (1.0) 5.6074 (1.0) 5.6074 (1.0) 0.0000 (1.0) 5.6074 (1.0) 0.0000 (1.0) 0;0 0.1783 (1.0) 1 1 test_sharing_azure-pull[2.58.2] 5.6448 (1.01) 5.6448 (1.01) 5.6448 (1.01) 0.0000 (1.0) 5.6448 (1.01) 0.0000 (1.0) 0;0 0.1772 (0.99) 1 1 test_sharing_azure-pull[3.0.0] 7.8749 (1.40) 7.8749 (1.40) 7.8749 (1.40) 0.0000 (1.0) 7.8749 (1.40) 0.0000 (1.0) 0;0 0.1270 (0.71) 1 1 test_sharing_azure-pull[3.0.0] 7.8501 (1.40) 7.8501 (1.40) 7.8501 (1.40) 0.0000 (1.0) 7.8501 (1.40) 0.0000 (1.0) 0;0 0.1274 (0.71) 1 1 test_sharing_azure-pull[3.10.0] 7.9307 (1.41) 7.9307 (1.41) 7.9307 (1.41) 0.0000 (1.0) 7.9307 (1.41) 0.0000 (1.0) 0;0 0.1261 (0.71) 1 1 test_sharing_azure-pull[3.10.0] 7.8343 (1.40) 7.8343 (1.40) 7.8343 (1.40) 0.0000 (1.0) 7.8343 (1.40) 0.0000 (1.0) 0;0 0.1276 (0.72) 1 1 test_sharing_azure-pull[3.20.0] 7.8304 (1.40) 7.8304 (1.40) 7.8304 (1.40) 0.0000 (1.0) 7.8304 (1.40) 0.0000 (1.0) 0;0 0.1277 (0.72) 1 1 test_sharing_azure-pull[3.20.0] 7.8064 (1.39) 7.8064 (1.39) 7.8064 (1.39) 0.0000 (1.0) 7.8064 (1.39) 0.0000 (1.0) 0;0 0.1281 (0.72) 1 1 test_sharing_azure-pull[main] 10.8898 (1.94) 10.8898 (1.94) 10.8898 (1.94) 0.0000 (1.0) 10.8898 (1.94) 0.0000 (1.0) 0;0 0.0918 (0.51) 1 1 test_sharing_azure-pull[main] 10.9002 (1.94) 10.9002 (1.94) 10.9002 (1.94) 0.0000 (1.0) 10.9002 (1.94) 0.0000 (1.0) 0;0 0.0917 (0.51) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull-noop[2.58.2] 729.3673 (1.01) 729.3673 (1.01) 729.3673 (1.01) 0.0000 (1.0) 729.3673 (1.01) 0.0000 (1.0) 0;0 1.3711 (0.99) 1 1 test_sharing_azure-pull-noop[2.58.2] 724.7762 (1.0) 724.7762 (1.0) 724.7762 (1.0) 0.0000 (1.0) 724.7762 (1.0) 0.0000 (1.0) 0;0 1.3797 (1.0) 1 1 test_sharing_azure-pull-noop[3.0.0] 835.3705 (1.15) 835.3705 (1.15) 835.3705 (1.15) 0.0000 (1.0) 835.3705 (1.15) 0.0000 (1.0) 0;0 1.1971 (0.87) 1 1 test_sharing_azure-pull-noop[3.0.0] 822.3199 (1.13) 822.3199 (1.13) 822.3199 (1.13) 0.0000 (1.0) 822.3199 (1.13) 0.0000 (1.0) 0;0 1.2161 (0.88) 1 1 test_sharing_azure-pull-noop[3.10.0] 874.9381 (1.21) 874.9381 (1.21) 874.9381 (1.21) 0.0000 (1.0) 874.9381 (1.21) 0.0000 (1.0) 0;0 1.1429 (0.83) 1 1 test_sharing_azure-pull-noop[3.10.0] 838.3259 (1.16) 838.3259 (1.16) 838.3259 (1.16) 0.0000 (1.0) 838.3259 (1.16) 0.0000 (1.0) 0;0 1.1929 (0.86) 1 1 test_sharing_azure-pull-noop[3.20.0] 839.9156 (1.16) 839.9156 (1.16) 839.9156 (1.16) 0.0000 (1.0) 839.9156 (1.16) 0.0000 (1.0) 0;0 1.1906 (0.86) 1 1 test_sharing_azure-pull-noop[3.20.0] 838.8120 (1.16) 838.8120 (1.16) 838.8120 (1.16) 0.0000 (1.0) 838.8120 (1.16) 0.0000 (1.0) 0;0 1.1922 (0.86) 1 1 test_sharing_azure-pull-noop[main] 785.0796 (1.08) 785.0796 (1.08) 785.0796 (1.08) 0.0000 (1.0) 785.0796 (1.08) 0.0000 (1.0) 0;0 1.2738 (0.92) 1 1 test_sharing_azure-pull-noop[main] 817.5468 (1.13) 817.5468 (1.13) 817.5468 (1.13) 0.0000 (1.0) 817.5468 (1.13) 0.0000 (1.0) 0;0 1.2232 (0.89) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push[2.58.2] 3.5523 (2.04) 3.5523 (2.04) 3.5523 (2.04) 0.0000 (1.0) 3.5523 (2.04) 0.0000 (1.0) 0;0 0.2815 (0.49) 1 1 test_sharing_azure-push[2.58.2] 3.6122 (2.07) 3.6122 (2.07) 3.6122 (2.07) 0.0000 (1.0) 3.6122 (2.07) 0.0000 (1.0) 0;0 0.2768 (0.48) 1 1 test_sharing_azure-push[3.0.0] 1.8132 (1.04) 1.8132 (1.04) 1.8132 (1.04) 0.0000 (1.0) 1.8132 (1.04) 0.0000 (1.0) 0;0 0.5515 (0.96) 1 1 test_sharing_azure-push[3.0.0] 2.0756 (1.19) 2.0756 (1.19) 2.0756 (1.19) 0.0000 (1.0) 2.0756 (1.19) 0.0000 (1.0) 0;0 0.4818 (0.84) 1 1 test_sharing_azure-push[3.10.0] 1.7452 (1.0) 1.7452 (1.0) 1.7452 (1.0) 0.0000 (1.0) 1.7452 (1.0) 0.0000 (1.0) 0;0 0.5730 (1.0) 1 1 test_sharing_azure-push[3.10.0] 2.2085 (1.27) 2.2085 (1.27) 2.2085 (1.27) 0.0000 (1.0) 2.2085 (1.27) 0.0000 (1.0) 0;0 0.4528 (0.79) 1 1 test_sharing_azure-push[3.20.0] 3.5663 (2.04) 3.5663 (2.04) 3.5663 (2.04) 0.0000 (1.0) 3.5663 (2.04) 0.0000 (1.0) 0;0 0.2804 (0.49) 1 1 test_sharing_azure-push[3.20.0] 3.6244 (2.08) 3.6244 (2.08) 3.6244 (2.08) 0.0000 (1.0) 3.6244 (2.08) 0.0000 (1.0) 0;0 0.2759 (0.48) 1 1 test_sharing_azure-push[main] 4.0722 (2.33) 4.0722 (2.33) 4.0722 (2.33) 0.0000 (1.0) 4.0722 (2.33) 0.0000 (1.0) 0;0 0.2456 (0.43) 1 1 test_sharing_azure-push[main] 4.1310 (2.37) 4.1310 (2.37) 4.1310 (2.37) 0.0000 (1.0) 4.1310 (2.37) 0.0000 (1.0) 0;0 0.2421 (0.42) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push-noop[2.58.2] 552.1364 (1.03) 552.1364 (1.03) 552.1364 (1.03) 0.0000 (1.0) 552.1364 (1.03) 0.0000 (1.0) 0;0 1.8111 (0.97) 1 1 test_sharing_azure-push-noop[2.58.2] 551.8862 (1.03) 551.8862 (1.03) 551.8862 (1.03) 0.0000 (1.0) 551.8862 (1.03) 0.0000 (1.0) 0;0 1.8120 (0.97) 1 1 test_sharing_azure-push-noop[3.0.0] 544.6445 (1.02) 544.6445 (1.02) 544.6445 (1.02) 0.0000 (1.0) 544.6445 (1.02) 0.0000 (1.0) 0;0 1.8361 (0.98) 1 1 test_sharing_azure-push-noop[3.0.0] 682.0461 (1.27) 682.0461 (1.27) 682.0461 (1.27) 0.0000 (1.0) 682.0461 (1.27) 0.0000 (1.0) 0;0 1.4662 (0.79) 1 1 test_sharing_azure-push-noop[3.10.0] 544.2903 (1.01) 544.2903 (1.01) 544.2903 (1.01) 0.0000 (1.0) 544.2903 (1.01) 0.0000 (1.0) 0;0 1.8373 (0.99) 1 1 test_sharing_azure-push-noop[3.10.0] 764.5628 (1.43) 764.5628 (1.43) 764.5628 (1.43) 0.0000 (1.0) 764.5628 (1.43) 0.0000 (1.0) 0;0 1.3079 (0.70) 1 1 test_sharing_azure-push-noop[3.20.0] 545.5938 (1.02) 545.5938 (1.02) 545.5938 (1.02) 0.0000 (1.0) 545.5938 (1.02) 0.0000 (1.0) 0;0 1.8329 (0.98) 1 1 test_sharing_azure-push-noop[3.20.0] 536.3698 (1.0) 536.3698 (1.0) 536.3698 (1.0) 0.0000 (1.0) 536.3698 (1.0) 0.0000 (1.0) 0;0 1.8644 (1.0) 1 1 test_sharing_azure-push-noop[main] 607.8938 (1.13) 607.8938 (1.13) 607.8938 (1.13) 0.0000 (1.0) 607.8938 (1.13) 0.0000 (1.0) 0;0 1.6450 (0.88) 1 1 test_sharing_azure-push-noop[main] 585.3109 (1.09) 585.3109 (1.09) 585.3109 (1.09) 0.0000 (1.0) 585.3109 (1.09) 0.0000 (1.0) 0;0 1.7085 (0.92) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.58.2] 717.1609 (1.03) 717.1609 (1.03) 717.1609 (1.03) 0.0000 (1.0) 717.1609 (1.03) 0.0000 (1.0) 0;0 1.3944 (0.97) 1 1 test_data_status-data-changed[3.0.0] 744.6955 (1.07) 744.6955 (1.07) 744.6955 (1.07) 0.0000 (1.0) 744.6955 (1.07) 0.0000 (1.0) 0;0 1.3428 (0.93) 1 1 test_data_status-data-changed[3.10.0] 695.4382 (1.0) 695.4382 (1.0) 695.4382 (1.0) 0.0000 (1.0) 695.4382 (1.0) 0.0000 (1.0) 0;0 1.4379 (1.0) 1 1 test_data_status-data-changed[3.20.0] 711.6817 (1.02) 711.6817 (1.02) 711.6817 (1.02) 0.0000 (1.0) 711.6817 (1.02) 0.0000 (1.0) 0;0 1.4051 (0.98) 1 1 test_data_status-data-changed[main] 715.8441 (1.03) 715.8441 (1.03) 715.8441 (1.03) 0.0000 (1.0) 715.8441 (1.03) 0.0000 (1.0) 0;0 1.3970 (0.97) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.58.2] 718.4913 (1.03) 718.4913 (1.03) 718.4913 (1.03) 0.0000 (1.0) 718.4913 (1.03) 0.0000 (1.0) 0;0 1.3918 (0.97) 1 1 test_data_status-data-changed-noop[3.0.0] 752.0873 (1.08) 752.0873 (1.08) 752.0873 (1.08) 0.0000 (1.0) 752.0873 (1.08) 0.0000 (1.0) 0;0 1.3296 (0.93) 1 1 test_data_status-data-changed-noop[3.10.0] 696.1844 (1.0) 696.1844 (1.0) 696.1844 (1.0) 0.0000 (1.0) 696.1844 (1.0) 0.0000 (1.0) 0;0 1.4364 (1.0) 1 1 test_data_status-data-changed-noop[3.20.0] 698.1616 (1.00) 698.1616 (1.00) 698.1616 (1.00) 0.0000 (1.0) 698.1616 (1.00) 0.0000 (1.0) 0;0 1.4323 (1.00) 1 1 test_data_status-data-changed-noop[main] 712.6346 (1.02) 712.6346 (1.02) 712.6346 (1.02) 0.0000 (1.0) 712.6346 (1.02) 0.0000 (1.0) 0;0 1.4032 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.58.2] 1.5415 (1.01) 1.5415 (1.01) 1.5415 (1.01) 0.0000 (1.0) 1.5415 (1.01) 0.0000 (1.0) 0;0 0.6487 (0.99) 1 1 test_data_status-data-new[3.0.0] 1.5742 (1.03) 1.5742 (1.03) 1.5742 (1.03) 0.0000 (1.0) 1.5742 (1.03) 0.0000 (1.0) 0;0 0.6353 (0.97) 1 1 test_data_status-data-new[3.10.0] 1.5239 (1.0) 1.5239 (1.0) 1.5239 (1.0) 0.0000 (1.0) 1.5239 (1.0) 0.0000 (1.0) 0;0 0.6562 (1.0) 1 1 test_data_status-data-new[3.20.0] 1.5274 (1.00) 1.5274 (1.00) 1.5274 (1.00) 0.0000 (1.0) 1.5274 (1.00) 0.0000 (1.0) 0;0 0.6547 (1.00) 1 1 test_data_status-data-new[main] 1.5240 (1.00) 1.5240 (1.00) 1.5240 (1.00) 0.0000 (1.0) 1.5240 (1.00) 0.0000 (1.0) 0;0 0.6562 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.58.2] 730.1433 (1.04) 730.1433 (1.04) 730.1433 (1.04) 0.0000 (1.0) 730.1433 (1.04) 0.0000 (1.0) 0;0 1.3696 (0.96) 1 1 test_data_status-data-noop[3.0.0] 738.9228 (1.06) 738.9228 (1.06) 738.9228 (1.06) 0.0000 (1.0) 738.9228 (1.06) 0.0000 (1.0) 0;0 1.3533 (0.95) 1 1 test_data_status-data-noop[3.10.0] 700.0826 (1.0) 700.0826 (1.0) 700.0826 (1.0) 0.0000 (1.0) 700.0826 (1.0) 0.0000 (1.0) 0;0 1.4284 (1.0) 1 1 test_data_status-data-noop[3.20.0] 709.5066 (1.01) 709.5066 (1.01) 709.5066 (1.01) 0.0000 (1.0) 709.5066 (1.01) 0.0000 (1.0) 0;0 1.4094 (0.99) 1 1 test_data_status-data-noop[main] 715.2297 (1.02) 715.2297 (1.02) 715.2297 (1.02) 0.0000 (1.0) 715.2297 (1.02) 0.0000 (1.0) 0;0 1.3982 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.58.2] 3.2409 (1.0) 3.2409 (1.0) 3.2409 (1.0) 0.0000 (1.0) 3.2409 (1.0) 0.0000 (1.0) 0;0 0.3086 (1.0) 1 1 test_checkout_copy-checkout[3.0.0] 5.9568 (1.84) 5.9568 (1.84) 5.9568 (1.84) 0.0000 (1.0) 5.9568 (1.84) 0.0000 (1.0) 0;0 0.1679 (0.54) 1 1 test_checkout_copy-checkout[3.10.0] 6.0471 (1.87) 6.0471 (1.87) 6.0471 (1.87) 0.0000 (1.0) 6.0471 (1.87) 0.0000 (1.0) 0;0 0.1654 (0.54) 1 1 test_checkout_copy-checkout[3.20.0] 6.0241 (1.86) 6.0241 (1.86) 6.0241 (1.86) 0.0000 (1.0) 6.0241 (1.86) 0.0000 (1.0) 0;0 0.1660 (0.54) 1 1 test_checkout_copy-checkout[main] 6.0208 (1.86) 6.0208 (1.86) 6.0208 (1.86) 0.0000 (1.0) 6.0208 (1.86) 0.0000 (1.0) 0;0 0.1661 (0.54) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.58.2] 1.0010 (1.0) 1.0010 (1.0) 1.0010 (1.0) 0.0000 (1.0) 1.0010 (1.0) 0.0000 (1.0) 0;0 0.9990 (1.0) 1 1 test_checkout_copy-checkout-noop[3.0.0] 1.0412 (1.04) 1.0412 (1.04) 1.0412 (1.04) 0.0000 (1.0) 1.0412 (1.04) 0.0000 (1.0) 0;0 0.9604 (0.96) 1 1 test_checkout_copy-checkout-noop[3.10.0] 1.0268 (1.03) 1.0268 (1.03) 1.0268 (1.03) 0.0000 (1.0) 1.0268 (1.03) 0.0000 (1.0) 0;0 0.9739 (0.97) 1 1 test_checkout_copy-checkout-noop[3.20.0] 1.0482 (1.05) 1.0482 (1.05) 1.0482 (1.05) 0.0000 (1.0) 1.0482 (1.05) 0.0000 (1.0) 0;0 0.9540 (0.96) 1 1 test_checkout_copy-checkout-noop[main] 1.0680 (1.07) 1.0680 (1.07) 1.0680 (1.07) 0.0000 (1.0) 1.0680 (1.07) 0.0000 (1.0) 0;0 0.9364 (0.94) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.58.2] 1.2653 (1.14) 1.2653 (1.14) 1.2653 (1.14) 0.0000 (1.0) 1.2653 (1.14) 0.0000 (1.0) 0;0 0.7904 (0.88) 1 1 test_checkout_copy-checkout-update[3.0.0] 1.1139 (1.0) 1.1139 (1.0) 1.1139 (1.0) 0.0000 (1.0) 1.1139 (1.0) 0.0000 (1.0) 0;0 0.8978 (1.0) 1 1 test_checkout_copy-checkout-update[3.10.0] 1.1331 (1.02) 1.1331 (1.02) 1.1331 (1.02) 0.0000 (1.0) 1.1331 (1.02) 0.0000 (1.0) 0;0 0.8825 (0.98) 1 1 test_checkout_copy-checkout-update[3.20.0] 1.1599 (1.04) 1.1599 (1.04) 1.1599 (1.04) 0.0000 (1.0) 1.1599 (1.04) 0.0000 (1.0) 0;0 0.8621 (0.96) 1 1 test_checkout_copy-checkout-update[main] 1.1428 (1.03) 1.1428 (1.03) 1.1428 (1.03) 0.0000 (1.0) 1.1428 (1.03) 0.0000 (1.0) 0;0 0.8751 (0.97) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.58.2] 2.0050 (1.23) 2.0050 (1.23) 2.0050 (1.23) 0.0000 (1.0) 2.0050 (1.23) 0.0000 (1.0) 0;0 0.4988 (0.81) 1 1 test_checkout_hardlink-checkout[3.0.0] 1.7158 (1.05) 1.7158 (1.05) 1.7158 (1.05) 0.0000 (1.0) 1.7158 (1.05) 0.0000 (1.0) 0;0 0.5828 (0.95) 1 1 test_checkout_hardlink-checkout[3.10.0] 1.7745 (1.09) 1.7745 (1.09) 1.7745 (1.09) 0.0000 (1.0) 1.7745 (1.09) 0.0000 (1.0) 0;0 0.5635 (0.92) 1 1 test_checkout_hardlink-checkout[3.20.0] 1.6327 (1.0) 1.6327 (1.0) 1.6327 (1.0) 0.0000 (1.0) 1.6327 (1.0) 0.0000 (1.0) 0;0 0.6125 (1.0) 1 1 test_checkout_hardlink-checkout[main] 1.7665 (1.08) 1.7665 (1.08) 1.7665 (1.08) 0.0000 (1.0) 1.7665 (1.08) 0.0000 (1.0) 0;0 0.5661 (0.92) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 5 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.58.2] 926.5709 (1.03) 926.5709 (1.03) 926.5709 (1.03) 0.0000 (1.0) 926.5709 (1.03) 0.0000 (1.0) 0;0 1.0792 (0.97) 1 1 test_checkout_hardlink-checkout-noop[3.0.0] 1,003.1569 (1.12) 1,003.1569 (1.12) 1,003.1569 (1.12) 0.0000 (1.0) 1,003.1569 (1.12) 0.0000 (1.0) 0;0 0.9969 (0.90) 1 1 test_checkout_hardlink-checkout-noop[3.10.0] 983.2061 (1.09) 983.2061 (1.09) 983.2061 (1.09) 0.0000 (1.0) 983.2061 (1.09) 0.0000 (1.0) 0;0 1.0171 (0.91) 1 1 test_checkout_hardlink-checkout-noop[3.20.0] 899.0894 (1.0) 899.0894 (1.0) 899.0894 (1.0) 0.0000 (1.0) 899.0894 (1.0) 0.0000 (1.0) 0;0 1.1122 (1.0) 1 1 test_checkout_hardlink-checkout-noop[main] 1,029.0174 (1.14) 1,029.0174 (1.14) 1,029.0174 (1.14) 0.0000 (1.0) 1,029.0174 (1.14) 0.0000 (1.0) 0;0 0.9718 (0.87) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.58.2] 1.1935 (1.18) 1.1935 (1.18) 1.1935 (1.18) 0.0000 (1.0) 1.1935 (1.18) 0.0000 (1.0) 0;0 0.8378 (0.85) 1 1 test_checkout_hardlink-checkout-update[3.0.0] 1.0425 (1.03) 1.0425 (1.03) 1.0425 (1.03) 0.0000 (1.0) 1.0425 (1.03) 0.0000 (1.0) 0;0 0.9592 (0.97) 1 1 test_checkout_hardlink-checkout-update[3.10.0] 1.0577 (1.04) 1.0577 (1.04) 1.0577 (1.04) 0.0000 (1.0) 1.0577 (1.04) 0.0000 (1.0) 0;0 0.9455 (0.96) 1 1 test_checkout_hardlink-checkout-update[3.20.0] 1.0123 (1.0) 1.0123 (1.0) 1.0123 (1.0) 0.0000 (1.0) 1.0123 (1.0) 0.0000 (1.0) 0;0 0.9879 (1.0) 1 1 test_checkout_hardlink-checkout-update[main] 1.1117 (1.10) 1.1117 (1.10) 1.1117 (1.10) 0.0000 (1.0) 1.1117 (1.10) 0.0000 (1.0) 0;0 0.8995 (0.91) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.58.2] 716.1373 (1.0) 765.8761 (1.0) 736.1986 (1.0) 21.0416 (1.77) 737.1770 (1.0) 34.4470 (2.36) 1;0 1.3583 (1.0) 5 3 test_plots-plots-diff[3.0.0] 1,300.6939 (1.82) 1,395.1240 (1.82) 1,349.8806 (1.83) 39.5037 (3.33) 1,363.4899 (1.85) 65.2842 (4.47) 2;0 0.7408 (0.55) 5 3 test_plots-plots-diff[3.10.0] 1,258.9871 (1.76) 1,289.9910 (1.68) 1,277.6226 (1.74) 11.8694 (1.0) 1,281.6593 (1.74) 14.8254 (1.02) 2;0 0.7827 (0.58) 5 3 test_plots-plots-diff[3.20.0] 1,291.8624 (1.80) 1,336.1516 (1.74) 1,304.5586 (1.77) 17.9708 (1.51) 1,296.9832 (1.76) 14.5921 (1.0) 1;1 0.7665 (0.56) 5 3 test_plots-plots-diff[main] 1,284.3007 (1.79) 1,325.8040 (1.73) 1,303.3530 (1.77) 18.0301 (1.52) 1,303.3301 (1.77) 32.3087 (2.21) 2;0 0.7673 (0.56) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.58.2] 728.1337 (1.0) 757.4534 (1.0) 743.3044 (1.0) 10.8191 (1.0) 744.9087 (1.0) 13.6160 (1.0) 2;0 1.3453 (1.0) 5 3 test_plots-plots-diff-json[3.0.0] 1,763.1594 (2.42) 1,829.2669 (2.42) 1,790.5898 (2.41) 23.9351 (2.21) 1,787.1261 (2.40) 17.5507 (1.29) 2;1 0.5585 (0.42) 5 3 test_plots-plots-diff-json[3.10.0] 1,722.7271 (2.37) 1,786.9998 (2.36) 1,758.3308 (2.37) 23.3505 (2.16) 1,761.2291 (2.36) 25.2477 (1.85) 2;0 0.5687 (0.42) 5 3 test_plots-plots-diff-json[3.20.0] 1,646.5328 (2.26) 1,698.9052 (2.24) 1,683.3017 (2.26) 22.0216 (2.04) 1,692.9800 (2.27) 27.5092 (2.02) 1;0 0.5941 (0.44) 5 3 test_plots-plots-diff-json[main] 1,772.7470 (2.43) 1,851.9100 (2.44) 1,812.1439 (2.44) 29.4604 (2.72) 1,816.3145 (2.44) 38.4804 (2.83) 2;0 0.5518 (0.41) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show[2.58.2] 670.7697 (1.0) 690.8205 (1.0) 676.6242 (1.0) 8.4041 (1.0) 672.0646 (1.0) 9.6074 (1.0) 1;0 1.4779 (1.0) 5 3 test_plots-plots-show[3.0.0] 1,023.6048 (1.53) 1,058.2766 (1.53) 1,038.4779 (1.53) 14.4287 (1.72) 1,042.2424 (1.55) 22.4003 (2.33) 2;0 0.9629 (0.65) 5 3 test_plots-plots-show[3.10.0] 1,033.2779 (1.54) 1,083.3545 (1.57) 1,060.2990 (1.57) 18.1606 (2.16) 1,059.3676 (1.58) 19.6087 (2.04) 2;0 0.9431 (0.64) 5 3 test_plots-plots-show[3.20.0] 1,071.7384 (1.60) 1,093.6417 (1.58) 1,081.0400 (1.60) 8.9080 (1.06) 1,080.8281 (1.61) 14.1756 (1.48) 2;0 0.9250 (0.63) 5 3 test_plots-plots-show[main] 1,058.5214 (1.58) 1,116.1489 (1.62) 1,089.2638 (1.61) 24.0613 (2.86) 1,090.6056 (1.62) 41.3009 (4.30) 2;0 0.9181 (0.62) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.58.2] 685.3384 (1.0) 706.2707 (1.0) 695.6437 (1.0) 8.6777 (1.0) 694.7108 (1.0) 14.7803 (1.0) 2;0 1.4375 (1.0) 5 3 test_plots-plots-show-json[3.0.0] 1,262.9839 (1.84) 1,419.2673 (2.01) 1,326.9650 (1.91) 61.4622 (7.08) 1,300.1880 (1.87) 83.8064 (5.67) 2;0 0.7536 (0.52) 5 3 test_plots-plots-show-json[3.10.0] 1,265.2099 (1.85) 1,304.8022 (1.85) 1,292.7485 (1.86) 15.9733 (1.84) 1,298.9102 (1.87) 16.2170 (1.10) 1;0 0.7735 (0.54) 5 3 test_plots-plots-show-json[3.20.0] 1,298.7452 (1.90) 1,381.8158 (1.96) 1,333.6447 (1.92) 30.1929 (3.48) 1,327.8359 (1.91) 27.9956 (1.89) 2;0 0.7498 (0.52) 5 3 test_plots-plots-show-json[main] 1,309.6271 (1.91) 1,356.2689 (1.92) 1,338.0113 (1.92) 18.1912 (2.10) 1,345.6635 (1.94) 23.4263 (1.58) 2;0 0.7474 (0.52) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.58.2] 645.5146 (1.10) 645.5146 (1.10) 645.5146 (1.10) 0.0000 (1.0) 645.5146 (1.10) 0.0000 (1.0) 0;0 1.5492 (0.91) 1 1 test_list-list[3.0.0] 605.8995 (1.04) 605.8995 (1.04) 605.8995 (1.04) 0.0000 (1.0) 605.8995 (1.04) 0.0000 (1.0) 0;0 1.6504 (0.97) 1 1 test_list-list[3.10.0] 585.2031 (1.0) 585.2031 (1.0) 585.2031 (1.0) 0.0000 (1.0) 585.2031 (1.0) 0.0000 (1.0) 0;0 1.7088 (1.0) 1 1 test_list-list[3.20.0] 585.7632 (1.00) 585.7632 (1.00) 585.7632 (1.00) 0.0000 (1.0) 585.7632 (1.00) 0.0000 (1.0) 0;0 1.7072 (1.00) 1 1 test_list-list[main] 591.0193 (1.01) 591.0193 (1.01) 591.0193 (1.01) 0.0000 (1.0) 591.0193 (1.01) 0.0000 (1.0) 0;0 1.6920 (0.99) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.58.2] 653.3637 (1.17) 653.3637 (1.17) 653.3637 (1.17) 0.0000 (1.0) 653.3637 (1.17) 0.0000 (1.0) 0;0 1.5305 (0.85) 1 1 test_list-list-dvc-only[3.0.0] 562.4338 (1.01) 562.4338 (1.01) 562.4338 (1.01) 0.0000 (1.0) 562.4338 (1.01) 0.0000 (1.0) 0;0 1.7780 (0.99) 1 1 test_list-list-dvc-only[3.10.0] 603.5142 (1.08) 603.5142 (1.08) 603.5142 (1.08) 0.0000 (1.0) 603.5142 (1.08) 0.0000 (1.0) 0;0 1.6570 (0.92) 1 1 test_list-list-dvc-only[3.20.0] 557.0052 (1.0) 557.0052 (1.0) 557.0052 (1.0) 0.0000 (1.0) 557.0052 (1.0) 0.0000 (1.0) 0;0 1.7953 (1.0) 1 1 test_list-list-dvc-only[main] 586.3685 (1.05) 586.3685 (1.05) 586.3685 (1.05) 0.0000 (1.0) 586.3685 (1.05) 0.0000 (1.0) 0;0 1.7054 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.58.2] 790.2843 (1.20) 790.2843 (1.20) 790.2843 (1.20) 0.0000 (1.0) 790.2843 (1.20) 0.0000 (1.0) 0;0 1.2654 (0.83) 1 1 test_list-list-recursive[3.0.0] 703.8369 (1.07) 703.8369 (1.07) 703.8369 (1.07) 0.0000 (1.0) 703.8369 (1.07) 0.0000 (1.0) 0;0 1.4208 (0.93) 1 1 test_list-list-recursive[3.10.0] 721.6520 (1.10) 721.6520 (1.10) 721.6520 (1.10) 0.0000 (1.0) 721.6520 (1.10) 0.0000 (1.0) 0;0 1.3857 (0.91) 1 1 test_list-list-recursive[3.20.0] 716.3883 (1.09) 716.3883 (1.09) 716.3883 (1.09) 0.0000 (1.0) 716.3883 (1.09) 0.0000 (1.0) 0;0 1.3959 (0.92) 1 1 test_list-list-recursive[main] 656.6768 (1.0) 656.6768 (1.0) 656.6768 (1.0) 0.0000 (1.0) 656.6768 (1.0) 0.0000 (1.0) 0;0 1.5228 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.58.2] 637.3660 (1.13) 637.3660 (1.13) 637.3660 (1.13) 0.0000 (1.0) 637.3660 (1.13) 0.0000 (1.0) 0;0 1.5690 (0.89) 1 1 test_list-list-shallow[3.0.0] 572.5221 (1.01) 572.5221 (1.01) 572.5221 (1.01) 0.0000 (1.0) 572.5221 (1.01) 0.0000 (1.0) 0;0 1.7467 (0.99) 1 1 test_list-list-shallow[3.10.0] 565.8547 (1.0) 565.8547 (1.0) 565.8547 (1.0) 0.0000 (1.0) 565.8547 (1.0) 0.0000 (1.0) 0;0 1.7672 (1.0) 1 1 test_list-list-shallow[3.20.0] 595.2240 (1.05) 595.2240 (1.05) 595.2240 (1.05) 0.0000 (1.0) 595.2240 (1.05) 0.0000 (1.0) 0;0 1.6800 (0.95) 1 1 test_list-list-shallow[main] 575.2666 (1.02) 575.2666 (1.02) 575.2666 (1.02) 0.0000 (1.0) 575.2666 (1.02) 0.0000 (1.0) 0;0 1.7383 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.58.2] 1.1468 (1.0) 1.1468 (1.0) 1.1468 (1.0) 0.0000 (1.0) 1.1468 (1.0) 0.0000 (1.0) 0;0 0.8720 (1.0) 1 1 test_exp_show-exp[3.0.0] 5.0237 (4.38) 5.0237 (4.38) 5.0237 (4.38) 0.0000 (1.0) 5.0237 (4.38) 0.0000 (1.0) 0;0 0.1991 (0.23) 1 1 test_exp_show-exp[3.10.0] 5.5779 (4.86) 5.5779 (4.86) 5.5779 (4.86) 0.0000 (1.0) 5.5779 (4.86) 0.0000 (1.0) 0;0 0.1793 (0.21) 1 1 test_exp_show-exp[3.20.0] 4.2355 (3.69) 4.2355 (3.69) 4.2355 (3.69) 0.0000 (1.0) 4.2355 (3.69) 0.0000 (1.0) 0;0 0.2361 (0.27) 1 1 test_exp_show-exp[main] 4.7708 (4.16) 4.7708 (4.16) 4.7708 (4.16) 0.0000 (1.0) 4.7708 (4.16) 0.0000 (1.0) 0;0 0.2096 (0.24) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.58.2] 8.2824 (1.01) 8.2824 (1.01) 8.2824 (1.01) 0.0000 (1.0) 8.2824 (1.01) 0.0000 (1.0) 0;0 0.1207 (0.99) 1 1 test_import_url-import-url[3.0.0] 8.7511 (1.06) 8.7511 (1.06) 8.7511 (1.06) 0.0000 (1.0) 8.7511 (1.06) 0.0000 (1.0) 0;0 0.1143 (0.94) 1 1 test_import_url-import-url[3.10.0] 8.5567 (1.04) 8.5567 (1.04) 8.5567 (1.04) 0.0000 (1.0) 8.5567 (1.04) 0.0000 (1.0) 0;0 0.1169 (0.96) 1 1 test_import_url-import-url[3.20.0] 8.2228 (1.0) 8.2228 (1.0) 8.2228 (1.0) 0.0000 (1.0) 8.2228 (1.0) 0.0000 (1.0) 0;0 0.1216 (1.0) 1 1 test_import_url-import-url[main] 8.3122 (1.01) 8.3122 (1.01) 8.3122 (1.01) 0.0000 (1.0) 8.3122 (1.01) 0.0000 (1.0) 0;0 0.1203 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.58.2] 10.4321 (1.00) 10.4321 (1.00) 10.4321 (1.00) 0.0000 (1.0) 10.4321 (1.00) 0.0000 (1.0) 0;0 0.0959 (1.00) 1 1 test_import-import[3.0.0] 10.3924 (1.0) 10.3924 (1.0) 10.3924 (1.0) 0.0000 (1.0) 10.3924 (1.0) 0.0000 (1.0) 0;0 0.0962 (1.0) 1 1 test_import-import[3.10.0] 11.3395 (1.09) 11.3395 (1.09) 11.3395 (1.09) 0.0000 (1.0) 11.3395 (1.09) 0.0000 (1.0) 0;0 0.0882 (0.92) 1 1 test_import-import[3.20.0] 11.4304 (1.10) 11.4304 (1.10) 11.4304 (1.10) 0.0000 (1.0) 11.4304 (1.10) 0.0000 (1.0) 0;0 0.0875 (0.91) 1 1 test_import-import[main] 11.3268 (1.09) 11.3268 (1.09) 11.3268 (1.09) 0.0000 (1.0) 11.3268 (1.09) 0.0000 (1.0) 0;0 0.0883 (0.92) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-import-url': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-import-url[2.58.2] 8.2048 (1.00) 8.2048 (1.00) 8.2048 (1.00) 0.0000 (1.0) 8.2048 (1.00) 0.0000 (1.0) 0;0 0.1219 (1.00) 1 1 test_update-import-url[3.0.0] 8.1686 (1.0) 8.1686 (1.0) 8.1686 (1.0) 0.0000 (1.0) 8.1686 (1.0) 0.0000 (1.0) 0;0 0.1224 (1.0) 1 1 test_update-import-url[3.10.0] 8.4602 (1.04) 8.4602 (1.04) 8.4602 (1.04) 0.0000 (1.0) 8.4602 (1.04) 0.0000 (1.0) 0;0 0.1182 (0.97) 1 1 test_update-import-url[3.20.0] 8.3973 (1.03) 8.3973 (1.03) 8.3973 (1.03) 0.0000 (1.0) 8.3973 (1.03) 0.0000 (1.0) 0;0 0.1191 (0.97) 1 1 test_update-import-url[main] 8.2439 (1.01) 8.2439 (1.01) 8.2439 (1.01) 0.0000 (1.0) 8.2439 (1.01) 0.0000 (1.0) 0;0 0.1213 (0.99) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.58.2] 7.1901 (1.0) 7.1901 (1.0) 7.1901 (1.0) 0.0000 (1.0) 7.1901 (1.0) 0.0000 (1.0) 0;0 0.1391 (1.0) 1 1 test_update-update[3.0.0] 7.2104 (1.00) 7.2104 (1.00) 7.2104 (1.00) 0.0000 (1.0) 7.2104 (1.00) 0.0000 (1.0) 0;0 0.1387 (1.00) 1 1 test_update-update[3.10.0] 7.4165 (1.03) 7.4165 (1.03) 7.4165 (1.03) 0.0000 (1.0) 7.4165 (1.03) 0.0000 (1.0) 0;0 0.1348 (0.97) 1 1 test_update-update[3.20.0] 7.3927 (1.03) 7.3927 (1.03) 7.3927 (1.03) 0.0000 (1.0) 7.3927 (1.03) 0.0000 (1.0) 0;0 0.1353 (0.97) 1 1 test_update-update[main] 7.3352 (1.02) 7.3352 (1.02) 7.3352 (1.02) 0.0000 (1.0) 7.3352 (1.02) 0.0000 (1.0) 0;0 0.1363 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update-noop[2.58.2] 1.1161 (1.0) 1.1161 (1.0) 1.1161 (1.0) 0.0000 (1.0) 1.1161 (1.0) 0.0000 (1.0) 0;0 0.8960 (1.0) 1 1 test_update-update-noop[3.0.0] 1.1272 (1.01) 1.1272 (1.01) 1.1272 (1.01) 0.0000 (1.0) 1.1272 (1.01) 0.0000 (1.0) 0;0 0.8872 (0.99) 1 1 test_update-update-noop[3.10.0] 1.1719 (1.05) 1.1719 (1.05) 1.1719 (1.05) 0.0000 (1.0) 1.1719 (1.05) 0.0000 (1.0) 0;0 0.8533 (0.95) 1 1 test_update-update-noop[3.20.0] 1.1496 (1.03) 1.1496 (1.03) 1.1496 (1.03) 0.0000 (1.0) 1.1496 (1.03) 0.0000 (1.0) 0;0 0.8699 (0.97) 1 1 test_update-update-noop[main] 1.1291 (1.01) 1.1291 (1.01) 1.1291 (1.01) 0.0000 (1.0) 1.1291 (1.01) 0.0000 (1.0) 0;0 0.8856 (0.99) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.58.2] 5.9685 (1.00) 5.9685 (1.00) 5.9685 (1.00) 0.0000 (1.0) 5.9685 (1.00) 0.0000 (1.0) 0;0 0.1675 (1.00) 1 1 test_sharing-add[3.0.0] 6.1080 (1.03) 6.1080 (1.03) 6.1080 (1.03) 0.0000 (1.0) 6.1080 (1.03) 0.0000 (1.0) 0;0 0.1637 (0.97) 1 1 test_sharing-add[3.10.0] 6.1015 (1.03) 6.1015 (1.03) 6.1015 (1.03) 0.0000 (1.0) 6.1015 (1.03) 0.0000 (1.0) 0;0 0.1639 (0.97) 1 1 test_sharing-add[3.20.0] 6.0718 (1.02) 6.0718 (1.02) 6.0718 (1.02) 0.0000 (1.0) 6.0718 (1.02) 0.0000 (1.0) 0;0 0.1647 (0.98) 1 1 test_sharing-add[main] 5.9484 (1.0) 5.9484 (1.0) 5.9484 (1.0) 0.0000 (1.0) 5.9484 (1.0) 0.0000 (1.0) 0;0 0.1681 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.58.2] 4.0089 (1.01) 4.0089 (1.01) 4.0089 (1.01) 0.0000 (1.0) 4.0089 (1.01) 0.0000 (1.0) 0;0 0.2494 (0.99) 1 1 test_sharing-add-noop[3.0.0] 3.9594 (1.0) 3.9594 (1.0) 3.9594 (1.0) 0.0000 (1.0) 3.9594 (1.0) 0.0000 (1.0) 0;0 0.2526 (1.0) 1 1 test_sharing-add-noop[3.10.0] 3.9811 (1.01) 3.9811 (1.01) 3.9811 (1.01) 0.0000 (1.0) 3.9811 (1.01) 0.0000 (1.0) 0;0 0.2512 (0.99) 1 1 test_sharing-add-noop[3.20.0] 4.0461 (1.02) 4.0461 (1.02) 4.0461 (1.02) 0.0000 (1.0) 4.0461 (1.02) 0.0000 (1.0) 0;0 0.2472 (0.98) 1 1 test_sharing-add-noop[main] 4.0522 (1.02) 4.0522 (1.02) 4.0522 (1.02) 0.0000 (1.0) 4.0522 (1.02) 0.0000 (1.0) 0;0 0.2468 (0.98) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.58.2] 944.2728 (1.0) 944.2728 (1.0) 944.2728 (1.0) 0.0000 (1.0) 944.2728 (1.0) 0.0000 (1.0) 0;0 1.0590 (1.0) 1 1 test_sharing-checkout-noop[3.0.0] 1,036.5143 (1.10) 1,036.5143 (1.10) 1,036.5143 (1.10) 0.0000 (1.0) 1,036.5143 (1.10) 0.0000 (1.0) 0;0 0.9648 (0.91) 1 1 test_sharing-checkout-noop[3.10.0] 1,023.9029 (1.08) 1,023.9029 (1.08) 1,023.9029 (1.08) 0.0000 (1.0) 1,023.9029 (1.08) 0.0000 (1.0) 0;0 0.9767 (0.92) 1 1 test_sharing-checkout-noop[3.20.0] 1,012.5389 (1.07) 1,012.5389 (1.07) 1,012.5389 (1.07) 0.0000 (1.0) 1,012.5389 (1.07) 0.0000 (1.0) 0;0 0.9876 (0.93) 1 1 test_sharing-checkout-noop[main] 1,048.0870 (1.11) 1,048.0870 (1.11) 1,048.0870 (1.11) 0.0000 (1.0) 1,048.0870 (1.11) 0.0000 (1.0) 0;0 0.9541 (0.90) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing-pull': 5 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[2.58.2] 8.0848 (1.0) 8.0848 (1.0) 8.0848 (1.0) 0.0000 (1.0) 8.0848 (1.0) 0.0000 (1.0) 0;0 0.1237 (1.0) 1 1 test_sharing-pull[3.0.0] 11.4551 (1.42) 11.4551 (1.42) 11.4551 (1.42) 0.0000 (1.0) 11.4551 (1.42) 0.0000 (1.0) 0;0 0.0873 (0.71) 1 1 test_sharing-pull[3.10.0] 11.5738 (1.43) 11.5738 (1.43) 11.5738 (1.43) 0.0000 (1.0) 11.5738 (1.43) 0.0000 (1.0) 0;0 0.0864 (0.70) 1 1 test_sharing-pull[3.20.0] 11.8495 (1.47) 11.8495 (1.47) 11.8495 (1.47) 0.0000 (1.0) 11.8495 (1.47) 0.0000 (1.0) 0;0 0.0844 (0.68) 1 1 test_sharing-pull[main] 15.5732 (1.93) 15.5732 (1.93) 15.5732 (1.93) 0.0000 (1.0) 15.5732 (1.93) 0.0000 (1.0) 0;0 0.0642 (0.52) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-pull-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[2.58.2] 1.0169 (1.0) 1.0169 (1.0) 1.0169 (1.0) 0.0000 (1.0) 1.0169 (1.0) 0.0000 (1.0) 0;0 0.9834 (1.0) 1 1 test_sharing-pull-noop[3.0.0] 1.1978 (1.18) 1.1978 (1.18) 1.1978 (1.18) 0.0000 (1.0) 1.1978 (1.18) 0.0000 (1.0) 0;0 0.8349 (0.85) 1 1 test_sharing-pull-noop[3.10.0] 1.2129 (1.19) 1.2129 (1.19) 1.2129 (1.19) 0.0000 (1.0) 1.2129 (1.19) 0.0000 (1.0) 0;0 0.8245 (0.84) 1 1 test_sharing-pull-noop[3.20.0] 1.1962 (1.18) 1.1962 (1.18) 1.1962 (1.18) 0.0000 (1.0) 1.1962 (1.18) 0.0000 (1.0) 0;0 0.8360 (0.85) 1 1 test_sharing-pull-noop[main] 1.1666 (1.15) 1.1666 (1.15) 1.1666 (1.15) 0.0000 (1.0) 1.1666 (1.15) 0.0000 (1.0) 0;0 0.8572 (0.87) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.58.2] 5.0955 (2.06) 5.0955 (2.06) 5.0955 (2.06) 0.0000 (1.0) 5.0955 (2.06) 0.0000 (1.0) 0;0 0.1963 (0.49) 1 1 test_sharing-push[3.0.0] 2.4766 (1.0) 2.4766 (1.0) 2.4766 (1.0) 0.0000 (1.0) 2.4766 (1.0) 0.0000 (1.0) 0;0 0.4038 (1.0) 1 1 test_sharing-push[3.10.0] 2.5649 (1.04) 2.5649 (1.04) 2.5649 (1.04) 0.0000 (1.0) 2.5649 (1.04) 0.0000 (1.0) 0;0 0.3899 (0.97) 1 1 test_sharing-push[3.20.0] 4.9951 (2.02) 4.9951 (2.02) 4.9951 (2.02) 0.0000 (1.0) 4.9951 (2.02) 0.0000 (1.0) 0;0 0.2002 (0.50) 1 1 test_sharing-push[main] 5.7173 (2.31) 5.7173 (2.31) 5.7173 (2.31) 0.0000 (1.0) 5.7173 (2.31) 0.0000 (1.0) 0;0 0.1749 (0.43) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.58.2] 742.6841 (1.04) 742.6841 (1.04) 742.6841 (1.04) 0.0000 (1.0) 742.6841 (1.04) 0.0000 (1.0) 0;0 1.3465 (0.96) 1 1 test_sharing-push-noop[3.0.0] 739.6395 (1.04) 739.6395 (1.04) 739.6395 (1.04) 0.0000 (1.0) 739.6395 (1.04) 0.0000 (1.0) 0;0 1.3520 (0.96) 1 1 test_sharing-push-noop[3.10.0] 711.2438 (1.0) 711.2438 (1.0) 711.2438 (1.0) 0.0000 (1.0) 711.2438 (1.0) 0.0000 (1.0) 0;0 1.4060 (1.0) 1 1 test_sharing-push-noop[3.20.0] 733.6188 (1.03) 733.6188 (1.03) 733.6188 (1.03) 0.0000 (1.0) 733.6188 (1.03) 0.0000 (1.0) 0;0 1.3631 (0.97) 1 1 test_sharing-push-noop[main] 744.6772 (1.05) 744.6772 (1.05) 744.6772 (1.05) 0.0000 (1.0) 744.6772 (1.05) 0.0000 (1.0) 0;0 1.3429 (0.96) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_gs-add[2.58.2] 6.1092 (1.01) 6.1092 (1.01) 6.1092 (1.01) 0.0000 (1.0) 6.1092 (1.01) 0.0000 (1.0) 0;0 0.1637 (0.99) 1 1 test_sharing_gs-add[2.58.2] 6.0762 (1.0) 6.0762 (1.0) 6.0762 (1.0) 0.0000 (1.0) 6.0762 (1.0) 0.0000 (1.0) 0;0 0.1646 (1.0) 1 1 test_sharing_gs-add[3.0.0] 6.1764 (1.02) 6.1764 (1.02) 6.1764 (1.02) 0.0000 (1.0) 6.1764 (1.02) 0.0000 (1.0) 0;0 0.1619 (0.98) 1 1 test_sharing_gs-add[3.0.0] 6.1753 (1.02) 6.1753 (1.02) 6.1753 (1.02) 0.0000 (1.0) 6.1753 (1.02) 0.0000 (1.0) 0;0 0.1619 (0.98) 1 1 test_sharing_gs-add[3.10.0] 6.1413 (1.01) 6.1413 (1.01) 6.1413 (1.01) 0.0000 (1.0) 6.1413 (1.01) 0.0000 (1.0) 0;0 0.1628 (0.99) 1 1 test_sharing_gs-add[3.10.0] 6.1625 (1.01) 6.1625 (1.01) 6.1625 (1.01) 0.0000 (1.0) 6.1625 (1.01) 0.0000 (1.0) 0;0 0.1623 (0.99) 1 1 test_sharing_gs-add[3.20.0] 6.1967 (1.02) 6.1967 (1.02) 6.1967 (1.02) 0.0000 (1.0) 6.1967 (1.02) 0.0000 (1.0) 0;0 0.1614 (0.98) 1 1 test_sharing_gs-add[3.20.0] 6.1929 (1.02) 6.1929 (1.02) 6.1929 (1.02) 0.0000 (1.0) 6.1929 (1.02) 0.0000 (1.0) 0;0 0.1615 (0.98) 1 1 test_sharing_gs-add[main] 6.1381 (1.01) 6.1381 (1.01) 6.1381 (1.01) 0.0000 (1.0) 6.1381 (1.01) 0.0000 (1.0) 0;0 0.1629 (0.99) 1 1 test_sharing_gs-add[main] 6.1417 (1.01) 6.1417 (1.01) 6.1417 (1.01) 0.0000 (1.0) 6.1417 (1.01) 0.0000 (1.0) 0;0 0.1628 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-add-noop[2.58.2] 4.1217 (1.02) 4.1217 (1.02) 4.1217 (1.02) 0.0000 (1.0) 4.1217 (1.02) 0.0000 (1.0) 0;0 0.2426 (0.98) 1 1 test_sharing_gs-add-noop[2.58.2] 4.0918 (1.01) 4.0918 (1.01) 4.0918 (1.01) 0.0000 (1.0) 4.0918 (1.01) 0.0000 (1.0) 0;0 0.2444 (0.99) 1 1 test_sharing_gs-add-noop[3.0.0] 4.1257 (1.02) 4.1257 (1.02) 4.1257 (1.02) 0.0000 (1.0) 4.1257 (1.02) 0.0000 (1.0) 0;0 0.2424 (0.98) 1 1 test_sharing_gs-add-noop[3.0.0] 4.0805 (1.01) 4.0805 (1.01) 4.0805 (1.01) 0.0000 (1.0) 4.0805 (1.01) 0.0000 (1.0) 0;0 0.2451 (0.99) 1 1 test_sharing_gs-add-noop[3.10.0] 4.2244 (1.05) 4.2244 (1.05) 4.2244 (1.05) 0.0000 (1.0) 4.2244 (1.05) 0.0000 (1.0) 0;0 0.2367 (0.96) 1 1 test_sharing_gs-add-noop[3.10.0] 4.2068 (1.04) 4.2068 (1.04) 4.2068 (1.04) 0.0000 (1.0) 4.2068 (1.04) 0.0000 (1.0) 0;0 0.2377 (0.96) 1 1 test_sharing_gs-add-noop[3.20.0] 4.0571 (1.01) 4.0571 (1.01) 4.0571 (1.01) 0.0000 (1.0) 4.0571 (1.01) 0.0000 (1.0) 0;0 0.2465 (0.99) 1 1 test_sharing_gs-add-noop[3.20.0] 4.1730 (1.03) 4.1730 (1.03) 4.1730 (1.03) 0.0000 (1.0) 4.1730 (1.03) 0.0000 (1.0) 0;0 0.2396 (0.97) 1 1 test_sharing_gs-add-noop[main] 4.0977 (1.02) 4.0977 (1.02) 4.0977 (1.02) 0.0000 (1.0) 4.0977 (1.02) 0.0000 (1.0) 0;0 0.2440 (0.98) 1 1 test_sharing_gs-add-noop[main] 4.0353 (1.0) 4.0353 (1.0) 4.0353 (1.0) 0.0000 (1.0) 4.0353 (1.0) 0.0000 (1.0) 0;0 0.2478 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-checkout-noop[2.58.2] 1.0132 (1.03) 1.0132 (1.03) 1.0132 (1.03) 0.0000 (1.0) 1.0132 (1.03) 0.0000 (1.0) 0;0 0.9870 (0.97) 1 1 test_sharing_gs-checkout-noop[2.58.2] 0.9824 (1.0) 0.9824 (1.0) 0.9824 (1.0) 0.0000 (1.0) 0.9824 (1.0) 0.0000 (1.0) 0;0 1.0179 (1.0) 1 1 test_sharing_gs-checkout-noop[3.0.0] 1.0729 (1.09) 1.0729 (1.09) 1.0729 (1.09) 0.0000 (1.0) 1.0729 (1.09) 0.0000 (1.0) 0;0 0.9321 (0.92) 1 1 test_sharing_gs-checkout-noop[3.0.0] 0.9947 (1.01) 0.9947 (1.01) 0.9947 (1.01) 0.0000 (1.0) 0.9947 (1.01) 0.0000 (1.0) 0;0 1.0053 (0.99) 1 1 test_sharing_gs-checkout-noop[3.10.0] 1.0870 (1.11) 1.0870 (1.11) 1.0870 (1.11) 0.0000 (1.0) 1.0870 (1.11) 0.0000 (1.0) 0;0 0.9199 (0.90) 1 1 test_sharing_gs-checkout-noop[3.10.0] 1.0939 (1.11) 1.0939 (1.11) 1.0939 (1.11) 0.0000 (1.0) 1.0939 (1.11) 0.0000 (1.0) 0;0 0.9141 (0.90) 1 1 test_sharing_gs-checkout-noop[3.20.0] 1.0653 (1.08) 1.0653 (1.08) 1.0653 (1.08) 0.0000 (1.0) 1.0653 (1.08) 0.0000 (1.0) 0;0 0.9387 (0.92) 1 1 test_sharing_gs-checkout-noop[3.20.0] 1.0500 (1.07) 1.0500 (1.07) 1.0500 (1.07) 0.0000 (1.0) 1.0500 (1.07) 0.0000 (1.0) 0;0 0.9523 (0.94) 1 1 test_sharing_gs-checkout-noop[main] 1.0522 (1.07) 1.0522 (1.07) 1.0522 (1.07) 0.0000 (1.0) 1.0522 (1.07) 0.0000 (1.0) 0;0 0.9504 (0.93) 1 1 test_sharing_gs-checkout-noop[main] 0.9989 (1.02) 0.9989 (1.02) 0.9989 (1.02) 0.0000 (1.0) 0.9989 (1.02) 0.0000 (1.0) 0;0 1.0011 (0.98) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-pull[2.58.2] 8.1614 (1.0) 8.1614 (1.0) 8.1614 (1.0) 0.0000 (1.0) 8.1614 (1.0) 0.0000 (1.0) 0;0 0.1225 (1.0) 1 1 test_sharing_gs-pull[2.58.2] 8.3792 (1.03) 8.3792 (1.03) 8.3792 (1.03) 0.0000 (1.0) 8.3792 (1.03) 0.0000 (1.0) 0;0 0.1193 (0.97) 1 1 test_sharing_gs-pull[3.0.0] 11.6696 (1.43) 11.6696 (1.43) 11.6696 (1.43) 0.0000 (1.0) 11.6696 (1.43) 0.0000 (1.0) 0;0 0.0857 (0.70) 1 1 test_sharing_gs-pull[3.0.0] 11.9930 (1.47) 11.9930 (1.47) 11.9930 (1.47) 0.0000 (1.0) 11.9930 (1.47) 0.0000 (1.0) 0;0 0.0834 (0.68) 1 1 test_sharing_gs-pull[3.10.0] 12.2953 (1.51) 12.2953 (1.51) 12.2953 (1.51) 0.0000 (1.0) 12.2953 (1.51) 0.0000 (1.0) 0;0 0.0813 (0.66) 1 1 test_sharing_gs-pull[3.10.0] 11.9237 (1.46) 11.9237 (1.46) 11.9237 (1.46) 0.0000 (1.0) 11.9237 (1.46) 0.0000 (1.0) 0;0 0.0839 (0.68) 1 1 test_sharing_gs-pull[3.20.0] 11.6498 (1.43) 11.6498 (1.43) 11.6498 (1.43) 0.0000 (1.0) 11.6498 (1.43) 0.0000 (1.0) 0;0 0.0858 (0.70) 1 1 test_sharing_gs-pull[3.20.0] 11.7562 (1.44) 11.7562 (1.44) 11.7562 (1.44) 0.0000 (1.0) 11.7562 (1.44) 0.0000 (1.0) 0;0 0.0851 (0.69) 1 1 test_sharing_gs-pull[main] 16.3161 (2.00) 16.3161 (2.00) 16.3161 (2.00) 0.0000 (1.0) 16.3161 (2.00) 0.0000 (1.0) 0;0 0.0613 (0.50) 1 1 test_sharing_gs-pull[main] 15.8792 (1.95) 15.8792 (1.95) 15.8792 (1.95) 0.0000 (1.0) 15.8792 (1.95) 0.0000 (1.0) 0;0 0.0630 (0.51) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_gs-pull-noop[2.58.2] 1.0946 (1.00) 1.0946 (1.00) 1.0946 (1.00) 0.0000 (1.0) 1.0946 (1.00) 0.0000 (1.0) 0;0 0.9136 (1.00) 1 1 test_sharing_gs-pull-noop[2.58.2] 1.0905 (1.0) 1.0905 (1.0) 1.0905 (1.0) 0.0000 (1.0) 1.0905 (1.0) 0.0000 (1.0) 0;0 0.9170 (1.0) 1 1 test_sharing_gs-pull-noop[3.0.0] 1.2631 (1.16) 1.2631 (1.16) 1.2631 (1.16) 0.0000 (1.0) 1.2631 (1.16) 0.0000 (1.0) 0;0 0.7917 (0.86) 1 1 test_sharing_gs-pull-noop[3.0.0] 1.2066 (1.11) 1.2066 (1.11) 1.2066 (1.11) 0.0000 (1.0) 1.2066 (1.11) 0.0000 (1.0) 0;0 0.8288 (0.90) 1 1 test_sharing_gs-pull-noop[3.10.0] 1.3098 (1.20) 1.3098 (1.20) 1.3098 (1.20) 0.0000 (1.0) 1.3098 (1.20) 0.0000 (1.0) 0;0 0.7635 (0.83) 1 1 test_sharing_gs-pull-noop[3.10.0] 1.2714 (1.17) 1.2714 (1.17) 1.2714 (1.17) 0.0000 (1.0) 1.2714 (1.17) 0.0000 (1.0) 0;0 0.7865 (0.86) 1 1 test_sharing_gs-pull-noop[3.20.0] 1.2501 (1.15) 1.2501 (1.15) 1.2501 (1.15) 0.0000 (1.0) 1.2501 (1.15) 0.0000 (1.0) 0;0 0.8000 (0.87) 1 1 test_sharing_gs-pull-noop[3.20.0] 1.2724 (1.17) 1.2724 (1.17) 1.2724 (1.17) 0.0000 (1.0) 1.2724 (1.17) 0.0000 (1.0) 0;0 0.7859 (0.86) 1 1 test_sharing_gs-pull-noop[main] 1.1372 (1.04) 1.1372 (1.04) 1.1372 (1.04) 0.0000 (1.0) 1.1372 (1.04) 0.0000 (1.0) 0;0 0.8793 (0.96) 1 1 test_sharing_gs-pull-noop[main] 1.1646 (1.07) 1.1646 (1.07) 1.1646 (1.07) 0.0000 (1.0) 1.1646 (1.07) 0.0000 (1.0) 0;0 0.8587 (0.94) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-push[2.58.2] 5.1024 (1.93) 5.1024 (1.93) 5.1024 (1.93) 0.0000 (1.0) 5.1024 (1.93) 0.0000 (1.0) 0;0 0.1960 (0.52) 1 1 test_sharing_gs-push[2.58.2] 5.1652 (1.95) 5.1652 (1.95) 5.1652 (1.95) 0.0000 (1.0) 5.1652 (1.95) 0.0000 (1.0) 0;0 0.1936 (0.51) 1 1 test_sharing_gs-push[3.0.0] 2.6434 (1.0) 2.6434 (1.0) 2.6434 (1.0) 0.0000 (1.0) 2.6434 (1.0) 0.0000 (1.0) 0;0 0.3783 (1.0) 1 1 test_sharing_gs-push[3.0.0] 2.7495 (1.04) 2.7495 (1.04) 2.7495 (1.04) 0.0000 (1.0) 2.7495 (1.04) 0.0000 (1.0) 0;0 0.3637 (0.96) 1 1 test_sharing_gs-push[3.10.0] 2.7006 (1.02) 2.7006 (1.02) 2.7006 (1.02) 0.0000 (1.0) 2.7006 (1.02) 0.0000 (1.0) 0;0 0.3703 (0.98) 1 1 test_sharing_gs-push[3.10.0] 2.6836 (1.02) 2.6836 (1.02) 2.6836 (1.02) 0.0000 (1.0) 2.6836 (1.02) 0.0000 (1.0) 0;0 0.3726 (0.99) 1 1 test_sharing_gs-push[3.20.0] 5.2095 (1.97) 5.2095 (1.97) 5.2095 (1.97) 0.0000 (1.0) 5.2095 (1.97) 0.0000 (1.0) 0;0 0.1920 (0.51) 1 1 test_sharing_gs-push[3.20.0] 5.2994 (2.00) 5.2994 (2.00) 5.2994 (2.00) 0.0000 (1.0) 5.2994 (2.00) 0.0000 (1.0) 0;0 0.1887 (0.50) 1 1 test_sharing_gs-push[main] 6.0135 (2.27) 6.0135 (2.27) 6.0135 (2.27) 0.0000 (1.0) 6.0135 (2.27) 0.0000 (1.0) 0;0 0.1663 (0.44) 1 1 test_sharing_gs-push[main] 6.2791 (2.38) 6.2791 (2.38) 6.2791 (2.38) 0.0000 (1.0) 6.2791 (2.38) 0.0000 (1.0) 0;0 0.1593 (0.42) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-push-noop[2.58.2] 798.6514 (1.03) 798.6514 (1.03) 798.6514 (1.03) 0.0000 (1.0) 798.6514 (1.03) 0.0000 (1.0) 0;0 1.2521 (0.97) 1 1 test_sharing_gs-push-noop[2.58.2] 792.3245 (1.02) 792.3245 (1.02) 792.3245 (1.02) 0.0000 (1.0) 792.3245 (1.02) 0.0000 (1.0) 0;0 1.2621 (0.98) 1 1 test_sharing_gs-push-noop[3.0.0] 783.9454 (1.01) 783.9454 (1.01) 783.9454 (1.01) 0.0000 (1.0) 783.9454 (1.01) 0.0000 (1.0) 0;0 1.2756 (0.99) 1 1 test_sharing_gs-push-noop[3.0.0] 775.4599 (1.00) 775.4599 (1.00) 775.4599 (1.00) 0.0000 (1.0) 775.4599 (1.00) 0.0000 (1.0) 0;0 1.2896 (1.00) 1 1 test_sharing_gs-push-noop[3.10.0] 791.9199 (1.02) 791.9199 (1.02) 791.9199 (1.02) 0.0000 (1.0) 791.9199 (1.02) 0.0000 (1.0) 0;0 1.2628 (0.98) 1 1 test_sharing_gs-push-noop[3.10.0] 793.3746 (1.02) 793.3746 (1.02) 793.3746 (1.02) 0.0000 (1.0) 793.3746 (1.02) 0.0000 (1.0) 0;0 1.2604 (0.98) 1 1 test_sharing_gs-push-noop[3.20.0] 790.6980 (1.02) 790.6980 (1.02) 790.6980 (1.02) 0.0000 (1.0) 790.6980 (1.02) 0.0000 (1.0) 0;0 1.2647 (0.98) 1 1 test_sharing_gs-push-noop[3.20.0] 774.2979 (1.0) 774.2979 (1.0) 774.2979 (1.0) 0.0000 (1.0) 774.2979 (1.0) 0.0000 (1.0) 0;0 1.2915 (1.0) 1 1 test_sharing_gs-push-noop[main] 833.0407 (1.08) 833.0407 (1.08) 833.0407 (1.08) 0.0000 (1.0) 833.0407 (1.08) 0.0000 (1.0) 0;0 1.2004 (0.93) 1 1 test_sharing_gs-push-noop[main] 853.7845 (1.10) 853.7845 (1.10) 853.7845 (1.10) 0.0000 (1.0) 853.7845 (1.10) 0.0000 (1.0) 0;0 1.1713 (0.91) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.58.2] 4.1418 (1.01) 4.1418 (1.01) 4.1418 (1.01) 0.0000 (1.0) 4.1418 (1.01) 0.0000 (1.0) 0;0 0.2414 (0.99) 1 1 test_sharing_s3-add[2.58.2] 4.1257 (1.00) 4.1257 (1.00) 4.1257 (1.00) 0.0000 (1.0) 4.1257 (1.00) 0.0000 (1.0) 0;0 0.2424 (1.00) 1 1 test_sharing_s3-add[3.0.0] 4.1589 (1.01) 4.1589 (1.01) 4.1589 (1.01) 0.0000 (1.0) 4.1589 (1.01) 0.0000 (1.0) 0;0 0.2404 (0.99) 1 1 test_sharing_s3-add[3.0.0] 4.1146 (1.00) 4.1146 (1.00) 4.1146 (1.00) 0.0000 (1.0) 4.1146 (1.00) 0.0000 (1.0) 0;0 0.2430 (1.00) 1 1 test_sharing_s3-add[3.10.0] 4.2446 (1.03) 4.2446 (1.03) 4.2446 (1.03) 0.0000 (1.0) 4.2446 (1.03) 0.0000 (1.0) 0;0 0.2356 (0.97) 1 1 test_sharing_s3-add[3.10.0] 4.1393 (1.01) 4.1393 (1.01) 4.1393 (1.01) 0.0000 (1.0) 4.1393 (1.01) 0.0000 (1.0) 0;0 0.2416 (0.99) 1 1 test_sharing_s3-add[3.20.0] 4.1108 (1.0) 4.1108 (1.0) 4.1108 (1.0) 0.0000 (1.0) 4.1108 (1.0) 0.0000 (1.0) 0;0 0.2433 (1.0) 1 1 test_sharing_s3-add[3.20.0] 4.2388 (1.03) 4.2388 (1.03) 4.2388 (1.03) 0.0000 (1.0) 4.2388 (1.03) 0.0000 (1.0) 0;0 0.2359 (0.97) 1 1 test_sharing_s3-add[main] 4.1408 (1.01) 4.1408 (1.01) 4.1408 (1.01) 0.0000 (1.0) 4.1408 (1.01) 0.0000 (1.0) 0;0 0.2415 (0.99) 1 1 test_sharing_s3-add[main] 4.1527 (1.01) 4.1527 (1.01) 4.1527 (1.01) 0.0000 (1.0) 4.1527 (1.01) 0.0000 (1.0) 0;0 0.2408 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.58.2] 2.7707 (1.01) 2.7707 (1.01) 2.7707 (1.01) 0.0000 (1.0) 2.7707 (1.01) 0.0000 (1.0) 0;0 0.3609 (0.99) 1 1 test_sharing_s3-add-noop[2.58.2] 2.7826 (1.01) 2.7826 (1.01) 2.7826 (1.01) 0.0000 (1.0) 2.7826 (1.01) 0.0000 (1.0) 0;0 0.3594 (0.99) 1 1 test_sharing_s3-add-noop[3.0.0] 3.7646 (1.37) 3.7646 (1.37) 3.7646 (1.37) 0.0000 (1.0) 3.7646 (1.37) 0.0000 (1.0) 0;0 0.2656 (0.73) 1 1 test_sharing_s3-add-noop[3.0.0] 2.7917 (1.01) 2.7917 (1.01) 2.7917 (1.01) 0.0000 (1.0) 2.7917 (1.01) 0.0000 (1.0) 0;0 0.3582 (0.99) 1 1 test_sharing_s3-add-noop[3.10.0] 2.8330 (1.03) 2.8330 (1.03) 2.8330 (1.03) 0.0000 (1.0) 2.8330 (1.03) 0.0000 (1.0) 0;0 0.3530 (0.97) 1 1 test_sharing_s3-add-noop[3.10.0] 2.8179 (1.02) 2.8179 (1.02) 2.8179 (1.02) 0.0000 (1.0) 2.8179 (1.02) 0.0000 (1.0) 0;0 0.3549 (0.98) 1 1 test_sharing_s3-add-noop[3.20.0] 2.7566 (1.0) 2.7566 (1.0) 2.7566 (1.0) 0.0000 (1.0) 2.7566 (1.0) 0.0000 (1.0) 0;0 0.3628 (1.0) 1 1 test_sharing_s3-add-noop[3.20.0] 2.8540 (1.04) 2.8540 (1.04) 2.8540 (1.04) 0.0000 (1.0) 2.8540 (1.04) 0.0000 (1.0) 0;0 0.3504 (0.97) 1 1 test_sharing_s3-add-noop[main] 2.7851 (1.01) 2.7851 (1.01) 2.7851 (1.01) 0.0000 (1.0) 2.7851 (1.01) 0.0000 (1.0) 0;0 0.3591 (0.99) 1 1 test_sharing_s3-add-noop[main] 2.7879 (1.01) 2.7879 (1.01) 2.7879 (1.01) 0.0000 (1.0) 2.7879 (1.01) 0.0000 (1.0) 0;0 0.3587 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.58.2] 844.5378 (1.25) 844.5378 (1.25) 844.5378 (1.25) 0.0000 (1.0) 844.5378 (1.25) 0.0000 (1.0) 0;0 1.1841 (0.80) 1 1 test_sharing_s3-checkout-noop[2.58.2] 673.3543 (1.0) 673.3543 (1.0) 673.3543 (1.0) 0.0000 (1.0) 673.3543 (1.0) 0.0000 (1.0) 0;0 1.4851 (1.0) 1 1 test_sharing_s3-checkout-noop[3.0.0] 870.5932 (1.29) 870.5932 (1.29) 870.5932 (1.29) 0.0000 (1.0) 870.5932 (1.29) 0.0000 (1.0) 0;0 1.1486 (0.77) 1 1 test_sharing_s3-checkout-noop[3.0.0] 875.4317 (1.30) 875.4317 (1.30) 875.4317 (1.30) 0.0000 (1.0) 875.4317 (1.30) 0.0000 (1.0) 0;0 1.1423 (0.77) 1 1 test_sharing_s3-checkout-noop[3.10.0] 911.1823 (1.35) 911.1823 (1.35) 911.1823 (1.35) 0.0000 (1.0) 911.1823 (1.35) 0.0000 (1.0) 0;0 1.0975 (0.74) 1 1 test_sharing_s3-checkout-noop[3.10.0] 872.9488 (1.30) 872.9488 (1.30) 872.9488 (1.30) 0.0000 (1.0) 872.9488 (1.30) 0.0000 (1.0) 0;0 1.1455 (0.77) 1 1 test_sharing_s3-checkout-noop[3.20.0] 714.1441 (1.06) 714.1441 (1.06) 714.1441 (1.06) 0.0000 (1.0) 714.1441 (1.06) 0.0000 (1.0) 0;0 1.4003 (0.94) 1 1 test_sharing_s3-checkout-noop[3.20.0] 713.8722 (1.06) 713.8722 (1.06) 713.8722 (1.06) 0.0000 (1.0) 713.8722 (1.06) 0.0000 (1.0) 0;0 1.4008 (0.94) 1 1 test_sharing_s3-checkout-noop[main] 687.9096 (1.02) 687.9096 (1.02) 687.9096 (1.02) 0.0000 (1.0) 687.9096 (1.02) 0.0000 (1.0) 0;0 1.4537 (0.98) 1 1 test_sharing_s3-checkout-noop[main] 678.5749 (1.01) 678.5749 (1.01) 678.5749 (1.01) 0.0000 (1.0) 678.5749 (1.01) 0.0000 (1.0) 0;0 1.4737 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.58.2] 10.6019 (1.0) 10.6019 (1.0) 10.6019 (1.0) 0.0000 (1.0) 10.6019 (1.0) 0.0000 (1.0) 0;0 0.0943 (1.0) 1 1 test_sharing_s3-pull[2.58.2] 10.6142 (1.00) 10.6142 (1.00) 10.6142 (1.00) 0.0000 (1.0) 10.6142 (1.00) 0.0000 (1.0) 0;0 0.0942 (1.00) 1 1 test_sharing_s3-pull[3.0.0] 12.4103 (1.17) 12.4103 (1.17) 12.4103 (1.17) 0.0000 (1.0) 12.4103 (1.17) 0.0000 (1.0) 0;0 0.0806 (0.85) 1 1 test_sharing_s3-pull[3.0.0] 12.8716 (1.21) 12.8716 (1.21) 12.8716 (1.21) 0.0000 (1.0) 12.8716 (1.21) 0.0000 (1.0) 0;0 0.0777 (0.82) 1 1 test_sharing_s3-pull[3.10.0] 12.5471 (1.18) 12.5471 (1.18) 12.5471 (1.18) 0.0000 (1.0) 12.5471 (1.18) 0.0000 (1.0) 0;0 0.0797 (0.84) 1 1 test_sharing_s3-pull[3.10.0] 12.7488 (1.20) 12.7488 (1.20) 12.7488 (1.20) 0.0000 (1.0) 12.7488 (1.20) 0.0000 (1.0) 0;0 0.0784 (0.83) 1 1 test_sharing_s3-pull[3.20.0] 12.7170 (1.20) 12.7170 (1.20) 12.7170 (1.20) 0.0000 (1.0) 12.7170 (1.20) 0.0000 (1.0) 0;0 0.0786 (0.83) 1 1 test_sharing_s3-pull[3.20.0] 13.3363 (1.26) 13.3363 (1.26) 13.3363 (1.26) 0.0000 (1.0) 13.3363 (1.26) 0.0000 (1.0) 0;0 0.0750 (0.79) 1 1 test_sharing_s3-pull[main] 15.5962 (1.47) 15.5962 (1.47) 15.5962 (1.47) 0.0000 (1.0) 15.5962 (1.47) 0.0000 (1.0) 0;0 0.0641 (0.68) 1 1 test_sharing_s3-pull[main] 15.5904 (1.47) 15.5904 (1.47) 15.5904 (1.47) 0.0000 (1.0) 15.5904 (1.47) 0.0000 (1.0) 0;0 0.0641 (0.68) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.58.2] 899.9719 (1.0) 899.9719 (1.0) 899.9719 (1.0) 0.0000 (1.0) 899.9719 (1.0) 0.0000 (1.0) 0;0 1.1111 (1.0) 1 1 test_sharing_s3-pull-noop[2.58.2] 909.0024 (1.01) 909.0024 (1.01) 909.0024 (1.01) 0.0000 (1.0) 909.0024 (1.01) 0.0000 (1.0) 0;0 1.1001 (0.99) 1 1 test_sharing_s3-pull-noop[3.0.0] 1,029.5904 (1.14) 1,029.5904 (1.14) 1,029.5904 (1.14) 0.0000 (1.0) 1,029.5904 (1.14) 0.0000 (1.0) 0;0 0.9713 (0.87) 1 1 test_sharing_s3-pull-noop[3.0.0] 1,031.5685 (1.15) 1,031.5685 (1.15) 1,031.5685 (1.15) 0.0000 (1.0) 1,031.5685 (1.15) 0.0000 (1.0) 0;0 0.9694 (0.87) 1 1 test_sharing_s3-pull-noop[3.10.0] 1,024.2473 (1.14) 1,024.2473 (1.14) 1,024.2473 (1.14) 0.0000 (1.0) 1,024.2473 (1.14) 0.0000 (1.0) 0;0 0.9763 (0.88) 1 1 test_sharing_s3-pull-noop[3.10.0] 1,028.9904 (1.14) 1,028.9904 (1.14) 1,028.9904 (1.14) 0.0000 (1.0) 1,028.9904 (1.14) 0.0000 (1.0) 0;0 0.9718 (0.87) 1 1 test_sharing_s3-pull-noop[3.20.0] 1,688.9301 (1.88) 1,688.9301 (1.88) 1,688.9301 (1.88) 0.0000 (1.0) 1,688.9301 (1.88) 0.0000 (1.0) 0;0 0.5921 (0.53) 1 1 test_sharing_s3-pull-noop[3.20.0] 1,446.1644 (1.61) 1,446.1644 (1.61) 1,446.1644 (1.61) 0.0000 (1.0) 1,446.1644 (1.61) 0.0000 (1.0) 0;0 0.6915 (0.62) 1 1 test_sharing_s3-pull-noop[main] 1,328.6188 (1.48) 1,328.6188 (1.48) 1,328.6188 (1.48) 0.0000 (1.0) 1,328.6188 (1.48) 0.0000 (1.0) 0;0 0.7527 (0.68) 1 1 test_sharing_s3-pull-noop[main] 1,310.1660 (1.46) 1,310.1660 (1.46) 1,310.1660 (1.46) 0.0000 (1.0) 1,310.1660 (1.46) 0.0000 (1.0) 0;0 0.7633 (0.69) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.58.2] 9.2655 (1.21) 9.2655 (1.21) 9.2655 (1.21) 0.0000 (1.0) 9.2655 (1.21) 0.0000 (1.0) 0;0 0.1079 (0.83) 1 1 test_sharing_s3-push[2.58.2] 8.9086 (1.16) 8.9086 (1.16) 8.9086 (1.16) 0.0000 (1.0) 8.9086 (1.16) 0.0000 (1.0) 0;0 0.1123 (0.86) 1 1 test_sharing_s3-push[3.0.0] 7.8656 (1.02) 7.8656 (1.02) 7.8656 (1.02) 0.0000 (1.0) 7.8656 (1.02) 0.0000 (1.0) 0;0 0.1271 (0.98) 1 1 test_sharing_s3-push[3.0.0] 7.7725 (1.01) 7.7725 (1.01) 7.7725 (1.01) 0.0000 (1.0) 7.7725 (1.01) 0.0000 (1.0) 0;0 0.1287 (0.99) 1 1 test_sharing_s3-push[3.10.0] 7.6826 (1.0) 7.6826 (1.0) 7.6826 (1.0) 0.0000 (1.0) 7.6826 (1.0) 0.0000 (1.0) 0;0 0.1302 (1.0) 1 1 test_sharing_s3-push[3.10.0] 8.0105 (1.04) 8.0105 (1.04) 8.0105 (1.04) 0.0000 (1.0) 8.0105 (1.04) 0.0000 (1.0) 0;0 0.1248 (0.96) 1 1 test_sharing_s3-push[3.20.0] 9.1763 (1.19) 9.1763 (1.19) 9.1763 (1.19) 0.0000 (1.0) 9.1763 (1.19) 0.0000 (1.0) 0;0 0.1090 (0.84) 1 1 test_sharing_s3-push[3.20.0] 9.7159 (1.26) 9.7159 (1.26) 9.7159 (1.26) 0.0000 (1.0) 9.7159 (1.26) 0.0000 (1.0) 0;0 0.1029 (0.79) 1 1 test_sharing_s3-push[main] 10.1359 (1.32) 10.1359 (1.32) 10.1359 (1.32) 0.0000 (1.0) 10.1359 (1.32) 0.0000 (1.0) 0;0 0.0987 (0.76) 1 1 test_sharing_s3-push[main] 9.7424 (1.27) 9.7424 (1.27) 9.7424 (1.27) 0.0000 (1.0) 9.7424 (1.27) 0.0000 (1.0) 0;0 0.1026 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-push-noop[2.58.2] 1.0553 (1.00) 1.0553 (1.00) 1.0553 (1.00) 0.0000 (1.0) 1.0553 (1.00) 0.0000 (1.0) 0;0 0.9476 (1.00) 1 1 test_sharing_s3-push-noop[2.58.2] 1.0510 (1.0) 1.0510 (1.0) 1.0510 (1.0) 0.0000 (1.0) 1.0510 (1.0) 0.0000 (1.0) 0;0 0.9515 (1.0) 1 1 test_sharing_s3-push-noop[3.0.0] 1.0658 (1.01) 1.0658 (1.01) 1.0658 (1.01) 0.0000 (1.0) 1.0658 (1.01) 0.0000 (1.0) 0;0 0.9382 (0.99) 1 1 test_sharing_s3-push-noop[3.0.0] 1.0567 (1.01) 1.0567 (1.01) 1.0567 (1.01) 0.0000 (1.0) 1.0567 (1.01) 0.0000 (1.0) 0;0 0.9464 (0.99) 1 1 test_sharing_s3-push-noop[3.10.0] 1.0822 (1.03) 1.0822 (1.03) 1.0822 (1.03) 0.0000 (1.0) 1.0822 (1.03) 0.0000 (1.0) 0;0 0.9240 (0.97) 1 1 test_sharing_s3-push-noop[3.10.0] 1.0868 (1.03) 1.0868 (1.03) 1.0868 (1.03) 0.0000 (1.0) 1.0868 (1.03) 0.0000 (1.0) 0;0 0.9201 (0.97) 1 1 test_sharing_s3-push-noop[3.20.0] 1.0634 (1.01) 1.0634 (1.01) 1.0634 (1.01) 0.0000 (1.0) 1.0634 (1.01) 0.0000 (1.0) 0;0 0.9404 (0.99) 1 1 test_sharing_s3-push-noop[3.20.0] 1.1385 (1.08) 1.1385 (1.08) 1.1385 (1.08) 0.0000 (1.0) 1.1385 (1.08) 0.0000 (1.0) 0;0 0.8783 (0.92) 1 1 test_sharing_s3-push-noop[main] 1.4423 (1.37) 1.4423 (1.37) 1.4423 (1.37) 0.0000 (1.0) 1.4423 (1.37) 0.0000 (1.0) 0;0 0.6933 (0.73) 1 1 test_sharing_s3-push-noop[main] 1.4614 (1.39) 1.4614 (1.39) 1.4614 (1.39) 0.0000 (1.0) 1.4614 (1.39) 0.0000 (1.0) 0;0 0.6843 (0.72) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.58.2] 4.1662 (1.0) 4.1662 (1.0) 4.1662 (1.0) 0.0000 (1.0) 4.1662 (1.0) 0.0000 (1.0) 0;0 0.2400 (1.0) 1 1 test_get_url-get-url[3.0.0] 4.2671 (1.02) 4.2671 (1.02) 4.2671 (1.02) 0.0000 (1.0) 4.2671 (1.02) 0.0000 (1.0) 0;0 0.2344 (0.98) 1 1 test_get_url-get-url[3.10.0] 4.4813 (1.08) 4.4813 (1.08) 4.4813 (1.08) 0.0000 (1.0) 4.4813 (1.08) 0.0000 (1.0) 0;0 0.2232 (0.93) 1 1 test_get_url-get-url[3.20.0] 4.4632 (1.07) 4.4632 (1.07) 4.4632 (1.07) 0.0000 (1.0) 4.4632 (1.07) 0.0000 (1.0) 0;0 0.2241 (0.93) 1 1 test_get_url-get-url[main] 4.4952 (1.08) 4.4952 (1.08) 4.4952 (1.08) 0.0000 (1.0) 4.4952 (1.08) 0.0000 (1.0) 0;0 0.2225 (0.93) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.58.2] 3.6027 (1.98) 3.6027 (1.98) 3.6027 (1.98) 0.0000 (1.0) 3.6027 (1.98) 0.0000 (1.0) 0;0 0.2776 (0.50) 1 1 test_push-push[3.0.0] 1.8178 (1.0) 1.8178 (1.0) 1.8178 (1.0) 0.0000 (1.0) 1.8178 (1.0) 0.0000 (1.0) 0;0 0.5501 (1.0) 1 1 test_push-push[3.10.0] 1.8869 (1.04) 1.8869 (1.04) 1.8869 (1.04) 0.0000 (1.0) 1.8869 (1.04) 0.0000 (1.0) 0;0 0.5300 (0.96) 1 1 test_push-push[3.20.0] 3.6271 (2.00) 3.6271 (2.00) 3.6271 (2.00) 0.0000 (1.0) 3.6271 (2.00) 0.0000 (1.0) 0;0 0.2757 (0.50) 1 1 test_push-push[main] 4.1486 (2.28) 4.1486 (2.28) 4.1486 (2.28) 0.0000 (1.0) 4.1486 (2.28) 0.0000 (1.0) 0;0 0.2410 (0.44) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_pull-pull': 5 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_pull-pull[2.58.2] 7.0267 (1.0) 7.0267 (1.0) 7.0267 (1.0) 0.0000 (1.0) 7.0267 (1.0) 0.0000 (1.0) 0;0 0.1423 (1.0) 1 1 test_pull-pull[3.0.0] 10.3696 (1.48) 10.3696 (1.48) 10.3696 (1.48) 0.0000 (1.0) 10.3696 (1.48) 0.0000 (1.0) 0;0 0.0964 (0.68) 1 1 test_pull-pull[3.10.0] 9.8509 (1.40) 9.8509 (1.40) 9.8509 (1.40) 0.0000 (1.0) 9.8509 (1.40) 0.0000 (1.0) 0;0 0.1015 (0.71) 1 1 test_pull-pull[3.20.0] 10.0040 (1.42) 10.0040 (1.42) 10.0040 (1.42) 0.0000 (1.0) 10.0040 (1.42) 0.0000 (1.0) 0;0 0.1000 (0.70) 1 1 test_pull-pull[main] 13.9285 (1.98) 13.9285 (1.98) 13.9285 (1.98) 0.0000 (1.0) 13.9285 (1.98) 0.0000 (1.0) 0;0 0.0718 (0.50) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.58.2] 215.5590 (1.09) 246.4046 (1.06) 227.2061 (1.06) 6.5526 (1.17) 226.0429 (1.06) 8.8544 (1.48) 28;1 4.4013 (0.94) 100 1 test_help---help[3.0.0] 210.7176 (1.07) 243.9345 (1.05) 219.2521 (1.03) 5.6005 (1.0) 218.1736 (1.02) 5.9819 (1.0) 25;4 4.5610 (0.97) 100 1 test_help---help[3.10.0] 201.4420 (1.02) 239.5526 (1.03) 219.2250 (1.03) 7.5906 (1.36) 218.9744 (1.03) 7.9562 (1.33) 30;5 4.5615 (0.97) 100 1 test_help---help[3.20.0] 197.5858 (1.0) 233.2031 (1.00) 213.4816 (1.0) 7.2624 (1.30) 213.1354 (1.0) 8.4562 (1.41) 31;3 4.6842 (1.0) 100 1 test_help---help[main] 202.1834 (1.02) 232.5579 (1.0) 216.2060 (1.01) 6.1622 (1.10) 215.4566 (1.01) 8.3254 (1.39) 31;0 4.6252 (0.99) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.58.2] 1.5740 (1.18) 1.5740 (1.18) 1.5740 (1.18) 0.0000 (1.0) 1.5740 (1.18) 0.0000 (1.0) 0;0 0.6353 (0.85) 1 1 test_checkout_symlink-checkout[3.0.0] 1.3880 (1.04) 1.3880 (1.04) 1.3880 (1.04) 0.0000 (1.0) 1.3880 (1.04) 0.0000 (1.0) 0;0 0.7204 (0.96) 1 1 test_checkout_symlink-checkout[3.10.0] 1.3651 (1.02) 1.3651 (1.02) 1.3651 (1.02) 0.0000 (1.0) 1.3651 (1.02) 0.0000 (1.0) 0;0 0.7325 (0.98) 1 1 test_checkout_symlink-checkout[3.20.0] 1.3769 (1.03) 1.3769 (1.03) 1.3769 (1.03) 0.0000 (1.0) 1.3769 (1.03) 0.0000 (1.0) 0;0 0.7263 (0.97) 1 1 test_checkout_symlink-checkout[main] 1.3357 (1.0) 1.3357 (1.0) 1.3357 (1.0) 0.0000 (1.0) 1.3357 (1.0) 0.0000 (1.0) 0;0 0.7487 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.58.2] 720.8196 (1.0) 720.8196 (1.0) 720.8196 (1.0) 0.0000 (1.0) 720.8196 (1.0) 0.0000 (1.0) 0;0 1.3873 (1.0) 1 1 test_checkout_symlink-checkout-noop[3.0.0] 810.4967 (1.12) 810.4967 (1.12) 810.4967 (1.12) 0.0000 (1.0) 810.4967 (1.12) 0.0000 (1.0) 0;0 1.2338 (0.89) 1 1 test_checkout_symlink-checkout-noop[3.10.0] 742.8857 (1.03) 742.8857 (1.03) 742.8857 (1.03) 0.0000 (1.0) 742.8857 (1.03) 0.0000 (1.0) 0;0 1.3461 (0.97) 1 1 test_checkout_symlink-checkout-noop[3.20.0] 758.3101 (1.05) 758.3101 (1.05) 758.3101 (1.05) 0.0000 (1.0) 758.3101 (1.05) 0.0000 (1.0) 0;0 1.3187 (0.95) 1 1 test_checkout_symlink-checkout-noop[main] 731.0771 (1.01) 731.0771 (1.01) 731.0771 (1.01) 0.0000 (1.0) 731.0771 (1.01) 0.0000 (1.0) 0;0 1.3678 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout-update[2.58.2] 968.9984 (1.16) 968.9984 (1.16) 968.9984 (1.16) 0.0000 (1.0) 968.9984 (1.16) 0.0000 (1.0) 0;0 1.0320 (0.87) 1 1 test_checkout_symlink-checkout-update[3.0.0] 861.9494 (1.03) 861.9494 (1.03) 861.9494 (1.03) 0.0000 (1.0) 861.9494 (1.03) 0.0000 (1.0) 0;0 1.1602 (0.97) 1 1 test_checkout_symlink-checkout-update[3.10.0] 844.9007 (1.01) 844.9007 (1.01) 844.9007 (1.01) 0.0000 (1.0) 844.9007 (1.01) 0.0000 (1.0) 0;0 1.1836 (0.99) 1 1 test_checkout_symlink-checkout-update[3.20.0] 1,231.5528 (1.47) 1,231.5528 (1.47) 1,231.5528 (1.47) 0.0000 (1.0) 1,231.5528 (1.47) 0.0000 (1.0) 0;0 0.8120 (0.68) 1 1 test_checkout_symlink-checkout-update[main] 838.7265 (1.0) 838.7265 (1.0) 838.7265 (1.0) 0.0000 (1.0) 838.7265 (1.0) 0.0000 (1.0) 0;0 1.1923 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------------ benchmark 'test_init-init': 5 tests ------------------------------------------------------------------------------ Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.58.2] 606.6296 (1.0) 689.6842 (1.0) 651.1774 (1.0) 16.9206 (1.09) 651.0011 (1.00) 21.3473 (1.11) 30;1 1.5357 (1.0) 100 1 test_init-init[3.0.0] 615.6834 (1.01) 1,236.0462 (1.79) 656.4050 (1.01) 60.9403 (3.92) 650.6667 (1.0) 23.4837 (1.23) 1;2 1.5234 (0.99) 100 1 test_init-init[3.10.0] 633.3825 (1.04) 698.7506 (1.01) 669.7754 (1.03) 15.5606 (1.0) 669.3029 (1.03) 24.6311 (1.29) 34;0 1.4930 (0.97) 100 1 test_init-init[3.20.0] 628.0838 (1.04) 723.8963 (1.05) 663.9537 (1.02) 16.5417 (1.06) 663.0373 (1.02) 19.1562 (1.0) 30;3 1.5061 (0.98) 100 1 test_init-init[main] 641.1967 (1.06) 735.5036 (1.07) 683.4042 (1.05) 17.2205 (1.11) 682.2783 (1.05) 20.2189 (1.06) 31;4 1.4633 (0.95) 100 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
10 months ago 
github-actions[bot]
commented
10 months ago