Closed efiop closed 10 months ago
Thu Nov 2 02:12:36 UTC 2023 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.58.2] 1.2031 (1.02) 1.2031 (1.02) 1.2031 (1.02) 0.0000 (1.0) 1.2031 (1.02) 0.0000 (1.0) 0;0 0.8312 (0.98) 1 1 test_status-status[3.0.0] 1.1827 (1.01) 1.1827 (1.01) 1.1827 (1.01) 0.0000 (1.0) 1.1827 (1.01) 0.0000 (1.0) 0;0 0.8455 (0.99) 1 1 test_status-status[3.10.0] 1.2119 (1.03) 1.2119 (1.03) 1.2119 (1.03) 0.0000 (1.0) 1.2119 (1.03) 0.0000 (1.0) 0;0 0.8251 (0.97) 1 1 test_status-status[3.20.0] 1.1953 (1.02) 1.1953 (1.02) 1.1953 (1.02) 0.0000 (1.0) 1.1953 (1.02) 0.0000 (1.0) 0;0 0.8366 (0.98) 1 1 test_status-status[main] 1.1759 (1.0) 1.1759 (1.0) 1.1759 (1.0) 0.0000 (1.0) 1.1759 (1.0) 0.0000 (1.0) 0;0 0.8504 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.58.2] 522.4496 (1.00) 522.4496 (1.00) 522.4496 (1.00) 0.0000 (1.0) 522.4496 (1.00) 0.0000 (1.0) 0;0 1.9141 (1.00) 1 1 test_status-status-changed[3.0.0] 520.0293 (1.0) 520.0293 (1.0) 520.0293 (1.0) 0.0000 (1.0) 520.0293 (1.0) 0.0000 (1.0) 0;0 1.9230 (1.0) 1 1 test_status-status-changed[3.10.0] 538.0734 (1.03) 538.0734 (1.03) 538.0734 (1.03) 0.0000 (1.0) 538.0734 (1.03) 0.0000 (1.0) 0;0 1.8585 (0.97) 1 1 test_status-status-changed[3.20.0] 565.8566 (1.09) 565.8566 (1.09) 565.8566 (1.09) 0.0000 (1.0) 565.8566 (1.09) 0.0000 (1.0) 0;0 1.7672 (0.92) 1 1 test_status-status-changed[main] 529.1155 (1.02) 529.1155 (1.02) 529.1155 (1.02) 0.0000 (1.0) 529.1155 (1.02) 0.0000 (1.0) 0;0 1.8899 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.58.2] 523.0112 (1.00) 523.0112 (1.00) 523.0112 (1.00) 0.0000 (1.0) 523.0112 (1.00) 0.0000 (1.0) 0;0 1.9120 (1.00) 1 1 test_status-status-changed-noop[3.0.0] 522.1099 (1.00) 522.1099 (1.00) 522.1099 (1.00) 0.0000 (1.0) 522.1099 (1.00) 0.0000 (1.0) 0;0 1.9153 (1.00) 1 1 test_status-status-changed-noop[3.10.0] 544.3878 (1.04) 544.3878 (1.04) 544.3878 (1.04) 0.0000 (1.0) 544.3878 (1.04) 0.0000 (1.0) 0;0 1.8369 (0.96) 1 1 test_status-status-changed-noop[3.20.0] 532.6314 (1.02) 532.6314 (1.02) 532.6314 (1.02) 0.0000 (1.0) 532.6314 (1.02) 0.0000 (1.0) 0;0 1.8775 (0.98) 1 1 test_status-status-changed-noop[main] 521.7523 (1.0) 521.7523 (1.0) 521.7523 (1.0) 0.0000 (1.0) 521.7523 (1.0) 0.0000 (1.0) 0;0 1.9166 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.58.2] 524.1428 (1.01) 524.1428 (1.01) 524.1428 (1.01) 0.0000 (1.0) 524.1428 (1.01) 0.0000 (1.0) 0;0 1.9079 (0.99) 1 1 test_status-status-noop[3.0.0] 518.7511 (1.0) 518.7511 (1.0) 518.7511 (1.0) 0.0000 (1.0) 518.7511 (1.0) 0.0000 (1.0) 0;0 1.9277 (1.0) 1 1 test_status-status-noop[3.10.0] 533.4054 (1.03) 533.4054 (1.03) 533.4054 (1.03) 0.0000 (1.0) 533.4054 (1.03) 0.0000 (1.0) 0;0 1.8747 (0.97) 1 1 test_status-status-noop[3.20.0] 538.3450 (1.04) 538.3450 (1.04) 538.3450 (1.04) 0.0000 (1.0) 538.3450 (1.04) 0.0000 (1.0) 0;0 1.8575 (0.96) 1 1 test_status-status-noop[main] 531.0513 (1.02) 531.0513 (1.02) 531.0513 (1.02) 0.0000 (1.0) 531.0513 (1.02) 0.0000 (1.0) 0;0 1.8831 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.58.2] 1.6861 (1.02) 1.6861 (1.02) 1.6861 (1.02) 0.0000 (1.0) 1.6861 (1.02) 0.0000 (1.0) 0;0 0.5931 (0.98) 1 1 test_data_status_all_flags-data-changed[3.0.0] 1.6892 (1.02) 1.6892 (1.02) 1.6892 (1.02) 0.0000 (1.0) 1.6892 (1.02) 0.0000 (1.0) 0;0 0.5920 (0.98) 1 1 test_data_status_all_flags-data-changed[3.10.0] 1.7095 (1.03) 1.7095 (1.03) 1.7095 (1.03) 0.0000 (1.0) 1.7095 (1.03) 0.0000 (1.0) 0;0 0.5850 (0.97) 1 1 test_data_status_all_flags-data-changed[3.20.0] 1.6769 (1.01) 1.6769 (1.01) 1.6769 (1.01) 0.0000 (1.0) 1.6769 (1.01) 0.0000 (1.0) 0;0 0.5963 (0.99) 1 1 test_data_status_all_flags-data-changed[main] 1.6579 (1.0) 1.6579 (1.0) 1.6579 (1.0) 0.0000 (1.0) 1.6579 (1.0) 0.0000 (1.0) 0;0 0.6032 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.58.2] 1.6545 (1.0) 1.6545 (1.0) 1.6545 (1.0) 0.0000 (1.0) 1.6545 (1.0) 0.0000 (1.0) 0;0 0.6044 (1.0) 1 1 test_data_status_all_flags-data-changed-noop[3.0.0] 1.6897 (1.02) 1.6897 (1.02) 1.6897 (1.02) 0.0000 (1.0) 1.6897 (1.02) 0.0000 (1.0) 0;0 0.5918 (0.98) 1 1 test_data_status_all_flags-data-changed-noop[3.10.0] 1.6920 (1.02) 1.6920 (1.02) 1.6920 (1.02) 0.0000 (1.0) 1.6920 (1.02) 0.0000 (1.0) 0;0 0.5910 (0.98) 1 1 test_data_status_all_flags-data-changed-noop[3.20.0] 1.6715 (1.01) 1.6715 (1.01) 1.6715 (1.01) 0.0000 (1.0) 1.6715 (1.01) 0.0000 (1.0) 0;0 0.5983 (0.99) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.6959 (1.03) 1.6959 (1.03) 1.6959 (1.03) 0.0000 (1.0) 1.6959 (1.03) 0.0000 (1.0) 0;0 0.5896 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.58.2] 2.7059 (1.0) 2.7059 (1.0) 2.7059 (1.0) 0.0000 (1.0) 2.7059 (1.0) 0.0000 (1.0) 0;0 0.3696 (1.0) 1 1 test_data_status_all_flags-data-new[3.0.0] 2.7735 (1.02) 2.7735 (1.02) 2.7735 (1.02) 0.0000 (1.0) 2.7735 (1.02) 0.0000 (1.0) 0;0 0.3606 (0.98) 1 1 test_data_status_all_flags-data-new[3.10.0] 2.7949 (1.03) 2.7949 (1.03) 2.7949 (1.03) 0.0000 (1.0) 2.7949 (1.03) 0.0000 (1.0) 0;0 0.3578 (0.97) 1 1 test_data_status_all_flags-data-new[3.20.0] 2.8001 (1.03) 2.8001 (1.03) 2.8001 (1.03) 0.0000 (1.0) 2.8001 (1.03) 0.0000 (1.0) 0;0 0.3571 (0.97) 1 1 test_data_status_all_flags-data-new[main] 2.7591 (1.02) 2.7591 (1.02) 2.7591 (1.02) 0.0000 (1.0) 2.7591 (1.02) 0.0000 (1.0) 0;0 0.3624 (0.98) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.58.2] 1.6291 (1.00) 1.6291 (1.00) 1.6291 (1.00) 0.0000 (1.0) 1.6291 (1.00) 0.0000 (1.0) 0;0 0.6138 (1.00) 1 1 test_data_status_all_flags-data-noop[3.0.0] 1.6640 (1.03) 1.6640 (1.03) 1.6640 (1.03) 0.0000 (1.0) 1.6640 (1.03) 0.0000 (1.0) 0;0 0.6010 (0.98) 1 1 test_data_status_all_flags-data-noop[3.10.0] 1.6230 (1.0) 1.6230 (1.0) 1.6230 (1.0) 0.0000 (1.0) 1.6230 (1.0) 0.0000 (1.0) 0;0 0.6162 (1.0) 1 1 test_data_status_all_flags-data-noop[3.20.0] 1.6744 (1.03) 1.6744 (1.03) 1.6744 (1.03) 0.0000 (1.0) 1.6744 (1.03) 0.0000 (1.0) 0;0 0.5972 (0.97) 1 1 test_data_status_all_flags-data-noop[main] 1.6294 (1.00) 1.6294 (1.00) 1.6294 (1.00) 0.0000 (1.0) 1.6294 (1.00) 0.0000 (1.0) 0;0 0.6137 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[2.58.2] 4.2811 (1.03) 4.2811 (1.03) 4.2811 (1.03) 0.0000 (1.0) 4.2811 (1.03) 0.0000 (1.0) 0;0 0.2336 (0.97) 1 1 test_add-add[3.0.0] 4.4878 (1.08) 4.4878 (1.08) 4.4878 (1.08) 0.0000 (1.0) 4.4878 (1.08) 0.0000 (1.0) 0;0 0.2228 (0.92) 1 1 test_add-add[3.10.0] 4.4770 (1.08) 4.4770 (1.08) 4.4770 (1.08) 0.0000 (1.0) 4.4770 (1.08) 0.0000 (1.0) 0;0 0.2234 (0.92) 1 1 test_add-add[3.20.0] 4.1401 (1.0) 4.1401 (1.0) 4.1401 (1.0) 0.0000 (1.0) 4.1401 (1.0) 0.0000 (1.0) 0;0 0.2415 (1.0) 1 1 test_add-add[main] 4.2590 (1.03) 4.2590 (1.03) 4.2590 (1.03) 0.0000 (1.0) 4.2590 (1.03) 0.0000 (1.0) 0;0 0.2348 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.58.2] 1.1512 (1.0) 1.1512 (1.0) 1.1512 (1.0) 0.0000 (1.0) 1.1512 (1.0) 0.0000 (1.0) 0;0 0.8686 (1.0) 1 1 test_diff-diff[3.0.0] 1.2119 (1.05) 1.2119 (1.05) 1.2119 (1.05) 0.0000 (1.0) 1.2119 (1.05) 0.0000 (1.0) 0;0 0.8252 (0.95) 1 1 test_diff-diff[3.10.0] 1.1833 (1.03) 1.1833 (1.03) 1.1833 (1.03) 0.0000 (1.0) 1.1833 (1.03) 0.0000 (1.0) 0;0 0.8451 (0.97) 1 1 test_diff-diff[3.20.0] 1.2258 (1.06) 1.2258 (1.06) 1.2258 (1.06) 0.0000 (1.0) 1.2258 (1.06) 0.0000 (1.0) 0;0 0.8158 (0.94) 1 1 test_diff-diff[main] 1.2221 (1.06) 1.2221 (1.06) 1.2221 (1.06) 0.0000 (1.0) 1.2221 (1.06) 0.0000 (1.0) 0;0 0.8182 (0.94) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.58.2] 606.7623 (1.05) 606.7623 (1.05) 606.7623 (1.05) 0.0000 (1.0) 606.7623 (1.05) 0.0000 (1.0) 0;0 1.6481 (0.95) 1 1 test_diff-diff-changed[3.0.0] 624.0810 (1.08) 624.0810 (1.08) 624.0810 (1.08) 0.0000 (1.0) 624.0810 (1.08) 0.0000 (1.0) 0;0 1.6024 (0.93) 1 1 test_diff-diff-changed[3.10.0] 639.9048 (1.11) 639.9048 (1.11) 639.9048 (1.11) 0.0000 (1.0) 639.9048 (1.11) 0.0000 (1.0) 0;0 1.5627 (0.90) 1 1 test_diff-diff-changed[3.20.0] 631.4638 (1.09) 631.4638 (1.09) 631.4638 (1.09) 0.0000 (1.0) 631.4638 (1.09) 0.0000 (1.0) 0;0 1.5836 (0.92) 1 1 test_diff-diff-changed[main] 578.6859 (1.0) 578.6859 (1.0) 578.6859 (1.0) 0.0000 (1.0) 578.6859 (1.0) 0.0000 (1.0) 0;0 1.7281 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.58.2] 593.5859 (1.00) 593.5859 (1.00) 593.5859 (1.00) 0.0000 (1.0) 593.5859 (1.00) 0.0000 (1.0) 0;0 1.6847 (1.00) 1 1 test_diff-diff-changed-noop[3.0.0] 594.0900 (1.00) 594.0900 (1.00) 594.0900 (1.00) 0.0000 (1.0) 594.0900 (1.00) 0.0000 (1.0) 0;0 1.6832 (1.00) 1 1 test_diff-diff-changed-noop[3.10.0] 607.3853 (1.03) 607.3853 (1.03) 607.3853 (1.03) 0.0000 (1.0) 607.3853 (1.03) 0.0000 (1.0) 0;0 1.6464 (0.97) 1 1 test_diff-diff-changed-noop[3.20.0] 591.6955 (1.0) 591.6955 (1.0) 591.6955 (1.0) 0.0000 (1.0) 591.6955 (1.0) 0.0000 (1.0) 0;0 1.6901 (1.0) 1 1 test_diff-diff-changed-noop[main] 601.4856 (1.02) 601.4856 (1.02) 601.4856 (1.02) 0.0000 (1.0) 601.4856 (1.02) 0.0000 (1.0) 0;0 1.6626 (0.98) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.58.2] 558.9113 (1.0) 558.9113 (1.0) 558.9113 (1.0) 0.0000 (1.0) 558.9113 (1.0) 0.0000 (1.0) 0;0 1.7892 (1.0) 1 1 test_diff-diff-noop[3.0.0] 563.6559 (1.01) 563.6559 (1.01) 563.6559 (1.01) 0.0000 (1.0) 563.6559 (1.01) 0.0000 (1.0) 0;0 1.7741 (0.99) 1 1 test_diff-diff-noop[3.10.0] 581.8267 (1.04) 581.8267 (1.04) 581.8267 (1.04) 0.0000 (1.0) 581.8267 (1.04) 0.0000 (1.0) 0;0 1.7187 (0.96) 1 1 test_diff-diff-noop[3.20.0] 571.9740 (1.02) 571.9740 (1.02) 571.9740 (1.02) 0.0000 (1.0) 571.9740 (1.02) 0.0000 (1.0) 0;0 1.7483 (0.98) 1 1 test_diff-diff-noop[main] 586.6800 (1.05) 586.6800 (1.05) 586.6800 (1.05) 0.0000 (1.0) 586.6800 (1.05) 0.0000 (1.0) 0;0 1.7045 (0.95) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.58.2] 4.1692 (1.01) 4.1692 (1.01) 4.1692 (1.01) 0.0000 (1.0) 4.1692 (1.01) 0.0000 (1.0) 0;0 0.2399 (0.99) 1 1 test_partial_remove-add[3.0.0] 4.1336 (1.00) 4.1336 (1.00) 4.1336 (1.00) 0.0000 (1.0) 4.1336 (1.00) 0.0000 (1.0) 0;0 0.2419 (1.00) 1 1 test_partial_remove-add[3.10.0] 4.1894 (1.01) 4.1894 (1.01) 4.1894 (1.01) 0.0000 (1.0) 4.1894 (1.01) 0.0000 (1.0) 0;0 0.2387 (0.99) 1 1 test_partial_remove-add[3.20.0] 4.1697 (1.01) 4.1697 (1.01) 4.1697 (1.01) 0.0000 (1.0) 4.1697 (1.01) 0.0000 (1.0) 0;0 0.2398 (0.99) 1 1 test_partial_remove-add[main] 4.1333 (1.0) 4.1333 (1.0) 4.1333 (1.0) 0.0000 (1.0) 4.1333 (1.0) 0.0000 (1.0) 0;0 0.2419 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add-update[2.58.2] 1.7051 (1.02) 1.7051 (1.02) 1.7051 (1.02) 0.0000 (1.0) 1.7051 (1.02) 0.0000 (1.0) 0;0 0.5865 (0.98) 1 1 test_partial_remove-add-update[3.0.0] 1.6734 (1.0) 1.6734 (1.0) 1.6734 (1.0) 0.0000 (1.0) 1.6734 (1.0) 0.0000 (1.0) 0;0 0.5976 (1.0) 1 1 test_partial_remove-add-update[3.10.0] 1.7278 (1.03) 1.7278 (1.03) 1.7278 (1.03) 0.0000 (1.0) 1.7278 (1.03) 0.0000 (1.0) 0;0 0.5788 (0.97) 1 1 test_partial_remove-add-update[3.20.0] 1.7179 (1.03) 1.7179 (1.03) 1.7179 (1.03) 0.0000 (1.0) 1.7179 (1.03) 0.0000 (1.0) 0;0 0.5821 (0.97) 1 1 test_partial_remove-add-update[main] 1.6780 (1.00) 1.6780 (1.00) 1.6780 (1.00) 0.0000 (1.0) 1.6780 (1.00) 0.0000 (1.0) 0;0 0.5959 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.58.2] 603.7356 (1.0) 603.7356 (1.0) 603.7356 (1.0) 0.0000 (1.0) 603.7356 (1.0) 0.0000 (1.0) 0;0 1.6564 (1.0) 1 1 test_partial_remove-gc[3.0.0] 651.6685 (1.08) 651.6685 (1.08) 651.6685 (1.08) 0.0000 (1.0) 651.6685 (1.08) 0.0000 (1.0) 0;0 1.5345 (0.93) 1 1 test_partial_remove-gc[3.10.0] 653.9782 (1.08) 653.9782 (1.08) 653.9782 (1.08) 0.0000 (1.0) 653.9782 (1.08) 0.0000 (1.0) 0;0 1.5291 (0.92) 1 1 test_partial_remove-gc[3.20.0] 650.9952 (1.08) 650.9952 (1.08) 650.9952 (1.08) 0.0000 (1.0) 650.9952 (1.08) 0.0000 (1.0) 0;0 1.5361 (0.93) 1 1 test_partial_remove-gc[main] 652.1003 (1.08) 652.1003 (1.08) 652.1003 (1.08) 0.0000 (1.0) 652.1003 (1.08) 0.0000 (1.0) 0;0 1.5335 (0.93) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.58.2] 686.3065 (1.0) 686.3065 (1.0) 686.3065 (1.0) 0.0000 (1.0) 686.3065 (1.0) 0.0000 (1.0) 0;0 1.4571 (1.0) 1 1 test_partial_remove-gc-cloud[3.0.0] 711.5552 (1.04) 711.5552 (1.04) 711.5552 (1.04) 0.0000 (1.0) 711.5552 (1.04) 0.0000 (1.0) 0;0 1.4054 (0.96) 1 1 test_partial_remove-gc-cloud[3.10.0] 739.9557 (1.08) 739.9557 (1.08) 739.9557 (1.08) 0.0000 (1.0) 739.9557 (1.08) 0.0000 (1.0) 0;0 1.3514 (0.93) 1 1 test_partial_remove-gc-cloud[3.20.0] 718.0778 (1.05) 718.0778 (1.05) 718.0778 (1.05) 0.0000 (1.0) 718.0778 (1.05) 0.0000 (1.0) 0;0 1.3926 (0.96) 1 1 test_partial_remove-gc-cloud[main] 752.9090 (1.10) 752.9090 (1.10) 752.9090 (1.10) 0.0000 (1.0) 752.9090 (1.10) 0.0000 (1.0) 0;0 1.3282 (0.91) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.58.2] 3.5724 (2.00) 3.5724 (2.00) 3.5724 (2.00) 0.0000 (1.0) 3.5724 (2.00) 0.0000 (1.0) 0;0 0.2799 (0.50) 1 1 test_partial_remove-push[3.0.0] 1.8199 (1.02) 1.8199 (1.02) 1.8199 (1.02) 0.0000 (1.0) 1.8199 (1.02) 0.0000 (1.0) 0;0 0.5495 (0.98) 1 1 test_partial_remove-push[3.10.0] 1.7842 (1.0) 1.7842 (1.0) 1.7842 (1.0) 0.0000 (1.0) 1.7842 (1.0) 0.0000 (1.0) 0;0 0.5605 (1.0) 1 1 test_partial_remove-push[3.20.0] 3.4969 (1.96) 3.4969 (1.96) 3.4969 (1.96) 0.0000 (1.0) 3.4969 (1.96) 0.0000 (1.0) 0;0 0.2860 (0.51) 1 1 test_partial_remove-push[main] 4.0217 (2.25) 4.0217 (2.25) 4.0217 (2.25) 0.0000 (1.0) 4.0217 (2.25) 0.0000 (1.0) 0;0 0.2487 (0.44) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push-update[2.58.2] 598.6254 (1.03) 598.6254 (1.03) 598.6254 (1.03) 0.0000 (1.0) 598.6254 (1.03) 0.0000 (1.0) 0;0 1.6705 (0.97) 1 1 test_partial_remove-push-update[3.0.0] 584.3108 (1.01) 584.3108 (1.01) 584.3108 (1.01) 0.0000 (1.0) 584.3108 (1.01) 0.0000 (1.0) 0;0 1.7114 (0.99) 1 1 test_partial_remove-push-update[3.10.0] 579.4519 (1.0) 579.4519 (1.0) 579.4519 (1.0) 0.0000 (1.0) 579.4519 (1.0) 0.0000 (1.0) 0;0 1.7258 (1.0) 1 1 test_partial_remove-push-update[3.20.0] 579.6213 (1.00) 579.6213 (1.00) 579.6213 (1.00) 0.0000 (1.0) 579.6213 (1.00) 0.0000 (1.0) 0;0 1.7253 (1.00) 1 1 test_partial_remove-push-update[main] 980.6340 (1.69) 980.6340 (1.69) 980.6340 (1.69) 0.0000 (1.0) 980.6340 (1.69) 0.0000 (1.0) 0;0 1.0197 (0.59) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add[2.58.2] 2.8922 (1.01) 2.8922 (1.01) 2.8922 (1.01) 0.0000 (1.0) 2.8922 (1.01) 0.0000 (1.0) 0;0 0.3458 (0.99) 1 1 test_partial_add-add[3.0.0] 2.8840 (1.01) 2.8840 (1.01) 2.8840 (1.01) 0.0000 (1.0) 2.8840 (1.01) 0.0000 (1.0) 0;0 0.3467 (0.99) 1 1 test_partial_add-add[3.10.0] 2.8840 (1.01) 2.8840 (1.01) 2.8840 (1.01) 0.0000 (1.0) 2.8840 (1.01) 0.0000 (1.0) 0;0 0.3467 (0.99) 1 1 test_partial_add-add[3.20.0] 2.8825 (1.01) 2.8825 (1.01) 2.8825 (1.01) 0.0000 (1.0) 2.8825 (1.01) 0.0000 (1.0) 0;0 0.3469 (0.99) 1 1 test_partial_add-add[main] 2.8615 (1.0) 2.8615 (1.0) 2.8615 (1.0) 0.0000 (1.0) 2.8615 (1.0) 0.0000 (1.0) 0;0 0.3495 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial[2.58.2] 4.0484 (1.01) 4.0484 (1.01) 4.0484 (1.01) 0.0000 (1.0) 4.0484 (1.01) 0.0000 (1.0) 0;0 0.2470 (0.99) 1 1 test_partial_add-add-partial[3.0.0] 4.0118 (1.0) 4.0118 (1.0) 4.0118 (1.0) 0.0000 (1.0) 4.0118 (1.0) 0.0000 (1.0) 0;0 0.2493 (1.0) 1 1 test_partial_add-add-partial[3.10.0] 4.0733 (1.02) 4.0733 (1.02) 4.0733 (1.02) 0.0000 (1.0) 4.0733 (1.02) 0.0000 (1.0) 0;0 0.2455 (0.98) 1 1 test_partial_add-add-partial[3.20.0] 4.0879 (1.02) 4.0879 (1.02) 4.0879 (1.02) 0.0000 (1.0) 4.0879 (1.02) 0.0000 (1.0) 0;0 0.2446 (0.98) 1 1 test_partial_add-add-partial[main] 4.0577 (1.01) 4.0577 (1.01) 4.0577 (1.01) 0.0000 (1.0) 4.0577 (1.01) 0.0000 (1.0) 0;0 0.2464 (0.99) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 5 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.58.2] 847.8893 (1.0) 847.8893 (1.0) 847.8893 (1.0) 0.0000 (1.0) 847.8893 (1.0) 0.0000 (1.0) 0;0 1.1794 (1.0) 1 1 test_partial_add-gc-cloud-noop[3.0.0] 947.4621 (1.12) 947.4621 (1.12) 947.4621 (1.12) 0.0000 (1.0) 947.4621 (1.12) 0.0000 (1.0) 0;0 1.0555 (0.89) 1 1 test_partial_add-gc-cloud-noop[3.10.0] 953.8541 (1.12) 953.8541 (1.12) 953.8541 (1.12) 0.0000 (1.0) 953.8541 (1.12) 0.0000 (1.0) 0;0 1.0484 (0.89) 1 1 test_partial_add-gc-cloud-noop[3.20.0] 923.6402 (1.09) 923.6402 (1.09) 923.6402 (1.09) 0.0000 (1.0) 923.6402 (1.09) 0.0000 (1.0) 0;0 1.0827 (0.92) 1 1 test_partial_add-gc-cloud-noop[main] 1,040.9248 (1.23) 1,040.9248 (1.23) 1,040.9248 (1.23) 0.0000 (1.0) 1,040.9248 (1.23) 0.0000 (1.0) 0;0 0.9607 (0.81) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.58.2] 709.2887 (1.0) 709.2887 (1.0) 709.2887 (1.0) 0.0000 (1.0) 709.2887 (1.0) 0.0000 (1.0) 0;0 1.4099 (1.0) 1 1 test_partial_add-gc-noop[3.0.0] 834.4971 (1.18) 834.4971 (1.18) 834.4971 (1.18) 0.0000 (1.0) 834.4971 (1.18) 0.0000 (1.0) 0;0 1.1983 (0.85) 1 1 test_partial_add-gc-noop[3.10.0] 844.3889 (1.19) 844.3889 (1.19) 844.3889 (1.19) 0.0000 (1.0) 844.3889 (1.19) 0.0000 (1.0) 0;0 1.1843 (0.84) 1 1 test_partial_add-gc-noop[3.20.0] 823.6372 (1.16) 823.6372 (1.16) 823.6372 (1.16) 0.0000 (1.0) 823.6372 (1.16) 0.0000 (1.0) 0;0 1.2141 (0.86) 1 1 test_partial_add-gc-noop[main] 827.6902 (1.17) 827.6902 (1.17) 827.6902 (1.17) 0.0000 (1.0) 827.6902 (1.17) 0.0000 (1.0) 0;0 1.2082 (0.86) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push[2.58.2] 2.3826 (1.83) 2.3826 (1.83) 2.3826 (1.83) 0.0000 (1.0) 2.3826 (1.83) 0.0000 (1.0) 0;0 0.4197 (0.55) 1 1 test_partial_add-push[3.0.0] 1.3003 (1.0) 1.3003 (1.0) 1.3003 (1.0) 0.0000 (1.0) 1.3003 (1.0) 0.0000 (1.0) 0;0 0.7691 (1.0) 1 1 test_partial_add-push[3.10.0] 1.3332 (1.03) 1.3332 (1.03) 1.3332 (1.03) 0.0000 (1.0) 1.3332 (1.03) 0.0000 (1.0) 0;0 0.7501 (0.98) 1 1 test_partial_add-push[3.20.0] 2.3988 (1.84) 2.3988 (1.84) 2.3988 (1.84) 0.0000 (1.0) 2.3988 (1.84) 0.0000 (1.0) 0;0 0.4169 (0.54) 1 1 test_partial_add-push[main] 2.9636 (2.28) 2.9636 (2.28) 2.9636 (2.28) 0.0000 (1.0) 2.9636 (2.28) 0.0000 (1.0) 0;0 0.3374 (0.44) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial[2.58.2] 2.4617 (1.75) 2.4617 (1.75) 2.4617 (1.75) 0.0000 (1.0) 2.4617 (1.75) 0.0000 (1.0) 0;0 0.4062 (0.57) 1 1 test_partial_add-push-partial[3.0.0] 1.4044 (1.0) 1.4044 (1.0) 1.4044 (1.0) 0.0000 (1.0) 1.4044 (1.0) 0.0000 (1.0) 0;0 0.7121 (1.0) 1 1 test_partial_add-push-partial[3.10.0] 1.4667 (1.04) 1.4667 (1.04) 1.4667 (1.04) 0.0000 (1.0) 1.4667 (1.04) 0.0000 (1.0) 0;0 0.6818 (0.96) 1 1 test_partial_add-push-partial[3.20.0] 2.4201 (1.72) 2.4201 (1.72) 2.4201 (1.72) 0.0000 (1.0) 2.4201 (1.72) 0.0000 (1.0) 0;0 0.4132 (0.58) 1 1 test_partial_add-push-partial[main] 3.1234 (2.22) 3.1234 (2.22) 3.1234 (2.22) 0.0000 (1.0) 3.1234 (2.22) 0.0000 (1.0) 0;0 0.3202 (0.45) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.58.2] 481.9505 (1.01) 481.9505 (1.01) 481.9505 (1.01) 0.0000 (1.0) 481.9505 (1.01) 0.0000 (1.0) 0;0 2.0749 (0.99) 1 1 test_gc-gc[3.0.0] 482.8618 (1.01) 482.8618 (1.01) 482.8618 (1.01) 0.0000 (1.0) 482.8618 (1.01) 0.0000 (1.0) 0;0 2.0710 (0.99) 1 1 test_gc-gc[3.10.0] 488.4729 (1.02) 488.4729 (1.02) 488.4729 (1.02) 0.0000 (1.0) 488.4729 (1.02) 0.0000 (1.0) 0;0 2.0472 (0.98) 1 1 test_gc-gc[3.20.0] 476.9194 (1.0) 476.9194 (1.0) 476.9194 (1.0) 0.0000 (1.0) 476.9194 (1.0) 0.0000 (1.0) 0;0 2.0968 (1.0) 1 1 test_gc-gc[main] 491.8195 (1.03) 491.8195 (1.03) 491.8195 (1.03) 0.0000 (1.0) 491.8195 (1.03) 0.0000 (1.0) 0;0 2.0333 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.58.2] 7.9556 (1.01) 7.9556 (1.01) 7.9556 (1.01) 0.0000 (1.0) 7.9556 (1.01) 0.0000 (1.0) 0;0 0.1257 (0.99) 1 1 test_get-get[3.0.0] 7.8833 (1.0) 7.8833 (1.0) 7.8833 (1.0) 0.0000 (1.0) 7.8833 (1.0) 0.0000 (1.0) 0;0 0.1269 (1.0) 1 1 test_get-get[3.10.0] 8.8029 (1.12) 8.8029 (1.12) 8.8029 (1.12) 0.0000 (1.0) 8.8029 (1.12) 0.0000 (1.0) 0;0 0.1136 (0.90) 1 1 test_get-get[3.20.0] 8.9840 (1.14) 8.9840 (1.14) 8.9840 (1.14) 0.0000 (1.0) 8.9840 (1.14) 0.0000 (1.0) 0;0 0.1113 (0.88) 1 1 test_get-get[main] 8.8322 (1.12) 8.8322 (1.12) 8.8322 (1.12) 0.0000 (1.0) 8.8322 (1.12) 0.0000 (1.0) 0;0 0.1132 (0.89) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add[2.58.2] 5.1961 (1.02) 5.1961 (1.02) 5.1961 (1.02) 0.0000 (1.0) 5.1961 (1.02) 0.0000 (1.0) 0;0 0.1925 (0.98) 1 1 test_sharing_azure-add[2.58.2] 5.9388 (1.16) 5.9388 (1.16) 5.9388 (1.16) 0.0000 (1.0) 5.9388 (1.16) 0.0000 (1.0) 0;0 0.1684 (0.86) 1 1 test_sharing_azure-add[3.0.0] 5.1040 (1.0) 5.1040 (1.0) 5.1040 (1.0) 0.0000 (1.0) 5.1040 (1.0) 0.0000 (1.0) 0;0 0.1959 (1.0) 1 1 test_sharing_azure-add[3.0.0] 5.1695 (1.01) 5.1695 (1.01) 5.1695 (1.01) 0.0000 (1.0) 5.1695 (1.01) 0.0000 (1.0) 0;0 0.1934 (0.99) 1 1 test_sharing_azure-add[3.10.0] 5.2043 (1.02) 5.2043 (1.02) 5.2043 (1.02) 0.0000 (1.0) 5.2043 (1.02) 0.0000 (1.0) 0;0 0.1922 (0.98) 1 1 test_sharing_azure-add[3.10.0] 5.1884 (1.02) 5.1884 (1.02) 5.1884 (1.02) 0.0000 (1.0) 5.1884 (1.02) 0.0000 (1.0) 0;0 0.1927 (0.98) 1 1 test_sharing_azure-add[3.20.0] 5.1441 (1.01) 5.1441 (1.01) 5.1441 (1.01) 0.0000 (1.0) 5.1441 (1.01) 0.0000 (1.0) 0;0 0.1944 (0.99) 1 1 test_sharing_azure-add[3.20.0] 5.1840 (1.02) 5.1840 (1.02) 5.1840 (1.02) 0.0000 (1.0) 5.1840 (1.02) 0.0000 (1.0) 0;0 0.1929 (0.98) 1 1 test_sharing_azure-add[main] 5.2143 (1.02) 5.2143 (1.02) 5.2143 (1.02) 0.0000 (1.0) 5.2143 (1.02) 0.0000 (1.0) 0;0 0.1918 (0.98) 1 1 test_sharing_azure-add[main] 5.1909 (1.02) 5.1909 (1.02) 5.1909 (1.02) 0.0000 (1.0) 5.1909 (1.02) 0.0000 (1.0) 0;0 0.1926 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-add-noop[2.58.2] 3.3739 (1.0) 3.3739 (1.0) 3.3739 (1.0) 0.0000 (1.0) 3.3739 (1.0) 0.0000 (1.0) 0;0 0.2964 (1.0) 1 1 test_sharing_azure-add-noop[2.58.2] 3.4815 (1.03) 3.4815 (1.03) 3.4815 (1.03) 0.0000 (1.0) 3.4815 (1.03) 0.0000 (1.0) 0;0 0.2872 (0.97) 1 1 test_sharing_azure-add-noop[3.0.0] 3.4618 (1.03) 3.4618 (1.03) 3.4618 (1.03) 0.0000 (1.0) 3.4618 (1.03) 0.0000 (1.0) 0;0 0.2889 (0.97) 1 1 test_sharing_azure-add-noop[3.0.0] 3.4641 (1.03) 3.4641 (1.03) 3.4641 (1.03) 0.0000 (1.0) 3.4641 (1.03) 0.0000 (1.0) 0;0 0.2887 (0.97) 1 1 test_sharing_azure-add-noop[3.10.0] 3.4988 (1.04) 3.4988 (1.04) 3.4988 (1.04) 0.0000 (1.0) 3.4988 (1.04) 0.0000 (1.0) 0;0 0.2858 (0.96) 1 1 test_sharing_azure-add-noop[3.10.0] 3.4433 (1.02) 3.4433 (1.02) 3.4433 (1.02) 0.0000 (1.0) 3.4433 (1.02) 0.0000 (1.0) 0;0 0.2904 (0.98) 1 1 test_sharing_azure-add-noop[3.20.0] 3.4314 (1.02) 3.4314 (1.02) 3.4314 (1.02) 0.0000 (1.0) 3.4314 (1.02) 0.0000 (1.0) 0;0 0.2914 (0.98) 1 1 test_sharing_azure-add-noop[3.20.0] 3.4717 (1.03) 3.4717 (1.03) 3.4717 (1.03) 0.0000 (1.0) 3.4717 (1.03) 0.0000 (1.0) 0;0 0.2880 (0.97) 1 1 test_sharing_azure-add-noop[main] 3.4997 (1.04) 3.4997 (1.04) 3.4997 (1.04) 0.0000 (1.0) 3.4997 (1.04) 0.0000 (1.0) 0;0 0.2857 (0.96) 1 1 test_sharing_azure-add-noop[main] 3.4263 (1.02) 3.4263 (1.02) 3.4263 (1.02) 0.0000 (1.0) 3.4263 (1.02) 0.0000 (1.0) 0;0 0.2919 (0.98) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-checkout-noop[2.58.2] 892.7006 (1.07) 892.7006 (1.07) 892.7006 (1.07) 0.0000 (1.0) 892.7006 (1.07) 0.0000 (1.0) 0;0 1.1202 (0.94) 1 1 test_sharing_azure-checkout-noop[2.58.2] 859.3283 (1.03) 859.3283 (1.03) 859.3283 (1.03) 0.0000 (1.0) 859.3283 (1.03) 0.0000 (1.0) 0;0 1.1637 (0.98) 1 1 test_sharing_azure-checkout-noop[3.0.0] 855.9947 (1.02) 855.9947 (1.02) 855.9947 (1.02) 0.0000 (1.0) 855.9947 (1.02) 0.0000 (1.0) 0;0 1.1682 (0.98) 1 1 test_sharing_azure-checkout-noop[3.0.0] 893.8948 (1.07) 893.8948 (1.07) 893.8948 (1.07) 0.0000 (1.0) 893.8948 (1.07) 0.0000 (1.0) 0;0 1.1187 (0.94) 1 1 test_sharing_azure-checkout-noop[3.10.0] 903.2805 (1.08) 903.2805 (1.08) 903.2805 (1.08) 0.0000 (1.0) 903.2805 (1.08) 0.0000 (1.0) 0;0 1.1071 (0.93) 1 1 test_sharing_azure-checkout-noop[3.10.0] 889.5065 (1.06) 889.5065 (1.06) 889.5065 (1.06) 0.0000 (1.0) 889.5065 (1.06) 0.0000 (1.0) 0;0 1.1242 (0.94) 1 1 test_sharing_azure-checkout-noop[3.20.0] 905.5096 (1.08) 905.5096 (1.08) 905.5096 (1.08) 0.0000 (1.0) 905.5096 (1.08) 0.0000 (1.0) 0;0 1.1044 (0.93) 1 1 test_sharing_azure-checkout-noop[3.20.0] 876.7906 (1.05) 876.7906 (1.05) 876.7906 (1.05) 0.0000 (1.0) 876.7906 (1.05) 0.0000 (1.0) 0;0 1.1405 (0.96) 1 1 test_sharing_azure-checkout-noop[main] 854.2263 (1.02) 854.2263 (1.02) 854.2263 (1.02) 0.0000 (1.0) 854.2263 (1.02) 0.0000 (1.0) 0;0 1.1707 (0.98) 1 1 test_sharing_azure-checkout-noop[main] 837.8845 (1.0) 837.8845 (1.0) 837.8845 (1.0) 0.0000 (1.0) 837.8845 (1.0) 0.0000 (1.0) 0;0 1.1935 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull[2.58.2] 6.9158 (1.0) 6.9158 (1.0) 6.9158 (1.0) 0.0000 (1.0) 6.9158 (1.0) 0.0000 (1.0) 0;0 0.1446 (1.0) 1 1 test_sharing_azure-pull[2.58.2] 6.9755 (1.01) 6.9755 (1.01) 6.9755 (1.01) 0.0000 (1.0) 6.9755 (1.01) 0.0000 (1.0) 0;0 0.1434 (0.99) 1 1 test_sharing_azure-pull[3.0.0] 9.7068 (1.40) 9.7068 (1.40) 9.7068 (1.40) 0.0000 (1.0) 9.7068 (1.40) 0.0000 (1.0) 0;0 0.1030 (0.71) 1 1 test_sharing_azure-pull[3.0.0] 9.8339 (1.42) 9.8339 (1.42) 9.8339 (1.42) 0.0000 (1.0) 9.8339 (1.42) 0.0000 (1.0) 0;0 0.1017 (0.70) 1 1 test_sharing_azure-pull[3.10.0] 9.7584 (1.41) 9.7584 (1.41) 9.7584 (1.41) 0.0000 (1.0) 9.7584 (1.41) 0.0000 (1.0) 0;0 0.1025 (0.71) 1 1 test_sharing_azure-pull[3.10.0] 10.1203 (1.46) 10.1203 (1.46) 10.1203 (1.46) 0.0000 (1.0) 10.1203 (1.46) 0.0000 (1.0) 0;0 0.0988 (0.68) 1 1 test_sharing_azure-pull[3.20.0] 9.8849 (1.43) 9.8849 (1.43) 9.8849 (1.43) 0.0000 (1.0) 9.8849 (1.43) 0.0000 (1.0) 0;0 0.1012 (0.70) 1 1 test_sharing_azure-pull[3.20.0] 9.9133 (1.43) 9.9133 (1.43) 9.9133 (1.43) 0.0000 (1.0) 9.9133 (1.43) 0.0000 (1.0) 0;0 0.1009 (0.70) 1 1 test_sharing_azure-pull[main] 13.6729 (1.98) 13.6729 (1.98) 13.6729 (1.98) 0.0000 (1.0) 13.6729 (1.98) 0.0000 (1.0) 0;0 0.0731 (0.51) 1 1 test_sharing_azure-pull[main] 14.6185 (2.11) 14.6185 (2.11) 14.6185 (2.11) 0.0000 (1.0) 14.6185 (2.11) 0.0000 (1.0) 0;0 0.0684 (0.47) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests ------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-pull-noop[2.58.2] 931.0026 (1.02) 931.0026 (1.02) 931.0026 (1.02) 0.0000 (1.0) 931.0026 (1.02) 0.0000 (1.0) 0;0 1.0741 (0.98) 1 1 test_sharing_azure-pull-noop[2.58.2] 912.5030 (1.0) 912.5030 (1.0) 912.5030 (1.0) 0.0000 (1.0) 912.5030 (1.0) 0.0000 (1.0) 0;0 1.0959 (1.0) 1 1 test_sharing_azure-pull-noop[3.0.0] 1,050.8063 (1.15) 1,050.8063 (1.15) 1,050.8063 (1.15) 0.0000 (1.0) 1,050.8063 (1.15) 0.0000 (1.0) 0;0 0.9517 (0.87) 1 1 test_sharing_azure-pull-noop[3.0.0] 1,092.2012 (1.20) 1,092.2012 (1.20) 1,092.2012 (1.20) 0.0000 (1.0) 1,092.2012 (1.20) 0.0000 (1.0) 0;0 0.9156 (0.84) 1 1 test_sharing_azure-pull-noop[3.10.0] 1,067.1701 (1.17) 1,067.1701 (1.17) 1,067.1701 (1.17) 0.0000 (1.0) 1,067.1701 (1.17) 0.0000 (1.0) 0;0 0.9371 (0.86) 1 1 test_sharing_azure-pull-noop[3.10.0] 1,065.0189 (1.17) 1,065.0189 (1.17) 1,065.0189 (1.17) 0.0000 (1.0) 1,065.0189 (1.17) 0.0000 (1.0) 0;0 0.9390 (0.86) 1 1 test_sharing_azure-pull-noop[3.20.0] 1,072.0682 (1.17) 1,072.0682 (1.17) 1,072.0682 (1.17) 0.0000 (1.0) 1,072.0682 (1.17) 0.0000 (1.0) 0;0 0.9328 (0.85) 1 1 test_sharing_azure-pull-noop[3.20.0] 1,071.6342 (1.17) 1,071.6342 (1.17) 1,071.6342 (1.17) 0.0000 (1.0) 1,071.6342 (1.17) 0.0000 (1.0) 0;0 0.9332 (0.85) 1 1 test_sharing_azure-pull-noop[main] 975.5900 (1.07) 975.5900 (1.07) 975.5900 (1.07) 0.0000 (1.0) 975.5900 (1.07) 0.0000 (1.0) 0;0 1.0250 (0.94) 1 1 test_sharing_azure-pull-noop[main] 959.2616 (1.05) 959.2616 (1.05) 959.2616 (1.05) 0.0000 (1.0) 959.2616 (1.05) 0.0000 (1.0) 0;0 1.0425 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push[2.58.2] 4.3616 (2.04) 4.3616 (2.04) 4.3616 (2.04) 0.0000 (1.0) 4.3616 (2.04) 0.0000 (1.0) 0;0 0.2293 (0.49) 1 1 test_sharing_azure-push[2.58.2] 4.3250 (2.02) 4.3250 (2.02) 4.3250 (2.02) 0.0000 (1.0) 4.3250 (2.02) 0.0000 (1.0) 0;0 0.2312 (0.49) 1 1 test_sharing_azure-push[3.0.0] 2.2208 (1.04) 2.2208 (1.04) 2.2208 (1.04) 0.0000 (1.0) 2.2208 (1.04) 0.0000 (1.0) 0;0 0.4503 (0.96) 1 1 test_sharing_azure-push[3.0.0] 2.1378 (1.0) 2.1378 (1.0) 2.1378 (1.0) 0.0000 (1.0) 2.1378 (1.0) 0.0000 (1.0) 0;0 0.4678 (1.0) 1 1 test_sharing_azure-push[3.10.0] 2.1697 (1.01) 2.1697 (1.01) 2.1697 (1.01) 0.0000 (1.0) 2.1697 (1.01) 0.0000 (1.0) 0;0 0.4609 (0.99) 1 1 test_sharing_azure-push[3.10.0] 2.3197 (1.09) 2.3197 (1.09) 2.3197 (1.09) 0.0000 (1.0) 2.3197 (1.09) 0.0000 (1.0) 0;0 0.4311 (0.92) 1 1 test_sharing_azure-push[3.20.0] 4.2444 (1.99) 4.2444 (1.99) 4.2444 (1.99) 0.0000 (1.0) 4.2444 (1.99) 0.0000 (1.0) 0;0 0.2356 (0.50) 1 1 test_sharing_azure-push[3.20.0] 4.5114 (2.11) 4.5114 (2.11) 4.5114 (2.11) 0.0000 (1.0) 4.5114 (2.11) 0.0000 (1.0) 0;0 0.2217 (0.47) 1 1 test_sharing_azure-push[main] 5.1995 (2.43) 5.1995 (2.43) 5.1995 (2.43) 0.0000 (1.0) 5.1995 (2.43) 0.0000 (1.0) 0;0 0.1923 (0.41) 1 1 test_sharing_azure-push[main] 5.2343 (2.45) 5.2343 (2.45) 5.2343 (2.45) 0.0000 (1.0) 5.2343 (2.45) 0.0000 (1.0) 0;0 0.1910 (0.41) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests --------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_azure-push-noop[2.58.2] 704.3078 (1.06) 704.3078 (1.06) 704.3078 (1.06) 0.0000 (1.0) 704.3078 (1.06) 0.0000 (1.0) 0;0 1.4198 (0.94) 1 1 test_sharing_azure-push-noop[2.58.2] 675.6471 (1.02) 675.6471 (1.02) 675.6471 (1.02) 0.0000 (1.0) 675.6471 (1.02) 0.0000 (1.0) 0;0 1.4801 (0.98) 1 1 test_sharing_azure-push-noop[3.0.0] 668.5273 (1.01) 668.5273 (1.01) 668.5273 (1.01) 0.0000 (1.0) 668.5273 (1.01) 0.0000 (1.0) 0;0 1.4958 (0.99) 1 1 test_sharing_azure-push-noop[3.0.0] 726.1688 (1.09) 726.1688 (1.09) 726.1688 (1.09) 0.0000 (1.0) 726.1688 (1.09) 0.0000 (1.0) 0;0 1.3771 (0.91) 1 1 test_sharing_azure-push-noop[3.10.0] 695.7375 (1.05) 695.7375 (1.05) 695.7375 (1.05) 0.0000 (1.0) 695.7375 (1.05) 0.0000 (1.0) 0;0 1.4373 (0.95) 1 1 test_sharing_azure-push-noop[3.10.0] 690.7965 (1.04) 690.7965 (1.04) 690.7965 (1.04) 0.0000 (1.0) 690.7965 (1.04) 0.0000 (1.0) 0;0 1.4476 (0.96) 1 1 test_sharing_azure-push-noop[3.20.0] 663.7882 (1.0) 663.7882 (1.0) 663.7882 (1.0) 0.0000 (1.0) 663.7882 (1.0) 0.0000 (1.0) 0;0 1.5065 (1.0) 1 1 test_sharing_azure-push-noop[3.20.0] 678.1854 (1.02) 678.1854 (1.02) 678.1854 (1.02) 0.0000 (1.0) 678.1854 (1.02) 0.0000 (1.0) 0;0 1.4745 (0.98) 1 1 test_sharing_azure-push-noop[main] 767.9719 (1.16) 767.9719 (1.16) 767.9719 (1.16) 0.0000 (1.0) 767.9719 (1.16) 0.0000 (1.0) 0;0 1.3021 (0.86) 1 1 test_sharing_azure-push-noop[main] 794.2560 (1.20) 794.2560 (1.20) 794.2560 (1.20) 0.0000 (1.0) 794.2560 (1.20) 0.0000 (1.0) 0;0 1.2590 (0.84) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.58.2] 914.3964 (1.0) 914.3964 (1.0) 914.3964 (1.0) 0.0000 (1.0) 914.3964 (1.0) 0.0000 (1.0) 0;0 1.0936 (1.0) 1 1 test_data_status-data-changed[3.0.0] 925.6664 (1.01) 925.6664 (1.01) 925.6664 (1.01) 0.0000 (1.0) 925.6664 (1.01) 0.0000 (1.0) 0;0 1.0803 (0.99) 1 1 test_data_status-data-changed[3.10.0] 929.8719 (1.02) 929.8719 (1.02) 929.8719 (1.02) 0.0000 (1.0) 929.8719 (1.02) 0.0000 (1.0) 0;0 1.0754 (0.98) 1 1 test_data_status-data-changed[3.20.0] 939.9480 (1.03) 939.9480 (1.03) 939.9480 (1.03) 0.0000 (1.0) 939.9480 (1.03) 0.0000 (1.0) 0;0 1.0639 (0.97) 1 1 test_data_status-data-changed[main] 927.4080 (1.01) 927.4080 (1.01) 927.4080 (1.01) 0.0000 (1.0) 927.4080 (1.01) 0.0000 (1.0) 0;0 1.0783 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.58.2] 1.0002 (1.09) 1.0002 (1.09) 1.0002 (1.09) 0.0000 (1.0) 1.0002 (1.09) 0.0000 (1.0) 0;0 0.9998 (0.92) 1 1 test_data_status-data-changed-noop[3.0.0] 0.9547 (1.04) 0.9547 (1.04) 0.9547 (1.04) 0.0000 (1.0) 0.9547 (1.04) 0.0000 (1.0) 0;0 1.0474 (0.97) 1 1 test_data_status-data-changed-noop[3.10.0] 0.9559 (1.04) 0.9559 (1.04) 0.9559 (1.04) 0.0000 (1.0) 0.9559 (1.04) 0.0000 (1.0) 0;0 1.0462 (0.96) 1 1 test_data_status-data-changed-noop[3.20.0] 0.9783 (1.06) 0.9783 (1.06) 0.9783 (1.06) 0.0000 (1.0) 0.9783 (1.06) 0.0000 (1.0) 0;0 1.0222 (0.94) 1 1 test_data_status-data-changed-noop[main] 0.9215 (1.0) 0.9215 (1.0) 0.9215 (1.0) 0.0000 (1.0) 0.9215 (1.0) 0.0000 (1.0) 0;0 1.0852 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.58.2] 1.9849 (1.0) 1.9849 (1.0) 1.9849 (1.0) 0.0000 (1.0) 1.9849 (1.0) 0.0000 (1.0) 0;0 0.5038 (1.0) 1 1 test_data_status-data-new[3.0.0] 2.0316 (1.02) 2.0316 (1.02) 2.0316 (1.02) 0.0000 (1.0) 2.0316 (1.02) 0.0000 (1.0) 0;0 0.4922 (0.98) 1 1 test_data_status-data-new[3.10.0] 1.9874 (1.00) 1.9874 (1.00) 1.9874 (1.00) 0.0000 (1.0) 1.9874 (1.00) 0.0000 (1.0) 0;0 0.5032 (1.00) 1 1 test_data_status-data-new[3.20.0] 1.9977 (1.01) 1.9977 (1.01) 1.9977 (1.01) 0.0000 (1.0) 1.9977 (1.01) 0.0000 (1.0) 0;0 0.5006 (0.99) 1 1 test_data_status-data-new[main] 2.0633 (1.04) 2.0633 (1.04) 2.0633 (1.04) 0.0000 (1.0) 2.0633 (1.04) 0.0000 (1.0) 0;0 0.4847 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.58.2] 903.1115 (1.0) 903.1115 (1.0) 903.1115 (1.0) 0.0000 (1.0) 903.1115 (1.0) 0.0000 (1.0) 0;0 1.1073 (1.0) 1 1 test_data_status-data-noop[3.0.0] 949.3552 (1.05) 949.3552 (1.05) 949.3552 (1.05) 0.0000 (1.0) 949.3552 (1.05) 0.0000 (1.0) 0;0 1.0533 (0.95) 1 1 test_data_status-data-noop[3.10.0] 941.7674 (1.04) 941.7674 (1.04) 941.7674 (1.04) 0.0000 (1.0) 941.7674 (1.04) 0.0000 (1.0) 0;0 1.0618 (0.96) 1 1 test_data_status-data-noop[3.20.0] 923.0587 (1.02) 923.0587 (1.02) 923.0587 (1.02) 0.0000 (1.0) 923.0587 (1.02) 0.0000 (1.0) 0;0 1.0834 (0.98) 1 1 test_data_status-data-noop[main] 921.2477 (1.02) 921.2477 (1.02) 921.2477 (1.02) 0.0000 (1.0) 921.2477 (1.02) 0.0000 (1.0) 0;0 1.0855 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.58.2] 2.5292 (1.0) 2.5292 (1.0) 2.5292 (1.0) 0.0000 (1.0) 2.5292 (1.0) 0.0000 (1.0) 0;0 0.3954 (1.0) 1 1 test_checkout_copy-checkout[3.0.0] 4.6837 (1.85) 4.6837 (1.85) 4.6837 (1.85) 0.0000 (1.0) 4.6837 (1.85) 0.0000 (1.0) 0;0 0.2135 (0.54) 1 1 test_checkout_copy-checkout[3.10.0] 4.6807 (1.85) 4.6807 (1.85) 4.6807 (1.85) 0.0000 (1.0) 4.6807 (1.85) 0.0000 (1.0) 0;0 0.2136 (0.54) 1 1 test_checkout_copy-checkout[3.20.0] 4.6423 (1.84) 4.6423 (1.84) 4.6423 (1.84) 0.0000 (1.0) 4.6423 (1.84) 0.0000 (1.0) 0;0 0.2154 (0.54) 1 1 test_checkout_copy-checkout[main] 4.7231 (1.87) 4.7231 (1.87) 4.7231 (1.87) 0.0000 (1.0) 4.7231 (1.87) 0.0000 (1.0) 0;0 0.2117 (0.54) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.58.2] 793.0143 (1.0) 793.0143 (1.0) 793.0143 (1.0) 0.0000 (1.0) 793.0143 (1.0) 0.0000 (1.0) 0;0 1.2610 (1.0) 1 1 test_checkout_copy-checkout-noop[3.0.0] 802.6202 (1.01) 802.6202 (1.01) 802.6202 (1.01) 0.0000 (1.0) 802.6202 (1.01) 0.0000 (1.0) 0;0 1.2459 (0.99) 1 1 test_checkout_copy-checkout-noop[3.10.0] 801.4211 (1.01) 801.4211 (1.01) 801.4211 (1.01) 0.0000 (1.0) 801.4211 (1.01) 0.0000 (1.0) 0;0 1.2478 (0.99) 1 1 test_checkout_copy-checkout-noop[3.20.0] 812.8347 (1.02) 812.8347 (1.02) 812.8347 (1.02) 0.0000 (1.0) 812.8347 (1.02) 0.0000 (1.0) 0;0 1.2303 (0.98) 1 1 test_checkout_copy-checkout-noop[main] 796.6627 (1.00) 796.6627 (1.00) 796.6627 (1.00) 0.0000 (1.0) 796.6627 (1.00) 0.0000 (1.0) 0;0 1.2552 (1.00) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.58.2] 1.0523 (1.20) 1.0523 (1.20) 1.0523 (1.20) 0.0000 (1.0) 1.0523 (1.20) 0.0000 (1.0) 0;0 0.9503 (0.83) 1 1 test_checkout_copy-checkout-update[3.0.0] 0.8848 (1.01) 0.8848 (1.01) 0.8848 (1.01) 0.0000 (1.0) 0.8848 (1.01) 0.0000 (1.0) 0;0 1.1302 (0.99) 1 1 test_checkout_copy-checkout-update[3.10.0] 0.8837 (1.01) 0.8837 (1.01) 0.8837 (1.01) 0.0000 (1.0) 0.8837 (1.01) 0.0000 (1.0) 0;0 1.1316 (0.99) 1 1 test_checkout_copy-checkout-update[3.20.0] 0.9368 (1.07) 0.9368 (1.07) 0.9368 (1.07) 0.0000 (1.0) 0.9368 (1.07) 0.0000 (1.0) 0;0 1.0675 (0.94) 1 1 test_checkout_copy-checkout-update[main] 0.8760 (1.0) 0.8760 (1.0) 0.8760 (1.0) 0.0000 (1.0) 0.8760 (1.0) 0.0000 (1.0) 0;0 1.1416 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.58.2] 1.7168 (1.19) 1.7168 (1.19) 1.7168 (1.19) 0.0000 (1.0) 1.7168 (1.19) 0.0000 (1.0) 0;0 0.5825 (0.84) 1 1 test_checkout_hardlink-checkout[3.0.0] 1.4674 (1.02) 1.4674 (1.02) 1.4674 (1.02) 0.0000 (1.0) 1.4674 (1.02) 0.0000 (1.0) 0;0 0.6815 (0.98) 1 1 test_checkout_hardlink-checkout[3.10.0] 1.4657 (1.02) 1.4657 (1.02) 1.4657 (1.02) 0.0000 (1.0) 1.4657 (1.02) 0.0000 (1.0) 0;0 0.6823 (0.98) 1 1 test_checkout_hardlink-checkout[3.20.0] 1.4424 (1.00) 1.4424 (1.00) 1.4424 (1.00) 0.0000 (1.0) 1.4424 (1.00) 0.0000 (1.0) 0;0 0.6933 (1.00) 1 1 test_checkout_hardlink-checkout[main] 1.4395 (1.0) 1.4395 (1.0) 1.4395 (1.0) 0.0000 (1.0) 1.4395 (1.0) 0.0000 (1.0) 0;0 0.6947 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.58.2] 784.9310 (1.0) 784.9310 (1.0) 784.9310 (1.0) 0.0000 (1.0) 784.9310 (1.0) 0.0000 (1.0) 0;0 1.2740 (1.0) 1 1 test_checkout_hardlink-checkout-noop[3.0.0] 846.3255 (1.08) 846.3255 (1.08) 846.3255 (1.08) 0.0000 (1.0) 846.3255 (1.08) 0.0000 (1.0) 0;0 1.1816 (0.93) 1 1 test_checkout_hardlink-checkout-noop[3.10.0] 828.1338 (1.06) 828.1338 (1.06) 828.1338 (1.06) 0.0000 (1.0) 828.1338 (1.06) 0.0000 (1.0) 0;0 1.2075 (0.95) 1 1 test_checkout_hardlink-checkout-noop[3.20.0] 825.0359 (1.05) 825.0359 (1.05) 825.0359 (1.05) 0.0000 (1.0) 825.0359 (1.05) 0.0000 (1.0) 0;0 1.2121 (0.95) 1 1 test_checkout_hardlink-checkout-noop[main] 834.2861 (1.06) 834.2861 (1.06) 834.2861 (1.06) 0.0000 (1.0) 834.2861 (1.06) 0.0000 (1.0) 0;0 1.1986 (0.94) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.58.2] 1.0046 (1.12) 1.0046 (1.12) 1.0046 (1.12) 0.0000 (1.0) 1.0046 (1.12) 0.0000 (1.0) 0;0 0.9954 (0.90) 1 1 test_checkout_hardlink-checkout-update[3.0.0] 0.9575 (1.06) 0.9575 (1.06) 0.9575 (1.06) 0.0000 (1.0) 0.9575 (1.06) 0.0000 (1.0) 0;0 1.0444 (0.94) 1 1 test_checkout_hardlink-checkout-update[3.10.0] 0.9001 (1.0) 0.9001 (1.0) 0.9001 (1.0) 0.0000 (1.0) 0.9001 (1.0) 0.0000 (1.0) 0;0 1.1109 (1.0) 1 1 test_checkout_hardlink-checkout-update[3.20.0] 0.9181 (1.02) 0.9181 (1.02) 0.9181 (1.02) 0.0000 (1.0) 0.9181 (1.02) 0.0000 (1.0) 0;0 1.0892 (0.98) 1 1 test_checkout_hardlink-checkout-update[main] 0.9203 (1.02) 0.9203 (1.02) 0.9203 (1.02) 0.0000 (1.0) 0.9203 (1.02) 0.0000 (1.0) 0;0 1.0866 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.58.2] 719.2750 (1.0) 737.3023 (1.0) 729.2817 (1.0) 7.6741 (1.0) 727.8201 (1.0) 12.9270 (1.16) 2;0 1.3712 (1.0) 5 3 test_plots-plots-diff[3.0.0] 1,327.9162 (1.85) 1,352.3264 (1.83) 1,339.8738 (1.84) 10.4447 (1.36) 1,339.4689 (1.84) 18.5693 (1.67) 2;0 0.7463 (0.54) 5 3 test_plots-plots-diff[3.10.0] 1,320.3894 (1.84) 1,363.7655 (1.85) 1,344.9877 (1.84) 15.5926 (2.03) 1,346.3636 (1.85) 12.6987 (1.14) 2;1 0.7435 (0.54) 5 3 test_plots-plots-diff[3.20.0] 1,333.2724 (1.85) 1,362.2038 (1.85) 1,344.4667 (1.84) 11.2611 (1.47) 1,341.1442 (1.84) 14.8155 (1.33) 1;0 0.7438 (0.54) 5 3 test_plots-plots-diff[main] 1,344.1993 (1.87) 1,375.7167 (1.87) 1,352.6817 (1.85) 13.0720 (1.70) 1,348.6591 (1.85) 11.1184 (1.0) 1;1 0.7393 (0.54) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.58.2] 757.3915 (1.0) 772.6175 (1.0) 766.9612 (1.0) 5.9627 (1.0) 768.7630 (1.0) 7.6555 (1.0) 1;0 1.3038 (1.0) 5 3 test_plots-plots-diff-json[3.0.0] 1,786.8509 (2.36) 1,812.5012 (2.35) 1,800.1166 (2.35) 10.9878 (1.84) 1,800.7169 (2.34) 19.5395 (2.55) 2;0 0.5555 (0.43) 5 3 test_plots-plots-diff-json[3.10.0] 1,799.1802 (2.38) 1,832.7390 (2.37) 1,815.0010 (2.37) 12.5743 (2.11) 1,816.5947 (2.36) 16.5242 (2.16) 2;0 0.5510 (0.42) 5 3 test_plots-plots-diff-json[3.20.0] 1,796.9259 (2.37) 1,826.9817 (2.36) 1,811.6687 (2.36) 10.9087 (1.83) 1,809.6070 (2.35) 12.1125 (1.58) 2;0 0.5520 (0.42) 5 3 test_plots-plots-diff-json[main] 1,787.0649 (2.36) 1,848.3283 (2.39) 1,822.3957 (2.38) 24.5140 (4.11) 1,828.3483 (2.38) 37.6053 (4.91) 2;0 0.5487 (0.42) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show[2.58.2] 666.8197 (1.0) 679.5927 (1.0) 674.0667 (1.0) 4.9101 (1.0) 675.1001 (1.0) 6.8792 (1.0) 2;0 1.4835 (1.0) 5 3 test_plots-plots-show[3.0.0] 1,117.3414 (1.68) 1,141.4686 (1.68) 1,133.9579 (1.68) 9.5323 (1.94) 1,137.6583 (1.69) 7.7535 (1.13) 1;1 0.8819 (0.59) 5 3 test_plots-plots-show[3.10.0] 1,112.3518 (1.67) 1,152.8618 (1.70) 1,130.8880 (1.68) 15.6447 (3.19) 1,125.2672 (1.67) 21.6788 (3.15) 2;0 0.8843 (0.60) 5 3 test_plots-plots-show[3.20.0] 1,113.6236 (1.67) 1,145.4966 (1.69) 1,132.6909 (1.68) 12.7740 (2.60) 1,136.5461 (1.68) 18.9603 (2.76) 2;0 0.8829 (0.60) 5 3 test_plots-plots-show[main] 1,127.4324 (1.69) 1,140.5919 (1.68) 1,134.5840 (1.68) 6.3418 (1.29) 1,136.8367 (1.68) 12.0325 (1.75) 2;0 0.8814 (0.59) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.58.2] 696.2655 (1.0) 714.1608 (1.0) 706.7571 (1.0) 7.4591 (1.09) 709.3466 (1.0) 12.0360 (1.23) 1;0 1.4149 (1.0) 5 3 test_plots-plots-show-json[3.0.0] 1,353.8831 (1.94) 1,376.5015 (1.93) 1,365.8716 (1.93) 8.2961 (1.22) 1,365.2473 (1.92) 9.9269 (1.02) 2;0 0.7321 (0.52) 5 3 test_plots-plots-show-json[3.10.0] 1,360.0805 (1.95) 1,396.1758 (1.95) 1,385.4994 (1.96) 14.9701 (2.19) 1,391.4865 (1.96) 17.3843 (1.78) 1;0 0.7218 (0.51) 5 3 test_plots-plots-show-json[3.20.0] 1,361.4152 (1.96) 1,400.2968 (1.96) 1,388.7520 (1.96) 15.6379 (2.29) 1,393.4259 (1.96) 13.6804 (1.40) 1;1 0.7201 (0.51) 5 3 test_plots-plots-show-json[main] 1,379.5980 (1.98) 1,396.9806 (1.96) 1,388.9964 (1.97) 6.8221 (1.0) 1,387.2334 (1.96) 9.7472 (1.0) 2;0 0.7199 (0.51) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.58.2] 516.9680 (1.07) 516.9680 (1.07) 516.9680 (1.07) 0.0000 (1.0) 516.9680 (1.07) 0.0000 (1.0) 0;0 1.9344 (0.93) 1 1 test_list-list[3.0.0] 499.7789 (1.04) 499.7789 (1.04) 499.7789 (1.04) 0.0000 (1.0) 499.7789 (1.04) 0.0000 (1.0) 0;0 2.0009 (0.96) 1 1 test_list-list[3.10.0] 499.7823 (1.04) 499.7823 (1.04) 499.7823 (1.04) 0.0000 (1.0) 499.7823 (1.04) 0.0000 (1.0) 0;0 2.0009 (0.96) 1 1 test_list-list[3.20.0] 500.8228 (1.04) 500.8228 (1.04) 500.8228 (1.04) 0.0000 (1.0) 500.8228 (1.04) 0.0000 (1.0) 0;0 1.9967 (0.96) 1 1 test_list-list[main] 480.9140 (1.0) 480.9140 (1.0) 480.9140 (1.0) 0.0000 (1.0) 480.9140 (1.0) 0.0000 (1.0) 0;0 2.0794 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.58.2] 496.3819 (1.04) 496.3819 (1.04) 496.3819 (1.04) 0.0000 (1.0) 496.3819 (1.04) 0.0000 (1.0) 0;0 2.0146 (0.96) 1 1 test_list-list-dvc-only[3.0.0] 479.4358 (1.01) 479.4358 (1.01) 479.4358 (1.01) 0.0000 (1.0) 479.4358 (1.01) 0.0000 (1.0) 0;0 2.0858 (0.99) 1 1 test_list-list-dvc-only[3.10.0] 477.0298 (1.00) 477.0298 (1.00) 477.0298 (1.00) 0.0000 (1.0) 477.0298 (1.00) 0.0000 (1.0) 0;0 2.0963 (1.00) 1 1 test_list-list-dvc-only[3.20.0] 475.7683 (1.0) 475.7683 (1.0) 475.7683 (1.0) 0.0000 (1.0) 475.7683 (1.0) 0.0000 (1.0) 0;0 2.1019 (1.0) 1 1 test_list-list-dvc-only[main] 479.6075 (1.01) 479.6075 (1.01) 479.6075 (1.01) 0.0000 (1.0) 479.6075 (1.01) 0.0000 (1.0) 0;0 2.0850 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.58.2] 680.7382 (1.26) 680.7382 (1.26) 680.7382 (1.26) 0.0000 (1.0) 680.7382 (1.26) 0.0000 (1.0) 0;0 1.4690 (0.80) 1 1 test_list-list-recursive[3.0.0] 583.5667 (1.08) 583.5667 (1.08) 583.5667 (1.08) 0.0000 (1.0) 583.5667 (1.08) 0.0000 (1.0) 0;0 1.7136 (0.93) 1 1 test_list-list-recursive[3.10.0] 590.8207 (1.09) 590.8207 (1.09) 590.8207 (1.09) 0.0000 (1.0) 590.8207 (1.09) 0.0000 (1.0) 0;0 1.6926 (0.92) 1 1 test_list-list-recursive[3.20.0] 580.3808 (1.07) 580.3808 (1.07) 580.3808 (1.07) 0.0000 (1.0) 580.3808 (1.07) 0.0000 (1.0) 0;0 1.7230 (0.93) 1 1 test_list-list-recursive[main] 541.3963 (1.0) 541.3963 (1.0) 541.3963 (1.0) 0.0000 (1.0) 541.3963 (1.0) 0.0000 (1.0) 0;0 1.8471 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.58.2] 494.1877 (1.03) 494.1877 (1.03) 494.1877 (1.03) 0.0000 (1.0) 494.1877 (1.03) 0.0000 (1.0) 0;0 2.0235 (0.97) 1 1 test_list-list-shallow[3.0.0] 494.6828 (1.03) 494.6828 (1.03) 494.6828 (1.03) 0.0000 (1.0) 494.6828 (1.03) 0.0000 (1.0) 0;0 2.0215 (0.97) 1 1 test_list-list-shallow[3.10.0] 481.8171 (1.00) 481.8171 (1.00) 481.8171 (1.00) 0.0000 (1.0) 481.8171 (1.00) 0.0000 (1.0) 0;0 2.0755 (1.00) 1 1 test_list-list-shallow[3.20.0] 480.9242 (1.00) 480.9242 (1.00) 480.9242 (1.00) 0.0000 (1.0) 480.9242 (1.00) 0.0000 (1.0) 0;0 2.0793 (1.00) 1 1 test_list-list-shallow[main] 480.7828 (1.0) 480.7828 (1.0) 480.7828 (1.0) 0.0000 (1.0) 480.7828 (1.0) 0.0000 (1.0) 0;0 2.0799 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests ---------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_exp_show-exp[2.58.2] 974.2284 (1.0) 974.2284 (1.0) 974.2284 (1.0) 0.0000 (1.0) 974.2284 (1.0) 0.0000 (1.0) 0;0 1.0265 (1.0) 1 1 test_exp_show-exp[3.0.0] 14,195.6003 (14.57) 14,195.6003 (14.57) 14,195.6003 (14.57) 0.0000 (1.0) 14,195.6003 (14.57) 0.0000 (1.0) 0;0 0.0704 (0.07) 1 1 test_exp_show-exp[3.10.0] 15,238.2245 (15.64) 15,238.2245 (15.64) 15,238.2245 (15.64) 0.0000 (1.0) 15,238.2245 (15.64) 0.0000 (1.0) 0;0 0.0656 (0.06) 1 1 test_exp_show-exp[3.20.0] 11,514.5160 (11.82) 11,514.5160 (11.82) 11,514.5160 (11.82) 0.0000 (1.0) 11,514.5160 (11.82) 0.0000 (1.0) 0;0 0.0868 (0.08) 1 1 test_exp_show-exp[main] 12,671.4301 (13.01) 12,671.4301 (13.01) 12,671.4301 (13.01) 0.0000 (1.0) 12,671.4301 (13.01) 0.0000 (1.0) 0;0 0.0789 (0.08) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.58.2] 7.9874 (1.09) 7.9874 (1.09) 7.9874 (1.09) 0.0000 (1.0) 7.9874 (1.09) 0.0000 (1.0) 0;0 0.1252 (0.92) 1 1 test_import_url-import-url[3.0.0] 7.3381 (1.0) 7.3381 (1.0) 7.3381 (1.0) 0.0000 (1.0) 7.3381 (1.0) 0.0000 (1.0) 0;0 0.1363 (1.0) 1 1 test_import_url-import-url[3.10.0] 7.7582 (1.06) 7.7582 (1.06) 7.7582 (1.06) 0.0000 (1.0) 7.7582 (1.06) 0.0000 (1.0) 0;0 0.1289 (0.95) 1 1 test_import_url-import-url[3.20.0] 7.7783 (1.06) 7.7783 (1.06) 7.7783 (1.06) 0.0000 (1.0) 7.7783 (1.06) 0.0000 (1.0) 0;0 0.1286 (0.94) 1 1 test_import_url-import-url[main] 7.5061 (1.02) 7.5061 (1.02) 7.5061 (1.02) 0.0000 (1.0) 7.5061 (1.02) 0.0000 (1.0) 0;0 0.1332 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.58.2] 10.3141 (1.0) 10.3141 (1.0) 10.3141 (1.0) 0.0000 (1.0) 10.3141 (1.0) 0.0000 (1.0) 0;0 0.0970 (1.0) 1 1 test_import-import[3.0.0] 10.4332 (1.01) 10.4332 (1.01) 10.4332 (1.01) 0.0000 (1.0) 10.4332 (1.01) 0.0000 (1.0) 0;0 0.0958 (0.99) 1 1 test_import-import[3.10.0] 11.5608 (1.12) 11.5608 (1.12) 11.5608 (1.12) 0.0000 (1.0) 11.5608 (1.12) 0.0000 (1.0) 0;0 0.0865 (0.89) 1 1 test_import-import[3.20.0] 11.3575 (1.10) 11.3575 (1.10) 11.3575 (1.10) 0.0000 (1.0) 11.3575 (1.10) 0.0000 (1.0) 0;0 0.0880 (0.91) 1 1 test_import-import[main] 11.2775 (1.09) 11.2775 (1.09) 11.2775 (1.09) 0.0000 (1.0) 11.2775 (1.09) 0.0000 (1.0) 0;0 0.0887 (0.91) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-import-url': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-import-url[2.58.2] 8.3522 (1.00) 8.3522 (1.00) 8.3522 (1.00) 0.0000 (1.0) 8.3522 (1.00) 0.0000 (1.0) 0;0 0.1197 (1.00) 1 1 test_update-import-url[3.0.0] 8.3175 (1.0) 8.3175 (1.0) 8.3175 (1.0) 0.0000 (1.0) 8.3175 (1.0) 0.0000 (1.0) 0;0 0.1202 (1.0) 1 1 test_update-import-url[3.10.0] 8.4842 (1.02) 8.4842 (1.02) 8.4842 (1.02) 0.0000 (1.0) 8.4842 (1.02) 0.0000 (1.0) 0;0 0.1179 (0.98) 1 1 test_update-import-url[3.20.0] 8.3824 (1.01) 8.3824 (1.01) 8.3824 (1.01) 0.0000 (1.0) 8.3824 (1.01) 0.0000 (1.0) 0;0 0.1193 (0.99) 1 1 test_update-import-url[main] 8.4180 (1.01) 8.4180 (1.01) 8.4180 (1.01) 0.0000 (1.0) 8.4180 (1.01) 0.0000 (1.0) 0;0 0.1188 (0.99) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.58.2] 7.3182 (1.02) 7.3182 (1.02) 7.3182 (1.02) 0.0000 (1.0) 7.3182 (1.02) 0.0000 (1.0) 0;0 0.1366 (0.98) 1 1 test_update-update[3.0.0] 7.1711 (1.0) 7.1711 (1.0) 7.1711 (1.0) 0.0000 (1.0) 7.1711 (1.0) 0.0000 (1.0) 0;0 0.1394 (1.0) 1 1 test_update-update[3.10.0] 7.3241 (1.02) 7.3241 (1.02) 7.3241 (1.02) 0.0000 (1.0) 7.3241 (1.02) 0.0000 (1.0) 0;0 0.1365 (0.98) 1 1 test_update-update[3.20.0] 7.4317 (1.04) 7.4317 (1.04) 7.4317 (1.04) 0.0000 (1.0) 7.4317 (1.04) 0.0000 (1.0) 0;0 0.1346 (0.96) 1 1 test_update-update[main] 7.4454 (1.04) 7.4454 (1.04) 7.4454 (1.04) 0.0000 (1.0) 7.4454 (1.04) 0.0000 (1.0) 0;0 0.1343 (0.96) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update-noop[2.58.2] 1.1126 (1.0) 1.1126 (1.0) 1.1126 (1.0) 0.0000 (1.0) 1.1126 (1.0) 0.0000 (1.0) 0;0 0.8988 (1.0) 1 1 test_update-update-noop[3.0.0] 1.1244 (1.01) 1.1244 (1.01) 1.1244 (1.01) 0.0000 (1.0) 1.1244 (1.01) 0.0000 (1.0) 0;0 0.8894 (0.99) 1 1 test_update-update-noop[3.10.0] 1.1653 (1.05) 1.1653 (1.05) 1.1653 (1.05) 0.0000 (1.0) 1.1653 (1.05) 0.0000 (1.0) 0;0 0.8582 (0.95) 1 1 test_update-update-noop[3.20.0] 1.1664 (1.05) 1.1664 (1.05) 1.1664 (1.05) 0.0000 (1.0) 1.1664 (1.05) 0.0000 (1.0) 0;0 0.8573 (0.95) 1 1 test_update-update-noop[main] 1.1553 (1.04) 1.1553 (1.04) 1.1553 (1.04) 0.0000 (1.0) 1.1553 (1.04) 0.0000 (1.0) 0;0 0.8655 (0.96) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.58.2] 5.8155 (1.0) 5.8155 (1.0) 5.8155 (1.0) 0.0000 (1.0) 5.8155 (1.0) 0.0000 (1.0) 0;0 0.1720 (1.0) 1 1 test_sharing-add[3.0.0] 6.1737 (1.06) 6.1737 (1.06) 6.1737 (1.06) 0.0000 (1.0) 6.1737 (1.06) 0.0000 (1.0) 0;0 0.1620 (0.94) 1 1 test_sharing-add[3.10.0] 5.9871 (1.03) 5.9871 (1.03) 5.9871 (1.03) 0.0000 (1.0) 5.9871 (1.03) 0.0000 (1.0) 0;0 0.1670 (0.97) 1 1 test_sharing-add[3.20.0] 6.1065 (1.05) 6.1065 (1.05) 6.1065 (1.05) 0.0000 (1.0) 6.1065 (1.05) 0.0000 (1.0) 0;0 0.1638 (0.95) 1 1 test_sharing-add[main] 6.1176 (1.05) 6.1176 (1.05) 6.1176 (1.05) 0.0000 (1.0) 6.1176 (1.05) 0.0000 (1.0) 0;0 0.1635 (0.95) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.58.2] 3.9578 (1.0) 3.9578 (1.0) 3.9578 (1.0) 0.0000 (1.0) 3.9578 (1.0) 0.0000 (1.0) 0;0 0.2527 (1.0) 1 1 test_sharing-add-noop[3.0.0] 4.1690 (1.05) 4.1690 (1.05) 4.1690 (1.05) 0.0000 (1.0) 4.1690 (1.05) 0.0000 (1.0) 0;0 0.2399 (0.95) 1 1 test_sharing-add-noop[3.10.0] 3.9752 (1.00) 3.9752 (1.00) 3.9752 (1.00) 0.0000 (1.0) 3.9752 (1.00) 0.0000 (1.0) 0;0 0.2516 (1.00) 1 1 test_sharing-add-noop[3.20.0] 4.0483 (1.02) 4.0483 (1.02) 4.0483 (1.02) 0.0000 (1.0) 4.0483 (1.02) 0.0000 (1.0) 0;0 0.2470 (0.98) 1 1 test_sharing-add-noop[main] 4.0266 (1.02) 4.0266 (1.02) 4.0266 (1.02) 0.0000 (1.0) 4.0266 (1.02) 0.0000 (1.0) 0;0 0.2483 (0.98) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.58.2] 985.5277 (1.0) 985.5277 (1.0) 985.5277 (1.0) 0.0000 (1.0) 985.5277 (1.0) 0.0000 (1.0) 0;0 1.0147 (1.0) 1 1 test_sharing-checkout-noop[3.0.0] 1,068.0318 (1.08) 1,068.0318 (1.08) 1,068.0318 (1.08) 0.0000 (1.0) 1,068.0318 (1.08) 0.0000 (1.0) 0;0 0.9363 (0.92) 1 1 test_sharing-checkout-noop[3.10.0] 1,039.5398 (1.05) 1,039.5398 (1.05) 1,039.5398 (1.05) 0.0000 (1.0) 1,039.5398 (1.05) 0.0000 (1.0) 0;0 0.9620 (0.95) 1 1 test_sharing-checkout-noop[3.20.0] 1,050.4815 (1.07) 1,050.4815 (1.07) 1,050.4815 (1.07) 0.0000 (1.0) 1,050.4815 (1.07) 0.0000 (1.0) 0;0 0.9519 (0.94) 1 1 test_sharing-checkout-noop[main] 1,018.0992 (1.03) 1,018.0992 (1.03) 1,018.0992 (1.03) 0.0000 (1.0) 1,018.0992 (1.03) 0.0000 (1.0) 0;0 0.9822 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing-pull': 5 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[2.58.2] 7.8544 (1.0) 7.8544 (1.0) 7.8544 (1.0) 0.0000 (1.0) 7.8544 (1.0) 0.0000 (1.0) 0;0 0.1273 (1.0) 1 1 test_sharing-pull[3.0.0] 11.8269 (1.51) 11.8269 (1.51) 11.8269 (1.51) 0.0000 (1.0) 11.8269 (1.51) 0.0000 (1.0) 0;0 0.0846 (0.66) 1 1 test_sharing-pull[3.10.0] 11.5422 (1.47) 11.5422 (1.47) 11.5422 (1.47) 0.0000 (1.0) 11.5422 (1.47) 0.0000 (1.0) 0;0 0.0866 (0.68) 1 1 test_sharing-pull[3.20.0] 11.4712 (1.46) 11.4712 (1.46) 11.4712 (1.46) 0.0000 (1.0) 11.4712 (1.46) 0.0000 (1.0) 0;0 0.0872 (0.68) 1 1 test_sharing-pull[main] 15.5877 (1.98) 15.5877 (1.98) 15.5877 (1.98) 0.0000 (1.0) 15.5877 (1.98) 0.0000 (1.0) 0;0 0.0642 (0.50) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-pull-noop': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[2.58.2] 1.0549 (1.0) 1.0549 (1.0) 1.0549 (1.0) 0.0000 (1.0) 1.0549 (1.0) 0.0000 (1.0) 0;0 0.9480 (1.0) 1 1 test_sharing-pull-noop[3.0.0] 1.2537 (1.19) 1.2537 (1.19) 1.2537 (1.19) 0.0000 (1.0) 1.2537 (1.19) 0.0000 (1.0) 0;0 0.7976 (0.84) 1 1 test_sharing-pull-noop[3.10.0] 1.2601 (1.19) 1.2601 (1.19) 1.2601 (1.19) 0.0000 (1.0) 1.2601 (1.19) 0.0000 (1.0) 0;0 0.7936 (0.84) 1 1 test_sharing-pull-noop[3.20.0] 1.2607 (1.20) 1.2607 (1.20) 1.2607 (1.20) 0.0000 (1.0) 1.2607 (1.20) 0.0000 (1.0) 0;0 0.7932 (0.84) 1 1 test_sharing-pull-noop[main] 1.1874 (1.13) 1.1874 (1.13) 1.1874 (1.13) 0.0000 (1.0) 1.1874 (1.13) 0.0000 (1.0) 0;0 0.8422 (0.89) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.58.2] 5.1138 (1.98) 5.1138 (1.98) 5.1138 (1.98) 0.0000 (1.0) 5.1138 (1.98) 0.0000 (1.0) 0;0 0.1956 (0.50) 1 1 test_sharing-push[3.0.0] 2.8166 (1.09) 2.8166 (1.09) 2.8166 (1.09) 0.0000 (1.0) 2.8166 (1.09) 0.0000 (1.0) 0;0 0.3550 (0.91) 1 1 test_sharing-push[3.10.0] 2.5771 (1.0) 2.5771 (1.0) 2.5771 (1.0) 0.0000 (1.0) 2.5771 (1.0) 0.0000 (1.0) 0;0 0.3880 (1.0) 1 1 test_sharing-push[3.20.0] 5.0482 (1.96) 5.0482 (1.96) 5.0482 (1.96) 0.0000 (1.0) 5.0482 (1.96) 0.0000 (1.0) 0;0 0.1981 (0.51) 1 1 test_sharing-push[main] 5.7559 (2.23) 5.7559 (2.23) 5.7559 (2.23) 0.0000 (1.0) 5.7559 (2.23) 0.0000 (1.0) 0;0 0.1737 (0.45) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.58.2] 819.0717 (1.08) 819.0717 (1.08) 819.0717 (1.08) 0.0000 (1.0) 819.0717 (1.08) 0.0000 (1.0) 0;0 1.2209 (0.93) 1 1 test_sharing-push-noop[3.0.0] 798.9736 (1.05) 798.9736 (1.05) 798.9736 (1.05) 0.0000 (1.0) 798.9736 (1.05) 0.0000 (1.0) 0;0 1.2516 (0.95) 1 1 test_sharing-push-noop[3.10.0] 759.3990 (1.0) 759.3990 (1.0) 759.3990 (1.0) 0.0000 (1.0) 759.3990 (1.0) 0.0000 (1.0) 0;0 1.3168 (1.0) 1 1 test_sharing-push-noop[3.20.0] 761.2408 (1.00) 761.2408 (1.00) 761.2408 (1.00) 0.0000 (1.0) 761.2408 (1.00) 0.0000 (1.0) 0;0 1.3136 (1.00) 1 1 test_sharing-push-noop[main] 884.9815 (1.17) 884.9815 (1.17) 884.9815 (1.17) 0.0000 (1.0) 884.9815 (1.17) 0.0000 (1.0) 0;0 1.1300 (0.86) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_gs-add[2.58.2] 6.5280 (1.11) 6.5280 (1.11) 6.5280 (1.11) 0.0000 (1.0) 6.5280 (1.11) 0.0000 (1.0) 0;0 0.1532 (0.90) 1 1 test_sharing_gs-add[2.58.2] 5.9529 (1.01) 5.9529 (1.01) 5.9529 (1.01) 0.0000 (1.0) 5.9529 (1.01) 0.0000 (1.0) 0;0 0.1680 (0.99) 1 1 test_sharing_gs-add[3.0.0] 6.0232 (1.02) 6.0232 (1.02) 6.0232 (1.02) 0.0000 (1.0) 6.0232 (1.02) 0.0000 (1.0) 0;0 0.1660 (0.98) 1 1 test_sharing_gs-add[3.0.0] 5.8769 (1.0) 5.8769 (1.0) 5.8769 (1.0) 0.0000 (1.0) 5.8769 (1.0) 0.0000 (1.0) 0;0 0.1702 (1.0) 1 1 test_sharing_gs-add[3.10.0] 6.0508 (1.03) 6.0508 (1.03) 6.0508 (1.03) 0.0000 (1.0) 6.0508 (1.03) 0.0000 (1.0) 0;0 0.1653 (0.97) 1 1 test_sharing_gs-add[3.10.0] 6.0928 (1.04) 6.0928 (1.04) 6.0928 (1.04) 0.0000 (1.0) 6.0928 (1.04) 0.0000 (1.0) 0;0 0.1641 (0.96) 1 1 test_sharing_gs-add[3.20.0] 6.2119 (1.06) 6.2119 (1.06) 6.2119 (1.06) 0.0000 (1.0) 6.2119 (1.06) 0.0000 (1.0) 0;0 0.1610 (0.95) 1 1 test_sharing_gs-add[3.20.0] 5.9969 (1.02) 5.9969 (1.02) 5.9969 (1.02) 0.0000 (1.0) 5.9969 (1.02) 0.0000 (1.0) 0;0 0.1668 (0.98) 1 1 test_sharing_gs-add[main] 6.0450 (1.03) 6.0450 (1.03) 6.0450 (1.03) 0.0000 (1.0) 6.0450 (1.03) 0.0000 (1.0) 0;0 0.1654 (0.97) 1 1 test_sharing_gs-add[main] 6.0942 (1.04) 6.0942 (1.04) 6.0942 (1.04) 0.0000 (1.0) 6.0942 (1.04) 0.0000 (1.0) 0;0 0.1641 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-add-noop[2.58.2] 4.1326 (1.06) 4.1326 (1.06) 4.1326 (1.06) 0.0000 (1.0) 4.1326 (1.06) 0.0000 (1.0) 0;0 0.2420 (0.95) 1 1 test_sharing_gs-add-noop[2.58.2] 4.0585 (1.04) 4.0585 (1.04) 4.0585 (1.04) 0.0000 (1.0) 4.0585 (1.04) 0.0000 (1.0) 0;0 0.2464 (0.96) 1 1 test_sharing_gs-add-noop[3.0.0] 3.9883 (1.02) 3.9883 (1.02) 3.9883 (1.02) 0.0000 (1.0) 3.9883 (1.02) 0.0000 (1.0) 0;0 0.2507 (0.98) 1 1 test_sharing_gs-add-noop[3.0.0] 3.9147 (1.0) 3.9147 (1.0) 3.9147 (1.0) 0.0000 (1.0) 3.9147 (1.0) 0.0000 (1.0) 0;0 0.2554 (1.0) 1 1 test_sharing_gs-add-noop[3.10.0] 4.0469 (1.03) 4.0469 (1.03) 4.0469 (1.03) 0.0000 (1.0) 4.0469 (1.03) 0.0000 (1.0) 0;0 0.2471 (0.97) 1 1 test_sharing_gs-add-noop[3.10.0] 3.9330 (1.00) 3.9330 (1.00) 3.9330 (1.00) 0.0000 (1.0) 3.9330 (1.00) 0.0000 (1.0) 0;0 0.2543 (1.00) 1 1 test_sharing_gs-add-noop[3.20.0] 3.9231 (1.00) 3.9231 (1.00) 3.9231 (1.00) 0.0000 (1.0) 3.9231 (1.00) 0.0000 (1.0) 0;0 0.2549 (1.00) 1 1 test_sharing_gs-add-noop[3.20.0] 4.0284 (1.03) 4.0284 (1.03) 4.0284 (1.03) 0.0000 (1.0) 4.0284 (1.03) 0.0000 (1.0) 0;0 0.2482 (0.97) 1 1 test_sharing_gs-add-noop[main] 3.9854 (1.02) 3.9854 (1.02) 3.9854 (1.02) 0.0000 (1.0) 3.9854 (1.02) 0.0000 (1.0) 0;0 0.2509 (0.98) 1 1 test_sharing_gs-add-noop[main] 3.9214 (1.00) 3.9214 (1.00) 3.9214 (1.00) 0.0000 (1.0) 3.9214 (1.00) 0.0000 (1.0) 0;0 0.2550 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-checkout-noop[2.58.2] 970.9929 (1.0) 970.9929 (1.0) 970.9929 (1.0) 0.0000 (1.0) 970.9929 (1.0) 0.0000 (1.0) 0;0 1.0299 (1.0) 1 1 test_sharing_gs-checkout-noop[2.58.2] 1,007.2934 (1.04) 1,007.2934 (1.04) 1,007.2934 (1.04) 0.0000 (1.0) 1,007.2934 (1.04) 0.0000 (1.0) 0;0 0.9928 (0.96) 1 1 test_sharing_gs-checkout-noop[3.0.0] 1,027.1196 (1.06) 1,027.1196 (1.06) 1,027.1196 (1.06) 0.0000 (1.0) 1,027.1196 (1.06) 0.0000 (1.0) 0;0 0.9736 (0.95) 1 1 test_sharing_gs-checkout-noop[3.0.0] 1,008.9133 (1.04) 1,008.9133 (1.04) 1,008.9133 (1.04) 0.0000 (1.0) 1,008.9133 (1.04) 0.0000 (1.0) 0;0 0.9912 (0.96) 1 1 test_sharing_gs-checkout-noop[3.10.0] 1,030.0816 (1.06) 1,030.0816 (1.06) 1,030.0816 (1.06) 0.0000 (1.0) 1,030.0816 (1.06) 0.0000 (1.0) 0;0 0.9708 (0.94) 1 1 test_sharing_gs-checkout-noop[3.10.0] 1,005.6880 (1.04) 1,005.6880 (1.04) 1,005.6880 (1.04) 0.0000 (1.0) 1,005.6880 (1.04) 0.0000 (1.0) 0;0 0.9943 (0.97) 1 1 test_sharing_gs-checkout-noop[3.20.0] 1,042.2851 (1.07) 1,042.2851 (1.07) 1,042.2851 (1.07) 0.0000 (1.0) 1,042.2851 (1.07) 0.0000 (1.0) 0;0 0.9594 (0.93) 1 1 test_sharing_gs-checkout-noop[3.20.0] 1,015.0985 (1.05) 1,015.0985 (1.05) 1,015.0985 (1.05) 0.0000 (1.0) 1,015.0985 (1.05) 0.0000 (1.0) 0;0 0.9851 (0.96) 1 1 test_sharing_gs-checkout-noop[main] 986.0582 (1.02) 986.0582 (1.02) 986.0582 (1.02) 0.0000 (1.0) 986.0582 (1.02) 0.0000 (1.0) 0;0 1.0141 (0.98) 1 1 test_sharing_gs-checkout-noop[main] 1,001.2322 (1.03) 1,001.2322 (1.03) 1,001.2322 (1.03) 0.0000 (1.0) 1,001.2322 (1.03) 0.0000 (1.0) 0;0 0.9988 (0.97) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-pull[2.58.2] 7.9541 (1.0) 7.9541 (1.0) 7.9541 (1.0) 0.0000 (1.0) 7.9541 (1.0) 0.0000 (1.0) 0;0 0.1257 (1.0) 1 1 test_sharing_gs-pull[2.58.2] 8.1198 (1.02) 8.1198 (1.02) 8.1198 (1.02) 0.0000 (1.0) 8.1198 (1.02) 0.0000 (1.0) 0;0 0.1232 (0.98) 1 1 test_sharing_gs-pull[3.0.0] 11.5237 (1.45) 11.5237 (1.45) 11.5237 (1.45) 0.0000 (1.0) 11.5237 (1.45) 0.0000 (1.0) 0;0 0.0868 (0.69) 1 1 test_sharing_gs-pull[3.0.0] 11.7268 (1.47) 11.7268 (1.47) 11.7268 (1.47) 0.0000 (1.0) 11.7268 (1.47) 0.0000 (1.0) 0;0 0.0853 (0.68) 1 1 test_sharing_gs-pull[3.10.0] 11.6164 (1.46) 11.6164 (1.46) 11.6164 (1.46) 0.0000 (1.0) 11.6164 (1.46) 0.0000 (1.0) 0;0 0.0861 (0.68) 1 1 test_sharing_gs-pull[3.10.0] 11.5552 (1.45) 11.5552 (1.45) 11.5552 (1.45) 0.0000 (1.0) 11.5552 (1.45) 0.0000 (1.0) 0;0 0.0865 (0.69) 1 1 test_sharing_gs-pull[3.20.0] 11.3859 (1.43) 11.3859 (1.43) 11.3859 (1.43) 0.0000 (1.0) 11.3859 (1.43) 0.0000 (1.0) 0;0 0.0878 (0.70) 1 1 test_sharing_gs-pull[3.20.0] 11.5314 (1.45) 11.5314 (1.45) 11.5314 (1.45) 0.0000 (1.0) 11.5314 (1.45) 0.0000 (1.0) 0;0 0.0867 (0.69) 1 1 test_sharing_gs-pull[main] 15.3260 (1.93) 15.3260 (1.93) 15.3260 (1.93) 0.0000 (1.0) 15.3260 (1.93) 0.0000 (1.0) 0;0 0.0652 (0.52) 1 1 test_sharing_gs-pull[main] 15.6984 (1.97) 15.6984 (1.97) 15.6984 (1.97) 0.0000 (1.0) 15.6984 (1.97) 0.0000 (1.0) 0;0 0.0637 (0.51) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_gs-pull-noop[2.58.2] 1.0713 (1.04) 1.0713 (1.04) 1.0713 (1.04) 0.0000 (1.0) 1.0713 (1.04) 0.0000 (1.0) 0;0 0.9335 (0.96) 1 1 test_sharing_gs-pull-noop[2.58.2] 1.0316 (1.0) 1.0316 (1.0) 1.0316 (1.0) 0.0000 (1.0) 1.0316 (1.0) 0.0000 (1.0) 0;0 0.9693 (1.0) 1 1 test_sharing_gs-pull-noop[3.0.0] 1.1871 (1.15) 1.1871 (1.15) 1.1871 (1.15) 0.0000 (1.0) 1.1871 (1.15) 0.0000 (1.0) 0;0 0.8424 (0.87) 1 1 test_sharing_gs-pull-noop[3.0.0] 1.2135 (1.18) 1.2135 (1.18) 1.2135 (1.18) 0.0000 (1.0) 1.2135 (1.18) 0.0000 (1.0) 0;0 0.8240 (0.85) 1 1 test_sharing_gs-pull-noop[3.10.0] 1.1924 (1.16) 1.1924 (1.16) 1.1924 (1.16) 0.0000 (1.0) 1.1924 (1.16) 0.0000 (1.0) 0;0 0.8386 (0.87) 1 1 test_sharing_gs-pull-noop[3.10.0] 1.1929 (1.16) 1.1929 (1.16) 1.1929 (1.16) 0.0000 (1.0) 1.1929 (1.16) 0.0000 (1.0) 0;0 0.8383 (0.86) 1 1 test_sharing_gs-pull-noop[3.20.0] 1.2294 (1.19) 1.2294 (1.19) 1.2294 (1.19) 0.0000 (1.0) 1.2294 (1.19) 0.0000 (1.0) 0;0 0.8134 (0.84) 1 1 test_sharing_gs-pull-noop[3.20.0] 1.2070 (1.17) 1.2070 (1.17) 1.2070 (1.17) 0.0000 (1.0) 1.2070 (1.17) 0.0000 (1.0) 0;0 0.8285 (0.85) 1 1 test_sharing_gs-pull-noop[main] 1.1859 (1.15) 1.1859 (1.15) 1.1859 (1.15) 0.0000 (1.0) 1.1859 (1.15) 0.0000 (1.0) 0;0 0.8432 (0.87) 1 1 test_sharing_gs-pull-noop[main] 1.1581 (1.12) 1.1581 (1.12) 1.1581 (1.12) 0.0000 (1.0) 1.1581 (1.12) 0.0000 (1.0) 0;0 0.8635 (0.89) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-push[2.58.2] 5.0779 (2.03) 5.0779 (2.03) 5.0779 (2.03) 0.0000 (1.0) 5.0779 (2.03) 0.0000 (1.0) 0;0 0.1969 (0.49) 1 1 test_sharing_gs-push[2.58.2] 5.0981 (2.04) 5.0981 (2.04) 5.0981 (2.04) 0.0000 (1.0) 5.0981 (2.04) 0.0000 (1.0) 0;0 0.1962 (0.49) 1 1 test_sharing_gs-push[3.0.0] 2.5018 (1.0) 2.5018 (1.0) 2.5018 (1.0) 0.0000 (1.0) 2.5018 (1.0) 0.0000 (1.0) 0;0 0.3997 (1.0) 1 1 test_sharing_gs-push[3.0.0] 2.6027 (1.04) 2.6027 (1.04) 2.6027 (1.04) 0.0000 (1.0) 2.6027 (1.04) 0.0000 (1.0) 0;0 0.3842 (0.96) 1 1 test_sharing_gs-push[3.10.0] 2.6594 (1.06) 2.6594 (1.06) 2.6594 (1.06) 0.0000 (1.0) 2.6594 (1.06) 0.0000 (1.0) 0;0 0.3760 (0.94) 1 1 test_sharing_gs-push[3.10.0] 2.5505 (1.02) 2.5505 (1.02) 2.5505 (1.02) 0.0000 (1.0) 2.5505 (1.02) 0.0000 (1.0) 0;0 0.3921 (0.98) 1 1 test_sharing_gs-push[3.20.0] 4.9862 (1.99) 4.9862 (1.99) 4.9862 (1.99) 0.0000 (1.0) 4.9862 (1.99) 0.0000 (1.0) 0;0 0.2006 (0.50) 1 1 test_sharing_gs-push[3.20.0] 5.1157 (2.04) 5.1157 (2.04) 5.1157 (2.04) 0.0000 (1.0) 5.1157 (2.04) 0.0000 (1.0) 0;0 0.1955 (0.49) 1 1 test_sharing_gs-push[main] 5.8143 (2.32) 5.8143 (2.32) 5.8143 (2.32) 0.0000 (1.0) 5.8143 (2.32) 0.0000 (1.0) 0;0 0.1720 (0.43) 1 1 test_sharing_gs-push[main] 5.8757 (2.35) 5.8757 (2.35) 5.8757 (2.35) 0.0000 (1.0) 5.8757 (2.35) 0.0000 (1.0) 0;0 0.1702 (0.43) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_gs-push-noop[2.58.2] 753.7764 (1.00) 753.7764 (1.00) 753.7764 (1.00) 0.0000 (1.0) 753.7764 (1.00) 0.0000 (1.0) 0;0 1.3267 (1.00) 1 1 test_sharing_gs-push-noop[2.58.2] 751.8730 (1.0) 751.8730 (1.0) 751.8730 (1.0) 0.0000 (1.0) 751.8730 (1.0) 0.0000 (1.0) 0;0 1.3300 (1.0) 1 1 test_sharing_gs-push-noop[3.0.0] 758.9412 (1.01) 758.9412 (1.01) 758.9412 (1.01) 0.0000 (1.0) 758.9412 (1.01) 0.0000 (1.0) 0;0 1.3176 (0.99) 1 1 test_sharing_gs-push-noop[3.0.0] 754.6368 (1.00) 754.6368 (1.00) 754.6368 (1.00) 0.0000 (1.0) 754.6368 (1.00) 0.0000 (1.0) 0;0 1.3251 (1.00) 1 1 test_sharing_gs-push-noop[3.10.0] 763.1219 (1.01) 763.1219 (1.01) 763.1219 (1.01) 0.0000 (1.0) 763.1219 (1.01) 0.0000 (1.0) 0;0 1.3104 (0.99) 1 1 test_sharing_gs-push-noop[3.10.0] 756.6049 (1.01) 756.6049 (1.01) 756.6049 (1.01) 0.0000 (1.0) 756.6049 (1.01) 0.0000 (1.0) 0;0 1.3217 (0.99) 1 1 test_sharing_gs-push-noop[3.20.0] 764.6588 (1.02) 764.6588 (1.02) 764.6588 (1.02) 0.0000 (1.0) 764.6588 (1.02) 0.0000 (1.0) 0;0 1.3078 (0.98) 1 1 test_sharing_gs-push-noop[3.20.0] 774.5700 (1.03) 774.5700 (1.03) 774.5700 (1.03) 0.0000 (1.0) 774.5700 (1.03) 0.0000 (1.0) 0;0 1.2910 (0.97) 1 1 test_sharing_gs-push-noop[main] 834.7781 (1.11) 834.7781 (1.11) 834.7781 (1.11) 0.0000 (1.0) 834.7781 (1.11) 0.0000 (1.0) 0;0 1.1979 (0.90) 1 1 test_sharing_gs-push-noop[main] 853.1385 (1.13) 853.1385 (1.13) 853.1385 (1.13) 0.0000 (1.0) 853.1385 (1.13) 0.0000 (1.0) 0;0 1.1721 (0.88) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.58.2] 4.1625 (1.01) 4.1625 (1.01) 4.1625 (1.01) 0.0000 (1.0) 4.1625 (1.01) 0.0000 (1.0) 0;0 0.2402 (0.99) 1 1 test_sharing_s3-add[2.58.2] 4.1126 (1.0) 4.1126 (1.0) 4.1126 (1.0) 0.0000 (1.0) 4.1126 (1.0) 0.0000 (1.0) 0;0 0.2432 (1.0) 1 1 test_sharing_s3-add[3.0.0] 4.1537 (1.01) 4.1537 (1.01) 4.1537 (1.01) 0.0000 (1.0) 4.1537 (1.01) 0.0000 (1.0) 0;0 0.2408 (0.99) 1 1 test_sharing_s3-add[3.0.0] 4.1817 (1.02) 4.1817 (1.02) 4.1817 (1.02) 0.0000 (1.0) 4.1817 (1.02) 0.0000 (1.0) 0;0 0.2391 (0.98) 1 1 test_sharing_s3-add[3.10.0] 4.1437 (1.01) 4.1437 (1.01) 4.1437 (1.01) 0.0000 (1.0) 4.1437 (1.01) 0.0000 (1.0) 0;0 0.2413 (0.99) 1 1 test_sharing_s3-add[3.10.0] 4.1354 (1.01) 4.1354 (1.01) 4.1354 (1.01) 0.0000 (1.0) 4.1354 (1.01) 0.0000 (1.0) 0;0 0.2418 (0.99) 1 1 test_sharing_s3-add[3.20.0] 4.2794 (1.04) 4.2794 (1.04) 4.2794 (1.04) 0.0000 (1.0) 4.2794 (1.04) 0.0000 (1.0) 0;0 0.2337 (0.96) 1 1 test_sharing_s3-add[3.20.0] 4.1311 (1.00) 4.1311 (1.00) 4.1311 (1.00) 0.0000 (1.0) 4.1311 (1.00) 0.0000 (1.0) 0;0 0.2421 (1.00) 1 1 test_sharing_s3-add[main] 4.1418 (1.01) 4.1418 (1.01) 4.1418 (1.01) 0.0000 (1.0) 4.1418 (1.01) 0.0000 (1.0) 0;0 0.2414 (0.99) 1 1 test_sharing_s3-add[main] 4.1290 (1.00) 4.1290 (1.00) 4.1290 (1.00) 0.0000 (1.0) 4.1290 (1.00) 0.0000 (1.0) 0;0 0.2422 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.58.2] 2.7856 (1.02) 2.7856 (1.02) 2.7856 (1.02) 0.0000 (1.0) 2.7856 (1.02) 0.0000 (1.0) 0;0 0.3590 (0.98) 1 1 test_sharing_s3-add-noop[2.58.2] 2.7614 (1.01) 2.7614 (1.01) 2.7614 (1.01) 0.0000 (1.0) 2.7614 (1.01) 0.0000 (1.0) 0;0 0.3621 (0.99) 1 1 test_sharing_s3-add-noop[3.0.0] 2.7902 (1.02) 2.7902 (1.02) 2.7902 (1.02) 0.0000 (1.0) 2.7902 (1.02) 0.0000 (1.0) 0;0 0.3584 (0.98) 1 1 test_sharing_s3-add-noop[3.0.0] 2.7836 (1.01) 2.7836 (1.01) 2.7836 (1.01) 0.0000 (1.0) 2.7836 (1.01) 0.0000 (1.0) 0;0 0.3592 (0.99) 1 1 test_sharing_s3-add-noop[3.10.0] 2.7913 (1.02) 2.7913 (1.02) 2.7913 (1.02) 0.0000 (1.0) 2.7913 (1.02) 0.0000 (1.0) 0;0 0.3583 (0.98) 1 1 test_sharing_s3-add-noop[3.10.0] 2.8102 (1.02) 2.8102 (1.02) 2.8102 (1.02) 0.0000 (1.0) 2.8102 (1.02) 0.0000 (1.0) 0;0 0.3558 (0.98) 1 1 test_sharing_s3-add-noop[3.20.0] 2.7740 (1.01) 2.7740 (1.01) 2.7740 (1.01) 0.0000 (1.0) 2.7740 (1.01) 0.0000 (1.0) 0;0 0.3605 (0.99) 1 1 test_sharing_s3-add-noop[3.20.0] 2.7748 (1.01) 2.7748 (1.01) 2.7748 (1.01) 0.0000 (1.0) 2.7748 (1.01) 0.0000 (1.0) 0;0 0.3604 (0.99) 1 1 test_sharing_s3-add-noop[main] 2.7428 (1.0) 2.7428 (1.0) 2.7428 (1.0) 0.0000 (1.0) 2.7428 (1.0) 0.0000 (1.0) 0;0 0.3646 (1.0) 1 1 test_sharing_s3-add-noop[main] 2.7843 (1.02) 2.7843 (1.02) 2.7843 (1.02) 0.0000 (1.0) 2.7843 (1.02) 0.0000 (1.0) 0;0 0.3592 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.58.2] 663.3662 (1.0) 663.3662 (1.0) 663.3662 (1.0) 0.0000 (1.0) 663.3662 (1.0) 0.0000 (1.0) 0;0 1.5075 (1.0) 1 1 test_sharing_s3-checkout-noop[2.58.2] 674.7753 (1.02) 674.7753 (1.02) 674.7753 (1.02) 0.0000 (1.0) 674.7753 (1.02) 0.0000 (1.0) 0;0 1.4820 (0.98) 1 1 test_sharing_s3-checkout-noop[3.0.0] 864.2299 (1.30) 864.2299 (1.30) 864.2299 (1.30) 0.0000 (1.0) 864.2299 (1.30) 0.0000 (1.0) 0;0 1.1571 (0.77) 1 1 test_sharing_s3-checkout-noop[3.0.0] 891.8911 (1.34) 891.8911 (1.34) 891.8911 (1.34) 0.0000 (1.0) 891.8911 (1.34) 0.0000 (1.0) 0;0 1.1212 (0.74) 1 1 test_sharing_s3-checkout-noop[3.10.0] 874.4212 (1.32) 874.4212 (1.32) 874.4212 (1.32) 0.0000 (1.0) 874.4212 (1.32) 0.0000 (1.0) 0;0 1.1436 (0.76) 1 1 test_sharing_s3-checkout-noop[3.10.0] 872.9604 (1.32) 872.9604 (1.32) 872.9604 (1.32) 0.0000 (1.0) 872.9604 (1.32) 0.0000 (1.0) 0;0 1.1455 (0.76) 1 1 test_sharing_s3-checkout-noop[3.20.0] 685.2854 (1.03) 685.2854 (1.03) 685.2854 (1.03) 0.0000 (1.0) 685.2854 (1.03) 0.0000 (1.0) 0;0 1.4592 (0.97) 1 1 test_sharing_s3-checkout-noop[3.20.0] 697.7948 (1.05) 697.7948 (1.05) 697.7948 (1.05) 0.0000 (1.0) 697.7948 (1.05) 0.0000 (1.0) 0;0 1.4331 (0.95) 1 1 test_sharing_s3-checkout-noop[main] 679.4075 (1.02) 679.4075 (1.02) 679.4075 (1.02) 0.0000 (1.0) 679.4075 (1.02) 0.0000 (1.0) 0;0 1.4719 (0.98) 1 1 test_sharing_s3-checkout-noop[main] 680.3214 (1.03) 680.3214 (1.03) 680.3214 (1.03) 0.0000 (1.0) 680.3214 (1.03) 0.0000 (1.0) 0;0 1.4699 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.58.2] 10.7798 (1.02) 10.7798 (1.02) 10.7798 (1.02) 0.0000 (1.0) 10.7798 (1.02) 0.0000 (1.0) 0;0 0.0928 (0.98) 1 1 test_sharing_s3-pull[2.58.2] 10.5845 (1.0) 10.5845 (1.0) 10.5845 (1.0) 0.0000 (1.0) 10.5845 (1.0) 0.0000 (1.0) 0;0 0.0945 (1.0) 1 1 test_sharing_s3-pull[3.0.0] 12.4447 (1.18) 12.4447 (1.18) 12.4447 (1.18) 0.0000 (1.0) 12.4447 (1.18) 0.0000 (1.0) 0;0 0.0804 (0.85) 1 1 test_sharing_s3-pull[3.0.0] 13.0942 (1.24) 13.0942 (1.24) 13.0942 (1.24) 0.0000 (1.0) 13.0942 (1.24) 0.0000 (1.0) 0;0 0.0764 (0.81) 1 1 test_sharing_s3-pull[3.10.0] 12.2981 (1.16) 12.2981 (1.16) 12.2981 (1.16) 0.0000 (1.0) 12.2981 (1.16) 0.0000 (1.0) 0;0 0.0813 (0.86) 1 1 test_sharing_s3-pull[3.10.0] 12.7190 (1.20) 12.7190 (1.20) 12.7190 (1.20) 0.0000 (1.0) 12.7190 (1.20) 0.0000 (1.0) 0;0 0.0786 (0.83) 1 1 test_sharing_s3-pull[3.20.0] 12.3084 (1.16) 12.3084 (1.16) 12.3084 (1.16) 0.0000 (1.0) 12.3084 (1.16) 0.0000 (1.0) 0;0 0.0812 (0.86) 1 1 test_sharing_s3-pull[3.20.0] 12.4222 (1.17) 12.4222 (1.17) 12.4222 (1.17) 0.0000 (1.0) 12.4222 (1.17) 0.0000 (1.0) 0;0 0.0805 (0.85) 1 1 test_sharing_s3-pull[main] 15.1209 (1.43) 15.1209 (1.43) 15.1209 (1.43) 0.0000 (1.0) 15.1209 (1.43) 0.0000 (1.0) 0;0 0.0661 (0.70) 1 1 test_sharing_s3-pull[main] 15.4947 (1.46) 15.4947 (1.46) 15.4947 (1.46) 0.0000 (1.0) 15.4947 (1.46) 0.0000 (1.0) 0;0 0.0645 (0.68) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.58.2] 906.9071 (1.0) 906.9071 (1.0) 906.9071 (1.0) 0.0000 (1.0) 906.9071 (1.0) 0.0000 (1.0) 0;0 1.1026 (1.0) 1 1 test_sharing_s3-pull-noop[2.58.2] 1,115.6249 (1.23) 1,115.6249 (1.23) 1,115.6249 (1.23) 0.0000 (1.0) 1,115.6249 (1.23) 0.0000 (1.0) 0;0 0.8964 (0.81) 1 1 test_sharing_s3-pull-noop[3.0.0] 1,015.1112 (1.12) 1,015.1112 (1.12) 1,015.1112 (1.12) 0.0000 (1.0) 1,015.1112 (1.12) 0.0000 (1.0) 0;0 0.9851 (0.89) 1 1 test_sharing_s3-pull-noop[3.0.0] 1,036.5197 (1.14) 1,036.5197 (1.14) 1,036.5197 (1.14) 0.0000 (1.0) 1,036.5197 (1.14) 0.0000 (1.0) 0;0 0.9648 (0.87) 1 1 test_sharing_s3-pull-noop[3.10.0] 1,036.5119 (1.14) 1,036.5119 (1.14) 1,036.5119 (1.14) 0.0000 (1.0) 1,036.5119 (1.14) 0.0000 (1.0) 0;0 0.9648 (0.87) 1 1 test_sharing_s3-pull-noop[3.10.0] 1,016.7470 (1.12) 1,016.7470 (1.12) 1,016.7470 (1.12) 0.0000 (1.0) 1,016.7470 (1.12) 0.0000 (1.0) 0;0 0.9835 (0.89) 1 1 test_sharing_s3-pull-noop[3.20.0] 1,352.1789 (1.49) 1,352.1789 (1.49) 1,352.1789 (1.49) 0.0000 (1.0) 1,352.1789 (1.49) 0.0000 (1.0) 0;0 0.7395 (0.67) 1 1 test_sharing_s3-pull-noop[3.20.0] 1,380.9996 (1.52) 1,380.9996 (1.52) 1,380.9996 (1.52) 0.0000 (1.0) 1,380.9996 (1.52) 0.0000 (1.0) 0;0 0.7241 (0.66) 1 1 test_sharing_s3-pull-noop[main] 1,298.9956 (1.43) 1,298.9956 (1.43) 1,298.9956 (1.43) 0.0000 (1.0) 1,298.9956 (1.43) 0.0000 (1.0) 0;0 0.7698 (0.70) 1 1 test_sharing_s3-pull-noop[main] 1,324.6413 (1.46) 1,324.6413 (1.46) 1,324.6413 (1.46) 0.0000 (1.0) 1,324.6413 (1.46) 0.0000 (1.0) 0;0 0.7549 (0.68) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.58.2] 9.1429 (1.20) 9.1429 (1.20) 9.1429 (1.20) 0.0000 (1.0) 9.1429 (1.20) 0.0000 (1.0) 0;0 0.1094 (0.83) 1 1 test_sharing_s3-push[2.58.2] 8.8635 (1.16) 8.8635 (1.16) 8.8635 (1.16) 0.0000 (1.0) 8.8635 (1.16) 0.0000 (1.0) 0;0 0.1128 (0.86) 1 1 test_sharing_s3-push[3.0.0] 7.7870 (1.02) 7.7870 (1.02) 7.7870 (1.02) 0.0000 (1.0) 7.7870 (1.02) 0.0000 (1.0) 0;0 0.1284 (0.98) 1 1 test_sharing_s3-push[3.0.0] 7.7919 (1.02) 7.7919 (1.02) 7.7919 (1.02) 0.0000 (1.0) 7.7919 (1.02) 0.0000 (1.0) 0;0 0.1283 (0.98) 1 1 test_sharing_s3-push[3.10.0] 7.6189 (1.0) 7.6189 (1.0) 7.6189 (1.0) 0.0000 (1.0) 7.6189 (1.0) 0.0000 (1.0) 0;0 0.1313 (1.0) 1 1 test_sharing_s3-push[3.10.0] 7.7171 (1.01) 7.7171 (1.01) 7.7171 (1.01) 0.0000 (1.0) 7.7171 (1.01) 0.0000 (1.0) 0;0 0.1296 (0.99) 1 1 test_sharing_s3-push[3.20.0] 9.0951 (1.19) 9.0951 (1.19) 9.0951 (1.19) 0.0000 (1.0) 9.0951 (1.19) 0.0000 (1.0) 0;0 0.1099 (0.84) 1 1 test_sharing_s3-push[3.20.0] 9.1557 (1.20) 9.1557 (1.20) 9.1557 (1.20) 0.0000 (1.0) 9.1557 (1.20) 0.0000 (1.0) 0;0 0.1092 (0.83) 1 1 test_sharing_s3-push[main] 9.9097 (1.30) 9.9097 (1.30) 9.9097 (1.30) 0.0000 (1.0) 9.9097 (1.30) 0.0000 (1.0) 0;0 0.1009 (0.77) 1 1 test_sharing_s3-push[main] 10.1583 (1.33) 10.1583 (1.33) 10.1583 (1.33) 0.0000 (1.0) 10.1583 (1.33) 0.0000 (1.0) 0;0 0.0984 (0.75) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-push-noop[2.58.2] 1.0569 (1.02) 1.0569 (1.02) 1.0569 (1.02) 0.0000 (1.0) 1.0569 (1.02) 0.0000 (1.0) 0;0 0.9462 (0.98) 1 1 test_sharing_s3-push-noop[2.58.2] 1.0436 (1.00) 1.0436 (1.00) 1.0436 (1.00) 0.0000 (1.0) 1.0436 (1.00) 0.0000 (1.0) 0;0 0.9582 (1.00) 1 1 test_sharing_s3-push-noop[3.0.0] 1.0529 (1.01) 1.0529 (1.01) 1.0529 (1.01) 0.0000 (1.0) 1.0529 (1.01) 0.0000 (1.0) 0;0 0.9497 (0.99) 1 1 test_sharing_s3-push-noop[3.0.0] 1.0636 (1.02) 1.0636 (1.02) 1.0636 (1.02) 0.0000 (1.0) 1.0636 (1.02) 0.0000 (1.0) 0;0 0.9402 (0.98) 1 1 test_sharing_s3-push-noop[3.10.0] 1.0598 (1.02) 1.0598 (1.02) 1.0598 (1.02) 0.0000 (1.0) 1.0598 (1.02) 0.0000 (1.0) 0;0 0.9436 (0.98) 1 1 test_sharing_s3-push-noop[3.10.0] 1.0494 (1.01) 1.0494 (1.01) 1.0494 (1.01) 0.0000 (1.0) 1.0494 (1.01) 0.0000 (1.0) 0;0 0.9529 (0.99) 1 1 test_sharing_s3-push-noop[3.20.0] 1.0409 (1.0) 1.0409 (1.0) 1.0409 (1.0) 0.0000 (1.0) 1.0409 (1.0) 0.0000 (1.0) 0;0 0.9607 (1.0) 1 1 test_sharing_s3-push-noop[3.20.0] 1.0548 (1.01) 1.0548 (1.01) 1.0548 (1.01) 0.0000 (1.0) 1.0548 (1.01) 0.0000 (1.0) 0;0 0.9480 (0.99) 1 1 test_sharing_s3-push-noop[main] 1.4358 (1.38) 1.4358 (1.38) 1.4358 (1.38) 0.0000 (1.0) 1.4358 (1.38) 0.0000 (1.0) 0;0 0.6965 (0.72) 1 1 test_sharing_s3-push-noop[main] 1.4581 (1.40) 1.4581 (1.40) 1.4581 (1.40) 0.0000 (1.0) 1.4581 (1.40) 0.0000 (1.0) 0;0 0.6858 (0.71) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.58.2] 3.1120 (1.0) 3.1120 (1.0) 3.1120 (1.0) 0.0000 (1.0) 3.1120 (1.0) 0.0000 (1.0) 0;0 0.3213 (1.0) 1 1 test_get_url-get-url[3.0.0] 3.1300 (1.01) 3.1300 (1.01) 3.1300 (1.01) 0.0000 (1.0) 3.1300 (1.01) 0.0000 (1.0) 0;0 0.3195 (0.99) 1 1 test_get_url-get-url[3.10.0] 3.2432 (1.04) 3.2432 (1.04) 3.2432 (1.04) 0.0000 (1.0) 3.2432 (1.04) 0.0000 (1.0) 0;0 0.3083 (0.96) 1 1 test_get_url-get-url[3.20.0] 3.2375 (1.04) 3.2375 (1.04) 3.2375 (1.04) 0.0000 (1.0) 3.2375 (1.04) 0.0000 (1.0) 0;0 0.3089 (0.96) 1 1 test_get_url-get-url[main] 3.2308 (1.04) 3.2308 (1.04) 3.2308 (1.04) 0.0000 (1.0) 3.2308 (1.04) 0.0000 (1.0) 0;0 0.3095 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.58.2] 3.7481 (1.98) 3.7481 (1.98) 3.7481 (1.98) 0.0000 (1.0) 3.7481 (1.98) 0.0000 (1.0) 0;0 0.2668 (0.50) 1 1 test_push-push[3.0.0] 1.9843 (1.05) 1.9843 (1.05) 1.9843 (1.05) 0.0000 (1.0) 1.9843 (1.05) 0.0000 (1.0) 0;0 0.5040 (0.95) 1 1 test_push-push[3.10.0] 1.8914 (1.0) 1.8914 (1.0) 1.8914 (1.0) 0.0000 (1.0) 1.8914 (1.0) 0.0000 (1.0) 0;0 0.5287 (1.0) 1 1 test_push-push[3.20.0] 3.6259 (1.92) 3.6259 (1.92) 3.6259 (1.92) 0.0000 (1.0) 3.6259 (1.92) 0.0000 (1.0) 0;0 0.2758 (0.52) 1 1 test_push-push[main] 4.1517 (2.19) 4.1517 (2.19) 4.1517 (2.19) 0.0000 (1.0) 4.1517 (2.19) 0.0000 (1.0) 0;0 0.2409 (0.46) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_pull-pull': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_pull-pull[2.58.2] 5.3333 (1.0) 5.3333 (1.0) 5.3333 (1.0) 0.0000 (1.0) 5.3333 (1.0) 0.0000 (1.0) 0;0 0.1875 (1.0) 1 1 test_pull-pull[3.0.0] 7.7846 (1.46) 7.7846 (1.46) 7.7846 (1.46) 0.0000 (1.0) 7.7846 (1.46) 0.0000 (1.0) 0;0 0.1285 (0.69) 1 1 test_pull-pull[3.10.0] 7.7119 (1.45) 7.7119 (1.45) 7.7119 (1.45) 0.0000 (1.0) 7.7119 (1.45) 0.0000 (1.0) 0;0 0.1297 (0.69) 1 1 test_pull-pull[3.20.0] 7.6331 (1.43) 7.6331 (1.43) 7.6331 (1.43) 0.0000 (1.0) 7.6331 (1.43) 0.0000 (1.0) 0;0 0.1310 (0.70) 1 1 test_pull-pull[main] 9.9362 (1.86) 9.9362 (1.86) 9.9362 (1.86) 0.0000 (1.0) 9.9362 (1.86) 0.0000 (1.0) 0;0 0.1006 (0.54) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.58.2] 157.1211 (1.05) 163.6318 (1.02) 159.3586 (1.04) 1.1955 (1.0) 159.1981 (1.04) 1.4756 (1.0) 32;2 6.2752 (0.97) 100 1 test_help---help[3.0.0] 152.3815 (1.01) 160.3429 (1.00) 155.9286 (1.01) 1.9658 (1.64) 155.5417 (1.01) 3.4941 (2.37) 40;0 6.4132 (0.99) 100 1 test_help---help[3.10.0] 153.9418 (1.02) 162.8889 (1.02) 156.4162 (1.02) 1.5977 (1.34) 156.2330 (1.02) 1.7066 (1.16) 24;5 6.3932 (0.98) 100 1 test_help---help[3.20.0] 150.2694 (1.0) 170.9239 (1.07) 153.8877 (1.0) 2.3318 (1.95) 153.7237 (1.0) 2.0515 (1.39) 19;2 6.4982 (1.0) 100 1 test_help---help[main] 151.2242 (1.01) 159.9811 (1.0) 154.3648 (1.00) 1.7265 (1.44) 154.2447 (1.00) 2.4566 (1.66) 30;2 6.4782 (1.00) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.58.2] 1.3286 (1.17) 1.3286 (1.17) 1.3286 (1.17) 0.0000 (1.0) 1.3286 (1.17) 0.0000 (1.0) 0;0 0.7527 (0.86) 1 1 test_checkout_symlink-checkout[3.0.0] 1.1569 (1.02) 1.1569 (1.02) 1.1569 (1.02) 0.0000 (1.0) 1.1569 (1.02) 0.0000 (1.0) 0;0 0.8644 (0.98) 1 1 test_checkout_symlink-checkout[3.10.0] 1.1761 (1.03) 1.1761 (1.03) 1.1761 (1.03) 0.0000 (1.0) 1.1761 (1.03) 0.0000 (1.0) 0;0 0.8503 (0.97) 1 1 test_checkout_symlink-checkout[3.20.0] 1.1546 (1.02) 1.1546 (1.02) 1.1546 (1.02) 0.0000 (1.0) 1.1546 (1.02) 0.0000 (1.0) 0;0 0.8661 (0.98) 1 1 test_checkout_symlink-checkout[main] 1.1372 (1.0) 1.1372 (1.0) 1.1372 (1.0) 0.0000 (1.0) 1.1372 (1.0) 0.0000 (1.0) 0;0 0.8794 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.58.2] 591.8785 (1.0) 591.8785 (1.0) 591.8785 (1.0) 0.0000 (1.0) 591.8785 (1.0) 0.0000 (1.0) 0;0 1.6895 (1.0) 1 1 test_checkout_symlink-checkout-noop[3.0.0] 600.4461 (1.01) 600.4461 (1.01) 600.4461 (1.01) 0.0000 (1.0) 600.4461 (1.01) 0.0000 (1.0) 0;0 1.6654 (0.99) 1 1 test_checkout_symlink-checkout-noop[3.10.0] 628.4155 (1.06) 628.4155 (1.06) 628.4155 (1.06) 0.0000 (1.0) 628.4155 (1.06) 0.0000 (1.0) 0;0 1.5913 (0.94) 1 1 test_checkout_symlink-checkout-noop[3.20.0] 609.7298 (1.03) 609.7298 (1.03) 609.7298 (1.03) 0.0000 (1.0) 609.7298 (1.03) 0.0000 (1.0) 0;0 1.6401 (0.97) 1 1 test_checkout_symlink-checkout-noop[main] 599.1015 (1.01) 599.1015 (1.01) 599.1015 (1.01) 0.0000 (1.0) 599.1015 (1.01) 0.0000 (1.0) 0;0 1.6692 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout-update[2.58.2] 781.3005 (1.14) 781.3005 (1.14) 781.3005 (1.14) 0.0000 (1.0) 781.3005 (1.14) 0.0000 (1.0) 0;0 1.2799 (0.88) 1 1 test_checkout_symlink-checkout-update[3.0.0] 689.4183 (1.00) 689.4183 (1.00) 689.4183 (1.00) 0.0000 (1.0) 689.4183 (1.00) 0.0000 (1.0) 0;0 1.4505 (1.00) 1 1 test_checkout_symlink-checkout-update[3.10.0] 705.4117 (1.03) 705.4117 (1.03) 705.4117 (1.03) 0.0000 (1.0) 705.4117 (1.03) 0.0000 (1.0) 0;0 1.4176 (0.97) 1 1 test_checkout_symlink-checkout-update[3.20.0] 688.4365 (1.00) 688.4365 (1.00) 688.4365 (1.00) 0.0000 (1.0) 688.4365 (1.00) 0.0000 (1.0) 0;0 1.4526 (1.00) 1 1 test_checkout_symlink-checkout-update[main] 686.2339 (1.0) 686.2339 (1.0) 686.2339 (1.0) 0.0000 (1.0) 686.2339 (1.0) 0.0000 (1.0) 0;0 1.4572 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.58.2] 551.0972 (1.01) 678.2024 (1.07) 588.1316 (1.01) 18.3052 (1.09) 587.9253 (1.01) 20.6629 (1.0) 22;2 1.7003 (0.99) 100 1 test_init-init[3.0.0] 545.9136 (1.0) 634.0044 (1.0) 582.2209 (1.0) 16.7942 (1.0) 581.0932 (1.0) 23.8816 (1.16) 30;1 1.7176 (1.0) 100 1 test_init-init[3.10.0] 565.1439 (1.04) 665.3184 (1.05) 603.4098 (1.04) 18.4393 (1.10) 603.8646 (1.04) 24.6762 (1.19) 27;2 1.6572 (0.96) 100 1 test_init-init[3.20.0] 552.4499 (1.01) 642.6932 (1.01) 596.0132 (1.02) 19.4196 (1.16) 593.2639 (1.02) 27.3803 (1.33) 32;0 1.6778 (0.98) 100 1 test_init-init[main] 575.3414 (1.05) 656.9277 (1.04) 608.1179 (1.04) 18.3397 (1.09) 605.0859 (1.04) 23.0931 (1.12) 30;1 1.6444 (0.96) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
10 months ago 
github-actions[bot]
commented
10 months ago