iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

build(deps): bump google-github-actions/auth from 2.1.2 to 2.1.3 #526

Closed dependabot[bot] closed 2 months ago

dependabot[bot] commented 2 months ago

Bumps google-github-actions/auth from 2.1.2 to 2.1.3.

Release notes

Sourced from google-github-actions/auth's releases.

v2.1.3

What's Changed

New Contributors

Full Changelog: https://github.com/google-github-actions/auth/compare/v2.1.2...v2.1.3

Commits


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
github-actions[bot] commented 2 months ago

Tue May 14 19:51:04 UTC 2024
dataset: small
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     3.5709 (1.05)     3.5709 (1.05)     3.5709 (1.05)     0.0000 (1.0)      3.5709 (1.05)     0.0000 (1.0)           0;0  0.2800 (0.95)          1           1
test_add-add[3.10.0]     3.5677 (1.05)     3.5677 (1.05)     3.5677 (1.05)     0.0000 (1.0)      3.5677 (1.05)     0.0000 (1.0)           0;0  0.2803 (0.95)          1           1
test_add-add[main]       3.3927 (1.0)      3.3927 (1.0)      3.3927 (1.0)      0.0000 (1.0)      3.3927 (1.0)      0.0000 (1.0)           0;0  0.2948 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     1.8973 (1.20)     1.8973 (1.20)     1.8973 (1.20)     0.0000 (1.0)      1.8973 (1.20)     0.0000 (1.0)           0;0  0.5271 (0.83)          1           1
test_checkout_copy-checkout[3.10.0]     3.8643 (2.45)     3.8643 (2.45)     3.8643 (2.45)     0.0000 (1.0)      3.8643 (2.45)     0.0000 (1.0)           0;0  0.2588 (0.41)          1           1
test_checkout_copy-checkout[main]       1.5749 (1.0)      1.5749 (1.0)      1.5749 (1.0)      0.0000 (1.0)      1.5749 (1.0)      0.0000 (1.0)           0;0  0.6350 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     553.3226 (1.0)      553.3226 (1.0)      553.3226 (1.0)      0.0000 (1.0)      553.3226 (1.0)      0.0000 (1.0)           0;0  1.8073 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     583.7951 (1.06)     583.7951 (1.06)     583.7951 (1.06)     0.0000 (1.0)      583.7951 (1.06)     0.0000 (1.0)           0;0  1.7129 (0.95)          1           1
test_checkout_copy-checkout-noop[main]       560.7592 (1.01)     560.7592 (1.01)     560.7592 (1.01)     0.0000 (1.0)      560.7592 (1.01)     0.0000 (1.0)           0;0  1.7833 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     697.5073 (1.15)     697.5073 (1.15)     697.5073 (1.15)     0.0000 (1.0)      697.5073 (1.15)     0.0000 (1.0)           0;0  1.4337 (0.87)          1           1
test_checkout_copy-checkout-update[3.10.0]     628.4535 (1.04)     628.4535 (1.04)     628.4535 (1.04)     0.0000 (1.0)      628.4535 (1.04)     0.0000 (1.0)           0;0  1.5912 (0.96)          1           1
test_checkout_copy-checkout-update[main]       605.2578 (1.0)      605.2578 (1.0)      605.2578 (1.0)      0.0000 (1.0)      605.2578 (1.0)      0.0000 (1.0)           0;0  1.6522 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     1.2343 (1.18)     1.2343 (1.18)     1.2343 (1.18)     0.0000 (1.0)      1.2343 (1.18)     0.0000 (1.0)           0;0  0.8101 (0.85)          1           1
test_checkout_hardlink-checkout[3.10.0]     1.1309 (1.08)     1.1309 (1.08)     1.1309 (1.08)     0.0000 (1.0)      1.1309 (1.08)     0.0000 (1.0)           0;0  0.8842 (0.92)          1           1
test_checkout_hardlink-checkout[main]       1.0459 (1.0)      1.0459 (1.0)      1.0459 (1.0)      0.0000 (1.0)      1.0459 (1.0)      0.0000 (1.0)           0;0  0.9561 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     549.1511 (1.00)     549.1511 (1.00)     549.1511 (1.00)     0.0000 (1.0)      549.1511 (1.00)     0.0000 (1.0)           0;0  1.8210 (1.00)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     598.6502 (1.09)     598.6502 (1.09)     598.6502 (1.09)     0.0000 (1.0)      598.6502 (1.09)     0.0000 (1.0)           0;0  1.6704 (0.92)          1           1
test_checkout_hardlink-checkout-noop[main]       548.6348 (1.0)      548.6348 (1.0)      548.6348 (1.0)      0.0000 (1.0)      548.6348 (1.0)      0.0000 (1.0)           0;0  1.8227 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     701.7440 (1.15)     701.7440 (1.15)     701.7440 (1.15)     0.0000 (1.0)      701.7440 (1.15)     0.0000 (1.0)           0;0  1.4250 (0.87)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     697.8727 (1.14)     697.8727 (1.14)     697.8727 (1.14)     0.0000 (1.0)      697.8727 (1.14)     0.0000 (1.0)           0;0  1.4329 (0.88)          1           1
test_checkout_hardlink-checkout-update[main]       612.2824 (1.0)      612.2824 (1.0)      612.2824 (1.0)      0.0000 (1.0)      612.2824 (1.0)      0.0000 (1.0)           0;0  1.6332 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     1.3912 (1.15)     1.3912 (1.15)     1.3912 (1.15)     0.0000 (1.0)      1.3912 (1.15)     0.0000 (1.0)           0;0  0.7188 (0.87)          1           1
test_checkout_symlink-checkout[3.10.0]     1.2254 (1.02)     1.2254 (1.02)     1.2254 (1.02)     0.0000 (1.0)      1.2254 (1.02)     0.0000 (1.0)           0;0  0.8161 (0.98)          1           1
test_checkout_symlink-checkout[main]       1.2069 (1.0)      1.2069 (1.0)      1.2069 (1.0)      0.0000 (1.0)      1.2069 (1.0)      0.0000 (1.0)           0;0  0.8286 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     611.6249 (1.0)      611.6249 (1.0)      611.6249 (1.0)      0.0000 (1.0)      611.6249 (1.0)      0.0000 (1.0)           0;0  1.6350 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     653.4137 (1.07)     653.4137 (1.07)     653.4137 (1.07)     0.0000 (1.0)      653.4137 (1.07)     0.0000 (1.0)           0;0  1.5304 (0.94)          1           1
test_checkout_symlink-checkout-noop[main]       629.4811 (1.03)     629.4811 (1.03)     629.4811 (1.03)     0.0000 (1.0)      629.4811 (1.03)     0.0000 (1.0)           0;0  1.5886 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     803.0827 (1.10)     803.0827 (1.10)     803.0827 (1.10)     0.0000 (1.0)      803.0827 (1.10)     0.0000 (1.0)           0;0  1.2452 (0.91)          1           1
test_checkout_symlink-checkout-update[3.10.0]     763.4579 (1.05)     763.4579 (1.05)     763.4579 (1.05)     0.0000 (1.0)      763.4579 (1.05)     0.0000 (1.0)           0;0  1.3098 (0.95)          1           1
test_checkout_symlink-checkout-update[main]       726.8594 (1.0)      726.8594 (1.0)      726.8594 (1.0)      0.0000 (1.0)      726.8594 (1.0)      0.0000 (1.0)           0;0  1.3758 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     574.6568 (1.03)     574.6568 (1.03)     574.6568 (1.03)     0.0000 (1.0)      574.6568 (1.03)     0.0000 (1.0)           0;0  1.7402 (0.97)          1           1
test_data_status-data-changed[3.10.0]     559.5608 (1.00)     559.5608 (1.00)     559.5608 (1.00)     0.0000 (1.0)      559.5608 (1.00)     0.0000 (1.0)           0;0  1.7871 (1.00)          1           1
test_data_status-data-changed[main]       558.5470 (1.0)      558.5470 (1.0)      558.5470 (1.0)      0.0000 (1.0)      558.5470 (1.0)      0.0000 (1.0)           0;0  1.7904 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     580.7597 (1.04)     580.7597 (1.04)     580.7597 (1.04)     0.0000 (1.0)      580.7597 (1.04)     0.0000 (1.0)           0;0  1.7219 (0.96)          1           1
test_data_status-data-changed-noop[3.10.0]     573.3709 (1.03)     573.3709 (1.03)     573.3709 (1.03)     0.0000 (1.0)      573.3709 (1.03)     0.0000 (1.0)           0;0  1.7441 (0.97)          1           1
test_data_status-data-changed-noop[main]       558.3366 (1.0)      558.3366 (1.0)      558.3366 (1.0)      0.0000 (1.0)      558.3366 (1.0)      0.0000 (1.0)           0;0  1.7910 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     1.2283 (1.03)     1.2283 (1.03)     1.2283 (1.03)     0.0000 (1.0)      1.2283 (1.03)     0.0000 (1.0)           0;0  0.8141 (0.98)          1           1
test_data_status-data-new[3.10.0]     1.2173 (1.02)     1.2173 (1.02)     1.2173 (1.02)     0.0000 (1.0)      1.2173 (1.02)     0.0000 (1.0)           0;0  0.8215 (0.98)          1           1
test_data_status-data-new[main]       1.1981 (1.0)      1.1981 (1.0)      1.1981 (1.0)      0.0000 (1.0)      1.1981 (1.0)      0.0000 (1.0)           0;0  0.8347 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     624.5196 (1.13)     624.5196 (1.13)     624.5196 (1.13)     0.0000 (1.0)      624.5196 (1.13)     0.0000 (1.0)           0;0  1.6012 (0.89)          1           1
test_data_status-data-noop[3.10.0]     566.0091 (1.02)     566.0091 (1.02)     566.0091 (1.02)     0.0000 (1.0)      566.0091 (1.02)     0.0000 (1.0)           0;0  1.7668 (0.98)          1           1
test_data_status-data-noop[main]       553.3641 (1.0)      553.3641 (1.0)      553.3641 (1.0)      0.0000 (1.0)      553.3641 (1.0)      0.0000 (1.0)           0;0  1.8071 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                          Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]       970.7049 (1.0)        970.7049 (1.0)        970.7049 (1.0)      0.0000 (1.0)        970.7049 (1.0)      0.0000 (1.0)           0;0  1.0302 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]     1,005.4901 (1.04)     1,005.4901 (1.04)     1,005.4901 (1.04)     0.0000 (1.0)      1,005.4901 (1.04)     0.0000 (1.0)           0;0  0.9945 (0.97)          1           1
test_data_status_all_flags-data-changed[main]         972.6009 (1.00)       972.6009 (1.00)       972.6009 (1.00)     0.0000 (1.0)        972.6009 (1.00)     0.0000 (1.0)           0;0  1.0282 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                               Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]       995.4652 (1.02)       995.4652 (1.02)       995.4652 (1.02)     0.0000 (1.0)        995.4652 (1.02)     0.0000 (1.0)           0;0  1.0046 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     1,009.6876 (1.03)     1,009.6876 (1.03)     1,009.6876 (1.03)     0.0000 (1.0)      1,009.6876 (1.03)     0.0000 (1.0)           0;0  0.9904 (0.97)          1           1
test_data_status_all_flags-data-changed-noop[main]         976.1139 (1.0)        976.1139 (1.0)        976.1139 (1.0)      0.0000 (1.0)        976.1139 (1.0)      0.0000 (1.0)           0;0  1.0245 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     1.6191 (1.0)      1.6191 (1.0)      1.6191 (1.0)      0.0000 (1.0)      1.6191 (1.0)      0.0000 (1.0)           0;0  0.6176 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     1.6559 (1.02)     1.6559 (1.02)     1.6559 (1.02)     0.0000 (1.0)      1.6559 (1.02)     0.0000 (1.0)           0;0  0.6039 (0.98)          1           1
test_data_status_all_flags-data-new[main]       1.6212 (1.00)     1.6212 (1.00)     1.6212 (1.00)     0.0000 (1.0)      1.6212 (1.00)     0.0000 (1.0)           0;0  0.6168 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     959.1498 (1.0)      959.1498 (1.0)      959.1498 (1.0)      0.0000 (1.0)      959.1498 (1.0)      0.0000 (1.0)           0;0  1.0426 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     971.9404 (1.01)     971.9404 (1.01)     971.9404 (1.01)     0.0000 (1.0)      971.9404 (1.01)     0.0000 (1.0)           0;0  1.0289 (0.99)          1           1
test_data_status_all_flags-data-noop[main]       960.8401 (1.00)     960.8401 (1.00)     960.8401 (1.00)     0.0000 (1.0)      960.8401 (1.00)     0.0000 (1.0)           0;0  1.0408 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     1.2323 (1.0)      1.2323 (1.0)      1.2323 (1.0)      0.0000 (1.0)      1.2323 (1.0)      0.0000 (1.0)           0;0  0.8115 (1.0)           1           1
test_diff-diff[3.10.0]     1.2798 (1.04)     1.2798 (1.04)     1.2798 (1.04)     0.0000 (1.0)      1.2798 (1.04)     0.0000 (1.0)           0;0  0.7814 (0.96)          1           1
test_diff-diff[main]       1.2919 (1.05)     1.2919 (1.05)     1.2919 (1.05)     0.0000 (1.0)      1.2919 (1.05)     0.0000 (1.0)           0;0  0.7741 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     656.5403 (1.06)     656.5403 (1.06)     656.5403 (1.06)     0.0000 (1.0)      656.5403 (1.06)     0.0000 (1.0)           0;0  1.5231 (0.95)          1           1
test_diff-diff-changed[3.10.0]     701.5136 (1.13)     701.5136 (1.13)     701.5136 (1.13)     0.0000 (1.0)      701.5136 (1.13)     0.0000 (1.0)           0;0  1.4255 (0.89)          1           1
test_diff-diff-changed[main]       621.6603 (1.0)      621.6603 (1.0)      621.6603 (1.0)      0.0000 (1.0)      621.6603 (1.0)      0.0000 (1.0)           0;0  1.6086 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     627.4114 (1.03)     627.4114 (1.03)     627.4114 (1.03)     0.0000 (1.0)      627.4114 (1.03)     0.0000 (1.0)           0;0  1.5939 (0.97)          1           1
test_diff-diff-changed-noop[3.10.0]     652.9288 (1.07)     652.9288 (1.07)     652.9288 (1.07)     0.0000 (1.0)      652.9288 (1.07)     0.0000 (1.0)           0;0  1.5316 (0.94)          1           1
test_diff-diff-changed-noop[main]       611.4623 (1.0)      611.4623 (1.0)      611.4623 (1.0)      0.0000 (1.0)      611.4623 (1.0)      0.0000 (1.0)           0;0  1.6354 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     602.7744 (1.0)      602.7744 (1.0)      602.7744 (1.0)      0.0000 (1.0)      602.7744 (1.0)      0.0000 (1.0)           0;0  1.6590 (1.0)           1           1
test_diff-diff-noop[3.10.0]     604.1074 (1.00)     604.1074 (1.00)     604.1074 (1.00)     0.0000 (1.0)      604.1074 (1.00)     0.0000 (1.0)           0;0  1.6553 (1.00)          1           1
test_diff-diff-noop[main]       614.7637 (1.02)     614.7637 (1.02)     614.7637 (1.02)     0.0000 (1.0)      614.7637 (1.02)     0.0000 (1.0)           0;0  1.6266 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       890.0268 (1.0)        890.0268 (1.0)        890.0268 (1.0)      0.0000 (1.0)        890.0268 (1.0)      0.0000 (1.0)           0;0  1.1236 (1.0)           1           1
test_exp_show-exp[3.10.0]     5,456.5318 (6.13)     5,456.5318 (6.13)     5,456.5318 (6.13)     0.0000 (1.0)      5,456.5318 (6.13)     0.0000 (1.0)           0;0  0.1833 (0.16)          1           1
test_exp_show-exp[main]       4,645.5563 (5.22)     4,645.5563 (5.22)     4,645.5563 (5.22)     0.0000 (1.0)      4,645.5563 (5.22)     0.0000 (1.0)           0;0  0.2153 (0.19)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     3.9206 (2.08)     3.9206 (2.08)     3.9206 (2.08)     0.0000 (1.0)      3.9206 (2.08)     0.0000 (1.0)           0;0  0.2551 (0.48)          1           1
test_fetch-fetch[3.10.0]     4.2974 (2.28)     4.2974 (2.28)     4.2974 (2.28)     0.0000 (1.0)      4.2974 (2.28)     0.0000 (1.0)           0;0  0.2327 (0.44)          1           1
test_fetch-fetch[main]       1.8879 (1.0)      1.8879 (1.0)      1.8879 (1.0)      0.0000 (1.0)      1.8879 (1.0)      0.0000 (1.0)           0;0  0.5297 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     497.2453 (1.05)     497.2453 (1.05)     497.2453 (1.05)     0.0000 (1.0)      497.2453 (1.05)     0.0000 (1.0)           0;0  2.0111 (0.96)          1           1
test_gc-gc[3.10.0]     500.1029 (1.05)     500.1029 (1.05)     500.1029 (1.05)     0.0000 (1.0)      500.1029 (1.05)     0.0000 (1.0)           0;0  1.9996 (0.95)          1           1
test_gc-gc[main]       475.5967 (1.0)      475.5967 (1.0)      475.5967 (1.0)      0.0000 (1.0)      475.5967 (1.0)      0.0000 (1.0)           0;0  2.1026 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     6.0557 (1.14)     6.0557 (1.14)     6.0557 (1.14)     0.0000 (1.0)      6.0557 (1.14)     0.0000 (1.0)           0;0  0.1651 (0.87)          1           1
test_get-get[3.10.0]     7.1084 (1.34)     7.1084 (1.34)     7.1084 (1.34)     0.0000 (1.0)      7.1084 (1.34)     0.0000 (1.0)           0;0  0.1407 (0.74)          1           1
test_get-get[main]       5.2894 (1.0)      5.2894 (1.0)      5.2894 (1.0)      0.0000 (1.0)      5.2894 (1.0)      0.0000 (1.0)           0;0  0.1891 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     3.1187 (3.33)     3.1187 (3.33)     3.1187 (3.33)     0.0000 (1.0)      3.1187 (3.33)     0.0000 (1.0)           0;0  0.3206 (0.30)          1           1
test_get_url-get-url[3.10.0]     3.2352 (3.46)     3.2352 (3.46)     3.2352 (3.46)     0.0000 (1.0)      3.2352 (3.46)     0.0000 (1.0)           0;0  0.3091 (0.29)          1           1
test_get_url-get-url[main]       0.9360 (1.0)      0.9360 (1.0)      0.9360 (1.0)      0.0000 (1.0)      0.9360 (1.0)      0.0000 (1.0)           0;0  1.0684 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     134.5066 (1.03)     141.3296 (1.01)     137.3508 (1.02)     1.5669 (1.01)     137.2373 (1.02)     1.9662 (1.03)         31;2  7.2806 (0.98)        100           1
test_help---help[3.10.0]     130.4282 (1.0)      139.5955 (1.0)      134.1765 (1.0)      1.5497 (1.0)      133.9262 (1.0)      1.9174 (1.0)          25;2  7.4529 (1.0)         100           1
test_help---help[main]       134.6355 (1.03)     151.6748 (1.09)     137.5508 (1.03)     2.3016 (1.49)     137.0861 (1.02)     2.1178 (1.10)         18;6  7.2700 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]      9.2535 (1.11)      9.2535 (1.11)      9.2535 (1.11)     0.0000 (1.0)       9.2535 (1.11)     0.0000 (1.0)           0;0  0.1081 (0.90)          1           1
test_import-import[3.10.0]     10.3005 (1.23)     10.3005 (1.23)     10.3005 (1.23)     0.0000 (1.0)      10.3005 (1.23)     0.0000 (1.0)           0;0  0.0971 (0.81)          1           1
test_import-import[main]        8.3651 (1.0)       8.3651 (1.0)       8.3651 (1.0)      0.0000 (1.0)       8.3651 (1.0)      0.0000 (1.0)           0;0  0.1195 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     7.4205 (1.46)     7.4205 (1.46)     7.4205 (1.46)     0.0000 (1.0)      7.4205 (1.46)     0.0000 (1.0)           0;0  0.1348 (0.68)          1           1
test_import_url-import-url[3.10.0]     7.6105 (1.50)     7.6105 (1.50)     7.6105 (1.50)     0.0000 (1.0)      7.6105 (1.50)     0.0000 (1.0)           0;0  0.1314 (0.67)          1           1
test_import_url-import-url[main]       5.0658 (1.0)      5.0658 (1.0)      5.0658 (1.0)      0.0000 (1.0)      5.0658 (1.0)      0.0000 (1.0)           0;0  0.1974 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     364.1497 (1.0)      420.0499 (1.02)     375.0110 (1.0)      8.0972 (1.15)     373.1518 (1.0)      8.1538 (1.31)         18;5  2.6666 (1.0)         100           1
test_init-init[3.10.0]     370.8482 (1.02)     411.7033 (1.0)      385.8999 (1.03)     8.0238 (1.14)     384.8949 (1.03)     9.7829 (1.57)         30;3  2.5913 (0.97)        100           1
test_init-init[main]       385.3875 (1.06)     434.0514 (1.05)     396.0244 (1.06)     7.0424 (1.0)      394.2989 (1.06)     6.2189 (1.0)          11;5  2.5251 (0.95)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     411.8624 (1.06)     411.8624 (1.06)     411.8624 (1.06)     0.0000 (1.0)      411.8624 (1.06)     0.0000 (1.0)           0;0  2.4280 (0.95)          1           1
test_list-list[3.10.0]     404.7880 (1.04)     404.7880 (1.04)     404.7880 (1.04)     0.0000 (1.0)      404.7880 (1.04)     0.0000 (1.0)           0;0  2.4704 (0.96)          1           1
test_list-list[main]       389.5187 (1.0)      389.5187 (1.0)      389.5187 (1.0)      0.0000 (1.0)      389.5187 (1.0)      0.0000 (1.0)           0;0  2.5673 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     396.4383 (1.04)     396.4383 (1.04)     396.4383 (1.04)     0.0000 (1.0)      396.4383 (1.04)     0.0000 (1.0)           0;0  2.5225 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     389.6563 (1.02)     389.6563 (1.02)     389.6563 (1.02)     0.0000 (1.0)      389.6563 (1.02)     0.0000 (1.0)           0;0  2.5664 (0.98)          1           1
test_list-list-dvc-only[main]       381.4098 (1.0)      381.4098 (1.0)      381.4098 (1.0)      0.0000 (1.0)      381.4098 (1.0)      0.0000 (1.0)           0;0  2.6219 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     485.9522 (1.04)     485.9522 (1.04)     485.9522 (1.04)     0.0000 (1.0)      485.9522 (1.04)     0.0000 (1.0)           0;0  2.0578 (0.96)          1           1
test_list-list-recursive[3.10.0]     475.2630 (1.02)     475.2630 (1.02)     475.2630 (1.02)     0.0000 (1.0)      475.2630 (1.02)     0.0000 (1.0)           0;0  2.1041 (0.98)          1           1
test_list-list-recursive[main]       465.2467 (1.0)      465.2467 (1.0)      465.2467 (1.0)      0.0000 (1.0)      465.2467 (1.0)      0.0000 (1.0)           0;0  2.1494 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     405.8220 (1.06)     405.8220 (1.06)     405.8220 (1.06)     0.0000 (1.0)      405.8220 (1.06)     0.0000 (1.0)           0;0  2.4641 (0.94)          1           1
test_list-list-shallow[3.10.0]     398.4127 (1.04)     398.4127 (1.04)     398.4127 (1.04)     0.0000 (1.0)      398.4127 (1.04)     0.0000 (1.0)           0;0  2.5100 (0.96)          1           1
test_list-list-shallow[main]       383.4130 (1.0)      383.4130 (1.0)      383.4130 (1.0)      0.0000 (1.0)      383.4130 (1.0)      0.0000 (1.0)           0;0  2.6082 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     2.0960 (1.03)     2.0960 (1.03)     2.0960 (1.03)     0.0000 (1.0)      2.0960 (1.03)     0.0000 (1.0)           0;0  0.4771 (0.97)          1           1
test_partial_add-add[3.10.0]     2.3860 (1.18)     2.3860 (1.18)     2.3860 (1.18)     0.0000 (1.0)      2.3860 (1.18)     0.0000 (1.0)           0;0  0.4191 (0.85)          1           1
test_partial_add-add[main]       2.0300 (1.0)      2.0300 (1.0)      2.0300 (1.0)      0.0000 (1.0)      2.0300 (1.0)      0.0000 (1.0)           0;0  0.4926 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     3.1729 (1.08)     3.1729 (1.08)     3.1729 (1.08)     0.0000 (1.0)      3.1729 (1.08)     0.0000 (1.0)           0;0  0.3152 (0.93)          1           1
test_partial_add-add-partial[3.10.0]     3.1521 (1.07)     3.1521 (1.07)     3.1521 (1.07)     0.0000 (1.0)      3.1521 (1.07)     0.0000 (1.0)           0;0  0.3173 (0.93)          1           1
test_partial_add-add-partial[main]       2.9449 (1.0)      2.9449 (1.0)      2.9449 (1.0)      0.0000 (1.0)      2.9449 (1.0)      0.0000 (1.0)           0;0  0.3396 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     621.0341 (1.0)      621.0341 (1.0)      621.0341 (1.0)      0.0000 (1.0)      621.0341 (1.0)      0.0000 (1.0)           0;0  1.6102 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     680.8077 (1.10)     680.8077 (1.10)     680.8077 (1.10)     0.0000 (1.0)      680.8077 (1.10)     0.0000 (1.0)           0;0  1.4688 (0.91)          1           1
test_partial_add-gc-cloud-noop[main]       712.2873 (1.15)     712.2873 (1.15)     712.2873 (1.15)     0.0000 (1.0)      712.2873 (1.15)     0.0000 (1.0)           0;0  1.4039 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     564.7357 (1.0)      564.7357 (1.0)      564.7357 (1.0)      0.0000 (1.0)      564.7357 (1.0)      0.0000 (1.0)           0;0  1.7707 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     588.7506 (1.04)     588.7506 (1.04)     588.7506 (1.04)     0.0000 (1.0)      588.7506 (1.04)     0.0000 (1.0)           0;0  1.6985 (0.96)          1           1
test_partial_add-gc-noop[main]       585.6936 (1.04)     585.6936 (1.04)     585.6936 (1.04)     0.0000 (1.0)      585.6936 (1.04)     0.0000 (1.0)           0;0  1.7074 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     1.9712 (1.80)     1.9712 (1.80)     1.9712 (1.80)     0.0000 (1.0)      1.9712 (1.80)     0.0000 (1.0)           0;0  0.5073 (0.56)          1           1
test_partial_add-push[3.10.0]     1.2138 (1.11)     1.2138 (1.11)     1.2138 (1.11)     0.0000 (1.0)      1.2138 (1.11)     0.0000 (1.0)           0;0  0.8239 (0.90)          1           1
test_partial_add-push[main]       1.0974 (1.0)      1.0974 (1.0)      1.0974 (1.0)      0.0000 (1.0)      1.0974 (1.0)      0.0000 (1.0)           0;0  0.9113 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     2.0544 (1.64)     2.0544 (1.64)     2.0544 (1.64)     0.0000 (1.0)      2.0544 (1.64)     0.0000 (1.0)           0;0  0.4868 (0.61)          1           1
test_partial_add-push-partial[3.10.0]     1.2734 (1.02)     1.2734 (1.02)     1.2734 (1.02)     0.0000 (1.0)      1.2734 (1.02)     0.0000 (1.0)           0;0  0.7853 (0.98)          1           1
test_partial_add-push-partial[main]       1.2510 (1.0)      1.2510 (1.0)      1.2510 (1.0)      0.0000 (1.0)      1.2510 (1.0)      0.0000 (1.0)           0;0  0.7994 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     3.5161 (1.05)     3.5161 (1.05)     3.5161 (1.05)     0.0000 (1.0)      3.5161 (1.05)     0.0000 (1.0)           0;0  0.2844 (0.95)          1           1
test_partial_remove-add[3.10.0]     3.5699 (1.07)     3.5699 (1.07)     3.5699 (1.07)     0.0000 (1.0)      3.5699 (1.07)     0.0000 (1.0)           0;0  0.2801 (0.93)          1           1
test_partial_remove-add[main]       3.3345 (1.0)      3.3345 (1.0)      3.3345 (1.0)      0.0000 (1.0)      3.3345 (1.0)      0.0000 (1.0)           0;0  0.2999 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     1.4707 (1.06)     1.4707 (1.06)     1.4707 (1.06)     0.0000 (1.0)      1.4707 (1.06)     0.0000 (1.0)           0;0  0.6800 (0.94)          1           1
test_partial_remove-add-update[3.10.0]     1.4774 (1.07)     1.4774 (1.07)     1.4774 (1.07)     0.0000 (1.0)      1.4774 (1.07)     0.0000 (1.0)           0;0  0.6769 (0.94)          1           1
test_partial_remove-add-update[main]       1.3870 (1.0)      1.3870 (1.0)      1.3870 (1.0)      0.0000 (1.0)      1.3870 (1.0)      0.0000 (1.0)           0;0  0.7210 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     482.4556 (1.0)      482.4556 (1.0)      482.4556 (1.0)      0.0000 (1.0)      482.4556 (1.0)      0.0000 (1.0)           0;0  2.0727 (1.0)           1           1
test_partial_remove-gc[3.10.0]     541.6526 (1.12)     541.6526 (1.12)     541.6526 (1.12)     0.0000 (1.0)      541.6526 (1.12)     0.0000 (1.0)           0;0  1.8462 (0.89)          1           1
test_partial_remove-gc[main]       522.7877 (1.08)     522.7877 (1.08)     522.7877 (1.08)     0.0000 (1.0)      522.7877 (1.08)     0.0000 (1.0)           0;0  1.9128 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     568.6906 (1.0)      568.6906 (1.0)      568.6906 (1.0)      0.0000 (1.0)      568.6906 (1.0)      0.0000 (1.0)           0;0  1.7584 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     611.6960 (1.08)     611.6960 (1.08)     611.6960 (1.08)     0.0000 (1.0)      611.6960 (1.08)     0.0000 (1.0)           0;0  1.6348 (0.93)          1           1
test_partial_remove-gc-cloud[main]       605.9159 (1.07)     605.9159 (1.07)     605.9159 (1.07)     0.0000 (1.0)      605.9159 (1.07)     0.0000 (1.0)           0;0  1.6504 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     3.3776 (2.29)     3.3776 (2.29)     3.3776 (2.29)     0.0000 (1.0)      3.3776 (2.29)     0.0000 (1.0)           0;0  0.2961 (0.44)          1           1
test_partial_remove-push[3.10.0]     1.8671 (1.27)     1.8671 (1.27)     1.8671 (1.27)     0.0000 (1.0)      1.8671 (1.27)     0.0000 (1.0)           0;0  0.5356 (0.79)          1           1
test_partial_remove-push[main]       1.4717 (1.0)      1.4717 (1.0)      1.4717 (1.0)      0.0000 (1.0)      1.4717 (1.0)      0.0000 (1.0)           0;0  0.6795 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     470.6373 (1.0)      470.6373 (1.0)      470.6373 (1.0)      0.0000 (1.0)      470.6373 (1.0)      0.0000 (1.0)           0;0  2.1248 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     473.1661 (1.01)     473.1661 (1.01)     473.1661 (1.01)     0.0000 (1.0)      473.1661 (1.01)     0.0000 (1.0)           0;0  2.1134 (0.99)          1           1
test_partial_remove-push-update[main]       831.8187 (1.77)     831.8187 (1.77)     831.8187 (1.77)     0.0000 (1.0)      831.8187 (1.77)     0.0000 (1.0)           0;0  1.2022 (0.57)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     416.1522 (1.0)      418.8816 (1.0)      417.7145 (1.0)      1.0584 (1.0)      417.6536 (1.0)      1.4837 (1.0)           2;0  2.3940 (1.0)           5           3
test_plots-plots-diff[3.10.0]     772.6132 (1.86)     778.0715 (1.86)     774.6473 (1.85)     2.1817 (2.06)     774.0267 (1.85)     3.0402 (2.05)          1;0  1.2909 (0.54)          5           3
test_plots-plots-diff[main]       729.0715 (1.75)     732.8831 (1.75)     730.7371 (1.75)     1.4032 (1.33)     730.6092 (1.75)     1.6381 (1.10)          2;0  1.3685 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       430.5337 (1.0)        444.6237 (1.0)        434.8513 (1.0)      5.9305 (2.85)       431.7809 (1.0)      7.5293 (3.11)          1;0  2.2996 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,018.6940 (2.37)     1,024.3208 (2.30)     1,021.1408 (2.35)     2.0828 (1.0)      1,020.5772 (2.36)     2.4245 (1.0)           2;0  0.9793 (0.43)          5           3
test_plots-plots-diff-json[main]         802.6944 (1.86)       809.4021 (1.82)       806.3101 (1.85)     2.4417 (1.17)       806.8547 (1.87)     2.6924 (1.11)          2;0  1.2402 (0.54)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     379.4994 (1.0)      390.8676 (1.0)      383.3752 (1.0)      4.8112 (2.45)     380.6858 (1.0)      6.7778 (2.05)          1;0  2.6084 (1.0)           5           3
test_plots-plots-show[3.10.0]     636.2792 (1.68)     640.9909 (1.64)     638.3915 (1.67)     1.9618 (1.0)      638.3997 (1.68)     3.3133 (1.0)           2;0  1.5664 (0.60)          5           3
test_plots-plots-show[main]       598.0868 (1.58)     615.2615 (1.57)     607.6342 (1.58)     6.3054 (3.21)     608.0035 (1.60)     7.3617 (2.22)          2;0  1.6457 (0.63)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     393.8365 (1.0)      400.2226 (1.0)      396.2956 (1.0)      2.5448 (1.08)     395.4815 (1.0)       3.5977 (1.0)           1;0  2.5234 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     785.1125 (1.99)     789.6953 (1.97)     787.6569 (1.99)     2.3478 (1.0)      788.7306 (1.99)      4.5174 (1.26)          2;0  1.2696 (0.50)          5           3
test_plots-plots-show-json[main]       646.5632 (1.64)     663.3902 (1.66)     657.8248 (1.66)     7.2188 (3.07)     661.4710 (1.67)     10.5038 (2.92)          1;0  1.5202 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     3.4698 (2.42)     3.4698 (2.42)     3.4698 (2.42)     0.0000 (1.0)      3.4698 (2.42)     0.0000 (1.0)           0;0  0.2882 (0.41)          1           1
test_push-push[3.10.0]     1.9129 (1.33)     1.9129 (1.33)     1.9129 (1.33)     0.0000 (1.0)      1.9129 (1.33)     0.0000 (1.0)           0;0  0.5228 (0.75)          1           1
test_push-push[main]       1.4368 (1.0)      1.4368 (1.0)      1.4368 (1.0)      0.0000 (1.0)      1.4368 (1.0)      0.0000 (1.0)           0;0  0.6960 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     3.5380 (1.05)     3.5380 (1.05)     3.5380 (1.05)     0.0000 (1.0)      3.5380 (1.05)     0.0000 (1.0)           0;0  0.2826 (0.95)          1           1
test_sharing-add[3.10.0]     3.5343 (1.05)     3.5343 (1.05)     3.5343 (1.05)     0.0000 (1.0)      3.5343 (1.05)     0.0000 (1.0)           0;0  0.2829 (0.95)          1           1
test_sharing-add[main]       3.3600 (1.0)      3.3600 (1.0)      3.3600 (1.0)      0.0000 (1.0)      3.3600 (1.0)      0.0000 (1.0)           0;0  0.2976 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     2.4143 (1.08)     2.4143 (1.08)     2.4143 (1.08)     0.0000 (1.0)      2.4143 (1.08)     0.0000 (1.0)           0;0  0.4142 (0.93)          1           1
test_sharing-add-noop[3.10.0]     2.3981 (1.07)     2.3981 (1.07)     2.3981 (1.07)     0.0000 (1.0)      2.3981 (1.07)     0.0000 (1.0)           0;0  0.4170 (0.93)          1           1
test_sharing-add-noop[main]       2.2361 (1.0)      2.2361 (1.0)      2.2361 (1.0)      0.0000 (1.0)      2.2361 (1.0)      0.0000 (1.0)           0;0  0.4472 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     1.7989 (1.33)     1.7989 (1.33)     1.7989 (1.33)     0.0000 (1.0)      1.7989 (1.33)     0.0000 (1.0)           0;0  0.5559 (0.75)          1           1
test_sharing-checkout[3.10.0]     3.6576 (2.70)     3.6576 (2.70)     3.6576 (2.70)     0.0000 (1.0)      3.6576 (2.70)     0.0000 (1.0)           0;0  0.2734 (0.37)          1           1
test_sharing-checkout[main]       1.3563 (1.0)      1.3563 (1.0)      1.3563 (1.0)      0.0000 (1.0)      1.3563 (1.0)      0.0000 (1.0)           0;0  0.7373 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     549.0301 (1.02)     549.0301 (1.02)     549.0301 (1.02)     0.0000 (1.0)      549.0301 (1.02)     0.0000 (1.0)           0;0  1.8214 (0.98)          1           1
test_sharing-checkout-noop[3.10.0]     566.7950 (1.05)     566.7950 (1.05)     566.7950 (1.05)     0.0000 (1.0)      566.7950 (1.05)     0.0000 (1.0)           0;0  1.7643 (0.95)          1           1
test_sharing-checkout-noop[main]       540.7347 (1.0)      540.7347 (1.0)      540.7347 (1.0)      0.0000 (1.0)      540.7347 (1.0)      0.0000 (1.0)           0;0  1.8493 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     3.8452 (2.10)     3.8452 (2.10)     3.8452 (2.10)     0.0000 (1.0)      3.8452 (2.10)     0.0000 (1.0)           0;0  0.2601 (0.48)          1           1
test_sharing-fetch[3.10.0]     4.2446 (2.32)     4.2446 (2.32)     4.2446 (2.32)     0.0000 (1.0)      4.2446 (2.32)     0.0000 (1.0)           0;0  0.2356 (0.43)          1           1
test_sharing-fetch[main]       1.8284 (1.0)      1.8284 (1.0)      1.8284 (1.0)      0.0000 (1.0)      1.8284 (1.0)      0.0000 (1.0)           0;0  0.5469 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     415.6924 (1.0)      415.6924 (1.0)      415.6924 (1.0)      0.0000 (1.0)      415.6924 (1.0)      0.0000 (1.0)           0;0  2.4056 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     489.1328 (1.18)     489.1328 (1.18)     489.1328 (1.18)     0.0000 (1.0)      489.1328 (1.18)     0.0000 (1.0)           0;0  2.0444 (0.85)          1           1
test_sharing-fetch-noop[main]       786.1231 (1.89)     786.1231 (1.89)     786.1231 (1.89)     0.0000 (1.0)      786.1231 (1.89)     0.0000 (1.0)           0;0  1.2721 (0.53)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     3.3939 (2.32)     3.3939 (2.32)     3.3939 (2.32)     0.0000 (1.0)      3.3939 (2.32)     0.0000 (1.0)           0;0  0.2946 (0.43)          1           1
test_sharing-push[3.10.0]     1.9246 (1.32)     1.9246 (1.32)     1.9246 (1.32)     0.0000 (1.0)      1.9246 (1.32)     0.0000 (1.0)           0;0  0.5196 (0.76)          1           1
test_sharing-push[main]       1.4629 (1.0)      1.4629 (1.0)      1.4629 (1.0)      0.0000 (1.0)      1.4629 (1.0)      0.0000 (1.0)           0;0  0.6836 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     432.8101 (1.0)      432.8101 (1.0)      432.8101 (1.0)      0.0000 (1.0)      432.8101 (1.0)      0.0000 (1.0)           0;0  2.3105 (1.0)           1           1
test_sharing-push-noop[3.10.0]     530.7420 (1.23)     530.7420 (1.23)     530.7420 (1.23)     0.0000 (1.0)      530.7420 (1.23)     0.0000 (1.0)           0;0  1.8842 (0.82)          1           1
test_sharing-push-noop[main]       825.8538 (1.91)     825.8538 (1.91)     825.8538 (1.91)     0.0000 (1.0)      825.8538 (1.91)     0.0000 (1.0)           0;0  1.2109 (0.52)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     1.2455 (1.05)     1.2455 (1.05)     1.2455 (1.05)     0.0000 (1.0)      1.2455 (1.05)     0.0000 (1.0)           0;0  0.8029 (0.95)          1           1
test_status-status[3.10.0]     1.2437 (1.05)     1.2437 (1.05)     1.2437 (1.05)     0.0000 (1.0)      1.2437 (1.05)     0.0000 (1.0)           0;0  0.8041 (0.95)          1           1
test_status-status[main]       1.1808 (1.0)      1.1808 (1.0)      1.1808 (1.0)      0.0000 (1.0)      1.1808 (1.0)      0.0000 (1.0)           0;0  0.8469 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     531.7242 (1.0)      531.7242 (1.0)      531.7242 (1.0)      0.0000 (1.0)      531.7242 (1.0)      0.0000 (1.0)           0;0  1.8807 (1.0)           1           1
test_status-status-changed[3.10.0]     573.2527 (1.08)     573.2527 (1.08)     573.2527 (1.08)     0.0000 (1.0)      573.2527 (1.08)     0.0000 (1.0)           0;0  1.7444 (0.93)          1           1
test_status-status-changed[main]       547.7288 (1.03)     547.7288 (1.03)     547.7288 (1.03)     0.0000 (1.0)      547.7288 (1.03)     0.0000 (1.0)           0;0  1.8257 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     552.0946 (1.02)     552.0946 (1.02)     552.0946 (1.02)     0.0000 (1.0)      552.0946 (1.02)     0.0000 (1.0)           0;0  1.8113 (0.98)          1           1
test_status-status-changed-noop[3.10.0]     571.6911 (1.06)     571.6911 (1.06)     571.6911 (1.06)     0.0000 (1.0)      571.6911 (1.06)     0.0000 (1.0)           0;0  1.7492 (0.94)          1           1
test_status-status-changed-noop[main]       538.6616 (1.0)      538.6616 (1.0)      538.6616 (1.0)      0.0000 (1.0)      538.6616 (1.0)      0.0000 (1.0)           0;0  1.8565 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     534.5687 (1.0)      534.5687 (1.0)      534.5687 (1.0)      0.0000 (1.0)      534.5687 (1.0)      0.0000 (1.0)           0;0  1.8707 (1.0)           1           1
test_status-status-noop[3.10.0]     562.0671 (1.05)     562.0671 (1.05)     562.0671 (1.05)     0.0000 (1.0)      562.0671 (1.05)     0.0000 (1.0)           0;0  1.7791 (0.95)          1           1
test_status-status-noop[main]       541.0745 (1.01)     541.0745 (1.01)     541.0745 (1.01)     0.0000 (1.0)      541.0745 (1.01)     0.0000 (1.0)           0;0  1.8482 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     7.4173 (1.47)     7.4173 (1.47)     7.4173 (1.47)     0.0000 (1.0)      7.4173 (1.47)     0.0000 (1.0)           0;0  0.1348 (0.68)          1           1
test_update-import-url[3.10.0]     7.5112 (1.49)     7.5112 (1.49)     7.5112 (1.49)     0.0000 (1.0)      7.5112 (1.49)     0.0000 (1.0)           0;0  0.1331 (0.67)          1           1
test_update-import-url[main]       5.0505 (1.0)      5.0505 (1.0)      5.0505 (1.0)      0.0000 (1.0)      5.0505 (1.0)      0.0000 (1.0)           0;0  0.1980 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     6.6123 (1.54)     6.6123 (1.54)     6.6123 (1.54)     0.0000 (1.0)      6.6123 (1.54)     0.0000 (1.0)           0;0  0.1512 (0.65)          1           1
test_update-update[3.10.0]     6.7499 (1.57)     6.7499 (1.57)     6.7499 (1.57)     0.0000 (1.0)      6.7499 (1.57)     0.0000 (1.0)           0;0  0.1482 (0.64)          1           1
test_update-update[main]       4.3027 (1.0)      4.3027 (1.0)      4.3027 (1.0)      0.0000 (1.0)      4.3027 (1.0)      0.0000 (1.0)           0;0  0.2324 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                          Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]       963.9979 (1.01)       963.9979 (1.01)       963.9979 (1.01)     0.0000 (1.0)        963.9979 (1.01)     0.0000 (1.0)           0;0  1.0373 (0.99)          1           1
test_update-update-noop[3.10.0]     1,000.7363 (1.05)     1,000.7363 (1.05)     1,000.7363 (1.05)     0.0000 (1.0)      1,000.7363 (1.05)     0.0000 (1.0)           0;0  0.9993 (0.95)          1           1
test_update-update-noop[main]         955.5772 (1.0)        955.5772 (1.0)        955.5772 (1.0)      0.0000 (1.0)        955.5772 (1.0)      0.0000 (1.0)           0;0  1.0465 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean