iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

build(deps): bump google-github-actions/auth from 2.1.3 to 2.1.4 #528

Closed dependabot[bot] closed 1 month ago

dependabot[bot] commented 1 month ago

Bumps google-github-actions/auth from 2.1.3 to 2.1.4.

Release notes

Sourced from google-github-actions/auth's releases.

v2.1.4

What's Changed

Full Changelog: https://github.com/google-github-actions/auth/compare/v2.1.3...v2.1.4

Commits


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
github-actions[bot] commented 1 month ago

Tue Aug  6 10:01:23 UTC 2024
dataset: small
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     3.5002 (1.02)     3.5002 (1.02)     3.5002 (1.02)     0.0000 (1.0)      3.5002 (1.02)     0.0000 (1.0)           0;0  0.2857 (0.98)          1           1
test_add-add[3.10.0]     3.6182 (1.06)     3.6182 (1.06)     3.6182 (1.06)     0.0000 (1.0)      3.6182 (1.06)     0.0000 (1.0)           0;0  0.2764 (0.94)          1           1
test_add-add[main]       3.4188 (1.0)      3.4188 (1.0)      3.4188 (1.0)      0.0000 (1.0)      3.4188 (1.0)      0.0000 (1.0)           0;0  0.2925 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     1.9021 (1.21)     1.9021 (1.21)     1.9021 (1.21)     0.0000 (1.0)      1.9021 (1.21)     0.0000 (1.0)           0;0  0.5257 (0.83)          1           1
test_checkout_copy-checkout[3.10.0]     3.9609 (2.51)     3.9609 (2.51)     3.9609 (2.51)     0.0000 (1.0)      3.9609 (2.51)     0.0000 (1.0)           0;0  0.2525 (0.40)          1           1
test_checkout_copy-checkout[main]       1.5751 (1.0)      1.5751 (1.0)      1.5751 (1.0)      0.0000 (1.0)      1.5751 (1.0)      0.0000 (1.0)           0;0  0.6349 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     569.5097 (1.0)      569.5097 (1.0)      569.5097 (1.0)      0.0000 (1.0)      569.5097 (1.0)      0.0000 (1.0)           0;0  1.7559 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     591.1526 (1.04)     591.1526 (1.04)     591.1526 (1.04)     0.0000 (1.0)      591.1526 (1.04)     0.0000 (1.0)           0;0  1.6916 (0.96)          1           1
test_checkout_copy-checkout-noop[main]       582.9776 (1.02)     582.9776 (1.02)     582.9776 (1.02)     0.0000 (1.0)      582.9776 (1.02)     0.0000 (1.0)           0;0  1.7153 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     711.3132 (1.13)     711.3132 (1.13)     711.3132 (1.13)     0.0000 (1.0)      711.3132 (1.13)     0.0000 (1.0)           0;0  1.4059 (0.89)          1           1
test_checkout_copy-checkout-update[3.10.0]     649.7134 (1.03)     649.7134 (1.03)     649.7134 (1.03)     0.0000 (1.0)      649.7134 (1.03)     0.0000 (1.0)           0;0  1.5391 (0.97)          1           1
test_checkout_copy-checkout-update[main]       632.0228 (1.0)      632.0228 (1.0)      632.0228 (1.0)      0.0000 (1.0)      632.0228 (1.0)      0.0000 (1.0)           0;0  1.5822 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     1.2249 (1.17)     1.2249 (1.17)     1.2249 (1.17)     0.0000 (1.0)      1.2249 (1.17)     0.0000 (1.0)           0;0  0.8164 (0.85)          1           1
test_checkout_hardlink-checkout[3.10.0]     1.0871 (1.04)     1.0871 (1.04)     1.0871 (1.04)     0.0000 (1.0)      1.0871 (1.04)     0.0000 (1.0)           0;0  0.9199 (0.96)          1           1
test_checkout_hardlink-checkout[main]       1.0442 (1.0)      1.0442 (1.0)      1.0442 (1.0)      0.0000 (1.0)      1.0442 (1.0)      0.0000 (1.0)           0;0  0.9577 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     570.8326 (1.01)     570.8326 (1.01)     570.8326 (1.01)     0.0000 (1.0)      570.8326 (1.01)     0.0000 (1.0)           0;0  1.7518 (0.99)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     577.8792 (1.03)     577.8792 (1.03)     577.8792 (1.03)     0.0000 (1.0)      577.8792 (1.03)     0.0000 (1.0)           0;0  1.7305 (0.97)          1           1
test_checkout_hardlink-checkout-noop[main]       563.0489 (1.0)      563.0489 (1.0)      563.0489 (1.0)      0.0000 (1.0)      563.0489 (1.0)      0.0000 (1.0)           0;0  1.7760 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     705.9672 (1.16)     705.9672 (1.16)     705.9672 (1.16)     0.0000 (1.0)      705.9672 (1.16)     0.0000 (1.0)           0;0  1.4165 (0.86)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     626.9468 (1.03)     626.9468 (1.03)     626.9468 (1.03)     0.0000 (1.0)      626.9468 (1.03)     0.0000 (1.0)           0;0  1.5950 (0.97)          1           1
test_checkout_hardlink-checkout-update[main]       607.2115 (1.0)      607.2115 (1.0)      607.2115 (1.0)      0.0000 (1.0)      607.2115 (1.0)      0.0000 (1.0)           0;0  1.6469 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     1.3435 (1.14)     1.3435 (1.14)     1.3435 (1.14)     0.0000 (1.0)      1.3435 (1.14)     0.0000 (1.0)           0;0  0.7443 (0.87)          1           1
test_checkout_symlink-checkout[3.10.0]     1.1964 (1.02)     1.1964 (1.02)     1.1964 (1.02)     0.0000 (1.0)      1.1964 (1.02)     0.0000 (1.0)           0;0  0.8359 (0.98)          1           1
test_checkout_symlink-checkout[main]       1.1742 (1.0)      1.1742 (1.0)      1.1742 (1.0)      0.0000 (1.0)      1.1742 (1.0)      0.0000 (1.0)           0;0  0.8516 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     626.1796 (1.03)     626.1796 (1.03)     626.1796 (1.03)     0.0000 (1.0)      626.1796 (1.03)     0.0000 (1.0)           0;0  1.5970 (0.97)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     635.5978 (1.04)     635.5978 (1.04)     635.5978 (1.04)     0.0000 (1.0)      635.5978 (1.04)     0.0000 (1.0)           0;0  1.5733 (0.96)          1           1
test_checkout_symlink-checkout-noop[main]       610.2656 (1.0)      610.2656 (1.0)      610.2656 (1.0)      0.0000 (1.0)      610.2656 (1.0)      0.0000 (1.0)           0;0  1.6386 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     798.8098 (1.12)     798.8098 (1.12)     798.8098 (1.12)     0.0000 (1.0)      798.8098 (1.12)     0.0000 (1.0)           0;0  1.2519 (0.89)          1           1
test_checkout_symlink-checkout-update[3.10.0]     722.6918 (1.02)     722.6918 (1.02)     722.6918 (1.02)     0.0000 (1.0)      722.6918 (1.02)     0.0000 (1.0)           0;0  1.3837 (0.98)          1           1
test_checkout_symlink-checkout-update[main]       710.1456 (1.0)      710.1456 (1.0)      710.1456 (1.0)      0.0000 (1.0)      710.1456 (1.0)      0.0000 (1.0)           0;0  1.4082 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     605.3627 (1.06)     605.3627 (1.06)     605.3627 (1.06)     0.0000 (1.0)      605.3627 (1.06)     0.0000 (1.0)           0;0  1.6519 (0.94)          1           1
test_data_status-data-changed[3.10.0]     570.8456 (1.0)      570.8456 (1.0)      570.8456 (1.0)      0.0000 (1.0)      570.8456 (1.0)      0.0000 (1.0)           0;0  1.7518 (1.0)           1           1
test_data_status-data-changed[main]       577.5083 (1.01)     577.5083 (1.01)     577.5083 (1.01)     0.0000 (1.0)      577.5083 (1.01)     0.0000 (1.0)           0;0  1.7316 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     598.1515 (1.05)     598.1515 (1.05)     598.1515 (1.05)     0.0000 (1.0)      598.1515 (1.05)     0.0000 (1.0)           0;0  1.6718 (0.95)          1           1
test_data_status-data-changed-noop[3.10.0]     582.3000 (1.03)     582.3000 (1.03)     582.3000 (1.03)     0.0000 (1.0)      582.3000 (1.03)     0.0000 (1.0)           0;0  1.7173 (0.97)          1           1
test_data_status-data-changed-noop[main]       567.6493 (1.0)      567.6493 (1.0)      567.6493 (1.0)      0.0000 (1.0)      567.6493 (1.0)      0.0000 (1.0)           0;0  1.7617 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     1.2624 (1.03)     1.2624 (1.03)     1.2624 (1.03)     0.0000 (1.0)      1.2624 (1.03)     0.0000 (1.0)           0;0  0.7922 (0.97)          1           1
test_data_status-data-new[3.10.0]     1.2473 (1.01)     1.2473 (1.01)     1.2473 (1.01)     0.0000 (1.0)      1.2473 (1.01)     0.0000 (1.0)           0;0  0.8017 (0.99)          1           1
test_data_status-data-new[main]       1.2292 (1.0)      1.2292 (1.0)      1.2292 (1.0)      0.0000 (1.0)      1.2292 (1.0)      0.0000 (1.0)           0;0  0.8135 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     619.4368 (1.07)     619.4368 (1.07)     619.4368 (1.07)     0.0000 (1.0)      619.4368 (1.07)     0.0000 (1.0)           0;0  1.6144 (0.93)          1           1
test_data_status-data-noop[3.10.0]     579.2716 (1.00)     579.2716 (1.00)     579.2716 (1.00)     0.0000 (1.0)      579.2716 (1.00)     0.0000 (1.0)           0;0  1.7263 (1.00)          1           1
test_data_status-data-noop[main]       576.9395 (1.0)      576.9395 (1.0)      576.9395 (1.0)      0.0000 (1.0)      576.9395 (1.0)      0.0000 (1.0)           0;0  1.7333 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     1.0559 (1.01)     1.0559 (1.01)     1.0559 (1.01)     0.0000 (1.0)      1.0559 (1.01)     0.0000 (1.0)           0;0  0.9470 (0.99)          1           1
test_data_status_all_flags-data-changed[3.10.0]     1.0493 (1.00)     1.0493 (1.00)     1.0493 (1.00)     0.0000 (1.0)      1.0493 (1.00)     0.0000 (1.0)           0;0  0.9530 (1.00)          1           1
test_data_status_all_flags-data-changed[main]       1.0471 (1.0)      1.0471 (1.0)      1.0471 (1.0)      0.0000 (1.0)      1.0471 (1.0)      0.0000 (1.0)           0;0  0.9550 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     1.0716 (1.02)     1.0716 (1.02)     1.0716 (1.02)     0.0000 (1.0)      1.0716 (1.02)     0.0000 (1.0)           0;0  0.9332 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     1.0602 (1.01)     1.0602 (1.01)     1.0602 (1.01)     0.0000 (1.0)      1.0602 (1.01)     0.0000 (1.0)           0;0  0.9432 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[main]       1.0516 (1.0)      1.0516 (1.0)      1.0516 (1.0)      0.0000 (1.0)      1.0516 (1.0)      0.0000 (1.0)           0;0  0.9509 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     1.6949 (1.0)      1.6949 (1.0)      1.6949 (1.0)      0.0000 (1.0)      1.6949 (1.0)      0.0000 (1.0)           0;0  0.5900 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     1.7099 (1.01)     1.7099 (1.01)     1.7099 (1.01)     0.0000 (1.0)      1.7099 (1.01)     0.0000 (1.0)           0;0  0.5848 (0.99)          1           1
test_data_status_all_flags-data-new[main]       1.7112 (1.01)     1.7112 (1.01)     1.7112 (1.01)     0.0000 (1.0)      1.7112 (1.01)     0.0000 (1.0)           0;0  0.5844 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     1.0035 (1.0)      1.0035 (1.0)      1.0035 (1.0)      0.0000 (1.0)      1.0035 (1.0)      0.0000 (1.0)           0;0  0.9965 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     1.0849 (1.08)     1.0849 (1.08)     1.0849 (1.08)     0.0000 (1.0)      1.0849 (1.08)     0.0000 (1.0)           0;0  0.9217 (0.92)          1           1
test_data_status_all_flags-data-noop[main]       1.0199 (1.02)     1.0199 (1.02)     1.0199 (1.02)     0.0000 (1.0)      1.0199 (1.02)     0.0000 (1.0)           0;0  0.9805 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     1.2326 (1.0)      1.2326 (1.0)      1.2326 (1.0)      0.0000 (1.0)      1.2326 (1.0)      0.0000 (1.0)           0;0  0.8113 (1.0)           1           1
test_diff-diff[3.10.0]     1.2383 (1.00)     1.2383 (1.00)     1.2383 (1.00)     0.0000 (1.0)      1.2383 (1.00)     0.0000 (1.0)           0;0  0.8076 (1.00)          1           1
test_diff-diff[main]       1.2888 (1.05)     1.2888 (1.05)     1.2888 (1.05)     0.0000 (1.0)      1.2888 (1.05)     0.0000 (1.0)           0;0  0.7759 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     640.3855 (1.03)     640.3855 (1.03)     640.3855 (1.03)     0.0000 (1.0)      640.3855 (1.03)     0.0000 (1.0)           0;0  1.5616 (0.97)          1           1
test_diff-diff-changed[3.10.0]     667.5218 (1.08)     667.5218 (1.08)     667.5218 (1.08)     0.0000 (1.0)      667.5218 (1.08)     0.0000 (1.0)           0;0  1.4981 (0.93)          1           1
test_diff-diff-changed[main]       620.4417 (1.0)      620.4417 (1.0)      620.4417 (1.0)      0.0000 (1.0)      620.4417 (1.0)      0.0000 (1.0)           0;0  1.6118 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     616.3159 (1.00)     616.3159 (1.00)     616.3159 (1.00)     0.0000 (1.0)      616.3159 (1.00)     0.0000 (1.0)           0;0  1.6225 (1.00)          1           1
test_diff-diff-changed-noop[3.10.0]     641.1268 (1.04)     641.1268 (1.04)     641.1268 (1.04)     0.0000 (1.0)      641.1268 (1.04)     0.0000 (1.0)           0;0  1.5598 (0.96)          1           1
test_diff-diff-changed-noop[main]       614.3358 (1.0)      614.3358 (1.0)      614.3358 (1.0)      0.0000 (1.0)      614.3358 (1.0)      0.0000 (1.0)           0;0  1.6278 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     580.7194 (1.0)      580.7194 (1.0)      580.7194 (1.0)      0.0000 (1.0)      580.7194 (1.0)      0.0000 (1.0)           0;0  1.7220 (1.0)           1           1
test_diff-diff-noop[3.10.0]     598.2426 (1.03)     598.2426 (1.03)     598.2426 (1.03)     0.0000 (1.0)      598.2426 (1.03)     0.0000 (1.0)           0;0  1.6716 (0.97)          1           1
test_diff-diff-noop[main]       606.8721 (1.05)     606.8721 (1.05)     606.8721 (1.05)     0.0000 (1.0)      606.8721 (1.05)     0.0000 (1.0)           0;0  1.6478 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        913.0144 (1.0)         913.0144 (1.0)         913.0144 (1.0)      0.0000 (1.0)         913.0144 (1.0)      0.0000 (1.0)           0;0  1.0953 (1.0)           1           1
test_exp_show-exp[3.10.0]     14,751.9420 (16.16)    14,751.9420 (16.16)    14,751.9420 (16.16)    0.0000 (1.0)      14,751.9420 (16.16)    0.0000 (1.0)           0;0  0.0678 (0.06)          1           1
test_exp_show-exp[main]       11,179.6090 (12.24)    11,179.6090 (12.24)    11,179.6090 (12.24)    0.0000 (1.0)      11,179.6090 (12.24)    0.0000 (1.0)           0;0  0.0894 (0.08)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     3.9104 (2.12)     3.9104 (2.12)     3.9104 (2.12)     0.0000 (1.0)      3.9104 (2.12)     0.0000 (1.0)           0;0  0.2557 (0.47)          1           1
test_fetch-fetch[3.10.0]     4.3517 (2.36)     4.3517 (2.36)     4.3517 (2.36)     0.0000 (1.0)      4.3517 (2.36)     0.0000 (1.0)           0;0  0.2298 (0.42)          1           1
test_fetch-fetch[main]       1.8423 (1.0)      1.8423 (1.0)      1.8423 (1.0)      0.0000 (1.0)      1.8423 (1.0)      0.0000 (1.0)           0;0  0.5428 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     495.3491 (1.03)     495.3491 (1.03)     495.3491 (1.03)     0.0000 (1.0)      495.3491 (1.03)     0.0000 (1.0)           0;0  2.0188 (0.97)          1           1
test_gc-gc[3.10.0]     530.2006 (1.10)     530.2006 (1.10)     530.2006 (1.10)     0.0000 (1.0)      530.2006 (1.10)     0.0000 (1.0)           0;0  1.8861 (0.91)          1           1
test_gc-gc[main]       482.7576 (1.0)      482.7576 (1.0)      482.7576 (1.0)      0.0000 (1.0)      482.7576 (1.0)      0.0000 (1.0)           0;0  2.0714 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     5.9689 (1.14)     5.9689 (1.14)     5.9689 (1.14)     0.0000 (1.0)      5.9689 (1.14)     0.0000 (1.0)           0;0  0.1675 (0.88)          1           1
test_get-get[3.10.0]     6.9632 (1.33)     6.9632 (1.33)     6.9632 (1.33)     0.0000 (1.0)      6.9632 (1.33)     0.0000 (1.0)           0;0  0.1436 (0.75)          1           1
test_get-get[main]       5.2411 (1.0)      5.2411 (1.0)      5.2411 (1.0)      0.0000 (1.0)      5.2411 (1.0)      0.0000 (1.0)           0;0  0.1908 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     3.1112 (3.25)     3.1112 (3.25)     3.1112 (3.25)     0.0000 (1.0)      3.1112 (3.25)     0.0000 (1.0)           0;0  0.3214 (0.31)          1           1
test_get_url-get-url[3.10.0]     3.2984 (3.44)     3.2984 (3.44)     3.2984 (3.44)     0.0000 (1.0)      3.2984 (3.44)     0.0000 (1.0)           0;0  0.3032 (0.29)          1           1
test_get_url-get-url[main]       0.9583 (1.0)      0.9583 (1.0)      0.9583 (1.0)      0.0000 (1.0)      0.9583 (1.0)      0.0000 (1.0)           0;0  1.0435 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     129.7750 (1.00)     136.7708 (1.0)      132.6287 (1.01)     1.5211 (1.0)      132.3959 (1.01)     2.1211 (1.0)          32;0  7.5398 (0.99)        100           1
test_help---help[3.10.0]     129.5138 (1.0)      141.6801 (1.04)     131.8489 (1.0)      1.7927 (1.18)     131.4646 (1.0)      2.5448 (1.20)         31;1  7.5844 (1.0)         100           1
test_help---help[main]       129.9914 (1.00)     144.2064 (1.05)     133.1873 (1.01)     2.0340 (1.34)     132.9951 (1.01)     2.4441 (1.15)         24;1  7.5082 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]      9.5379 (1.0)       9.5379 (1.0)       9.5379 (1.0)      0.0000 (1.0)       9.5379 (1.0)      0.0000 (1.0)           0;0  0.1048 (1.0)           1           1
test_import-import[3.10.0]     10.7386 (1.13)     10.7386 (1.13)     10.7386 (1.13)     0.0000 (1.0)      10.7386 (1.13)     0.0000 (1.0)           0;0  0.0931 (0.89)          1           1
test_import-import[main]       14.0741 (1.48)     14.0741 (1.48)     14.0741 (1.48)     0.0000 (1.0)      14.0741 (1.48)     0.0000 (1.0)           0;0  0.0711 (0.68)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     7.6703 (1.48)     7.6703 (1.48)     7.6703 (1.48)     0.0000 (1.0)      7.6703 (1.48)     0.0000 (1.0)           0;0  0.1304 (0.67)          1           1
test_import_url-import-url[3.10.0]     7.6410 (1.48)     7.6410 (1.48)     7.6410 (1.48)     0.0000 (1.0)      7.6410 (1.48)     0.0000 (1.0)           0;0  0.1309 (0.68)          1           1
test_import_url-import-url[main]       5.1701 (1.0)      5.1701 (1.0)      5.1701 (1.0)      0.0000 (1.0)      5.1701 (1.0)      0.0000 (1.0)           0;0  0.1934 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     366.3492 (1.0)      396.4840 (1.0)      372.2211 (1.0)      4.5525 (1.0)      371.2730 (1.0)      4.2163 (1.0)          12;5  2.6866 (1.0)         100           1
test_init-init[3.10.0]     373.5593 (1.02)     415.3749 (1.05)     381.3312 (1.02)     7.0371 (1.55)     378.7827 (1.02)     6.0248 (1.43)        18;11  2.6224 (0.98)        100           1
test_init-init[main]       373.1981 (1.02)     445.5399 (1.12)     385.4078 (1.04)     8.2033 (1.80)     383.7469 (1.03)     7.8484 (1.86)         12;2  2.5947 (0.97)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     395.3536 (1.01)     395.3536 (1.01)     395.3536 (1.01)     0.0000 (1.0)      395.3536 (1.01)     0.0000 (1.0)           0;0  2.5294 (0.99)          1           1
test_list-list[3.10.0]     394.0012 (1.01)     394.0012 (1.01)     394.0012 (1.01)     0.0000 (1.0)      394.0012 (1.01)     0.0000 (1.0)           0;0  2.5381 (0.99)          1           1
test_list-list[main]       391.9316 (1.0)      391.9316 (1.0)      391.9316 (1.0)      0.0000 (1.0)      391.9316 (1.0)      0.0000 (1.0)           0;0  2.5515 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     381.8769 (1.01)     381.8769 (1.01)     381.8769 (1.01)     0.0000 (1.0)      381.8769 (1.01)     0.0000 (1.0)           0;0  2.6186 (0.99)          1           1
test_list-list-dvc-only[3.10.0]     378.2717 (1.00)     378.2717 (1.00)     378.2717 (1.00)     0.0000 (1.0)      378.2717 (1.00)     0.0000 (1.0)           0;0  2.6436 (1.00)          1           1
test_list-list-dvc-only[main]       377.5847 (1.0)      377.5847 (1.0)      377.5847 (1.0)      0.0000 (1.0)      377.5847 (1.0)      0.0000 (1.0)           0;0  2.6484 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     461.0318 (1.0)      461.0318 (1.0)      461.0318 (1.0)      0.0000 (1.0)      461.0318 (1.0)      0.0000 (1.0)           0;0  2.1690 (1.0)           1           1
test_list-list-recursive[3.10.0]     462.1431 (1.00)     462.1431 (1.00)     462.1431 (1.00)     0.0000 (1.0)      462.1431 (1.00)     0.0000 (1.0)           0;0  2.1638 (1.00)          1           1
test_list-list-recursive[main]       466.1380 (1.01)     466.1380 (1.01)     466.1380 (1.01)     0.0000 (1.0)      466.1380 (1.01)     0.0000 (1.0)           0;0  2.1453 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     379.8976 (1.01)     379.8976 (1.01)     379.8976 (1.01)     0.0000 (1.0)      379.8976 (1.01)     0.0000 (1.0)           0;0  2.6323 (0.99)          1           1
test_list-list-shallow[3.10.0]     375.1805 (1.0)      375.1805 (1.0)      375.1805 (1.0)      0.0000 (1.0)      375.1805 (1.0)      0.0000 (1.0)           0;0  2.6654 (1.0)           1           1
test_list-list-shallow[main]       379.8048 (1.01)     379.8048 (1.01)     379.8048 (1.01)     0.0000 (1.0)      379.8048 (1.01)     0.0000 (1.0)           0;0  2.6329 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     2.1774 (1.10)     2.1774 (1.10)     2.1774 (1.10)     0.0000 (1.0)      2.1774 (1.10)     0.0000 (1.0)           0;0  0.4593 (0.91)          1           1
test_partial_add-add[3.10.0]     2.0591 (1.04)     2.0591 (1.04)     2.0591 (1.04)     0.0000 (1.0)      2.0591 (1.04)     0.0000 (1.0)           0;0  0.4857 (0.96)          1           1
test_partial_add-add[main]       1.9822 (1.0)      1.9822 (1.0)      1.9822 (1.0)      0.0000 (1.0)      1.9822 (1.0)      0.0000 (1.0)           0;0  0.5045 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     3.0617 (1.08)     3.0617 (1.08)     3.0617 (1.08)     0.0000 (1.0)      3.0617 (1.08)     0.0000 (1.0)           0;0  0.3266 (0.93)          1           1
test_partial_add-add-partial[3.10.0]     3.1564 (1.11)     3.1564 (1.11)     3.1564 (1.11)     0.0000 (1.0)      3.1564 (1.11)     0.0000 (1.0)           0;0  0.3168 (0.90)          1           1
test_partial_add-add-partial[main]       2.8411 (1.0)      2.8411 (1.0)      2.8411 (1.0)      0.0000 (1.0)      2.8411 (1.0)      0.0000 (1.0)           0;0  0.3520 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     571.6924 (1.0)      571.6924 (1.0)      571.6924 (1.0)      0.0000 (1.0)      571.6924 (1.0)      0.0000 (1.0)           0;0  1.7492 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     633.4570 (1.11)     633.4570 (1.11)     633.4570 (1.11)     0.0000 (1.0)      633.4570 (1.11)     0.0000 (1.0)           0;0  1.5786 (0.90)          1           1
test_partial_add-gc-cloud-noop[main]       671.0835 (1.17)     671.0835 (1.17)     671.0835 (1.17)     0.0000 (1.0)      671.0835 (1.17)     0.0000 (1.0)           0;0  1.4901 (0.85)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     488.8156 (1.0)      488.8156 (1.0)      488.8156 (1.0)      0.0000 (1.0)      488.8156 (1.0)      0.0000 (1.0)           0;0  2.0458 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     556.4611 (1.14)     556.4611 (1.14)     556.4611 (1.14)     0.0000 (1.0)      556.4611 (1.14)     0.0000 (1.0)           0;0  1.7971 (0.88)          1           1
test_partial_add-gc-noop[main]       552.7245 (1.13)     552.7245 (1.13)     552.7245 (1.13)     0.0000 (1.0)      552.7245 (1.13)     0.0000 (1.0)           0;0  1.8092 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     1.9710 (1.83)     1.9710 (1.83)     1.9710 (1.83)     0.0000 (1.0)      1.9710 (1.83)     0.0000 (1.0)           0;0  0.5074 (0.55)          1           1
test_partial_add-push[3.10.0]     1.1609 (1.08)     1.1609 (1.08)     1.1609 (1.08)     0.0000 (1.0)      1.1609 (1.08)     0.0000 (1.0)           0;0  0.8614 (0.93)          1           1
test_partial_add-push[main]       1.0772 (1.0)      1.0772 (1.0)      1.0772 (1.0)      0.0000 (1.0)      1.0772 (1.0)      0.0000 (1.0)           0;0  0.9283 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     1.9919 (1.64)     1.9919 (1.64)     1.9919 (1.64)     0.0000 (1.0)      1.9919 (1.64)     0.0000 (1.0)           0;0  0.5020 (0.61)          1           1
test_partial_add-push-partial[3.10.0]     1.2144 (1.0)      1.2144 (1.0)      1.2144 (1.0)      0.0000 (1.0)      1.2144 (1.0)      0.0000 (1.0)           0;0  0.8235 (1.0)           1           1
test_partial_add-push-partial[main]       1.2234 (1.01)     1.2234 (1.01)     1.2234 (1.01)     0.0000 (1.0)      1.2234 (1.01)     0.0000 (1.0)           0;0  0.8174 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     3.5840 (1.05)     3.5840 (1.05)     3.5840 (1.05)     0.0000 (1.0)      3.5840 (1.05)     0.0000 (1.0)           0;0  0.2790 (0.95)          1           1
test_partial_remove-add[3.10.0]     3.6700 (1.07)     3.6700 (1.07)     3.6700 (1.07)     0.0000 (1.0)      3.6700 (1.07)     0.0000 (1.0)           0;0  0.2725 (0.93)          1           1
test_partial_remove-add[main]       3.4198 (1.0)      3.4198 (1.0)      3.4198 (1.0)      0.0000 (1.0)      3.4198 (1.0)      0.0000 (1.0)           0;0  0.2924 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     1.4936 (1.07)     1.4936 (1.07)     1.4936 (1.07)     0.0000 (1.0)      1.4936 (1.07)     0.0000 (1.0)           0;0  0.6695 (0.93)          1           1
test_partial_remove-add-update[3.10.0]     1.5411 (1.11)     1.5411 (1.11)     1.5411 (1.11)     0.0000 (1.0)      1.5411 (1.11)     0.0000 (1.0)           0;0  0.6489 (0.90)          1           1
test_partial_remove-add-update[main]       1.3946 (1.0)      1.3946 (1.0)      1.3946 (1.0)      0.0000 (1.0)      1.3946 (1.0)      0.0000 (1.0)           0;0  0.7171 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     510.4742 (1.0)      510.4742 (1.0)      510.4742 (1.0)      0.0000 (1.0)      510.4742 (1.0)      0.0000 (1.0)           0;0  1.9590 (1.0)           1           1
test_partial_remove-gc[3.10.0]     575.3302 (1.13)     575.3302 (1.13)     575.3302 (1.13)     0.0000 (1.0)      575.3302 (1.13)     0.0000 (1.0)           0;0  1.7381 (0.89)          1           1
test_partial_remove-gc[main]       562.9367 (1.10)     562.9367 (1.10)     562.9367 (1.10)     0.0000 (1.0)      562.9367 (1.10)     0.0000 (1.0)           0;0  1.7764 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     555.6052 (1.0)      555.6052 (1.0)      555.6052 (1.0)      0.0000 (1.0)      555.6052 (1.0)      0.0000 (1.0)           0;0  1.7998 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     622.2578 (1.12)     622.2578 (1.12)     622.2578 (1.12)     0.0000 (1.0)      622.2578 (1.12)     0.0000 (1.0)           0;0  1.6071 (0.89)          1           1
test_partial_remove-gc-cloud[main]       634.1005 (1.14)     634.1005 (1.14)     634.1005 (1.14)     0.0000 (1.0)      634.1005 (1.14)     0.0000 (1.0)           0;0  1.5770 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     3.3968 (2.29)     3.3968 (2.29)     3.3968 (2.29)     0.0000 (1.0)      3.3968 (2.29)     0.0000 (1.0)           0;0  0.2944 (0.44)          1           1
test_partial_remove-push[3.10.0]     1.9185 (1.29)     1.9185 (1.29)     1.9185 (1.29)     0.0000 (1.0)      1.9185 (1.29)     0.0000 (1.0)           0;0  0.5213 (0.77)          1           1
test_partial_remove-push[main]       1.4828 (1.0)      1.4828 (1.0)      1.4828 (1.0)      0.0000 (1.0)      1.4828 (1.0)      0.0000 (1.0)           0;0  0.6744 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     483.3749 (1.00)     483.3749 (1.00)     483.3749 (1.00)     0.0000 (1.0)      483.3749 (1.00)     0.0000 (1.0)           0;0  2.0688 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     483.1888 (1.0)      483.1888 (1.0)      483.1888 (1.0)      0.0000 (1.0)      483.1888 (1.0)      0.0000 (1.0)           0;0  2.0696 (1.0)           1           1
test_partial_remove-push-update[main]       840.3158 (1.74)     840.3158 (1.74)     840.3158 (1.74)     0.0000 (1.0)      840.3158 (1.74)     0.0000 (1.0)           0;0  1.1900 (0.58)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     430.4954 (1.0)      436.8096 (1.0)      433.0374 (1.0)       2.6337 (1.0)      431.6350 (1.0)      3.9672 (1.0)           1;0  2.3093 (1.0)           5           3
test_plots-plots-diff[3.10.0]     789.6332 (1.83)     815.5243 (1.87)     796.6952 (1.84)     10.6639 (4.05)     792.9883 (1.84)     8.6576 (2.18)          1;1  1.2552 (0.54)          5           3
test_plots-plots-diff[main]       756.2086 (1.76)     765.6605 (1.75)     760.3858 (1.76)      4.2906 (1.63)     759.3621 (1.76)     7.9065 (1.99)          1;0  1.3151 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       444.2925 (1.0)        447.1284 (1.0)        445.6475 (1.0)      1.3093 (1.0)        445.8305 (1.0)       2.4668 (1.0)           3;0  2.2439 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,047.2136 (2.36)     1,054.2825 (2.36)     1,049.3339 (2.35)     2.9118 (2.22)     1,047.8207 (2.35)      3.1809 (1.29)          1;0  0.9530 (0.42)          5           3
test_plots-plots-diff-json[main]         833.5263 (1.88)       854.7949 (1.91)       845.3108 (1.90)     9.2240 (7.05)       841.8544 (1.89)     14.9796 (6.07)          3;0  1.1830 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     391.3952 (1.0)      394.7031 (1.0)      393.6815 (1.0)      1.3542 (1.0)      394.3940 (1.0)      1.5017 (1.0)           1;0  2.5401 (1.0)           5           3
test_plots-plots-show[3.10.0]     655.3450 (1.67)     663.4090 (1.68)     658.6564 (1.67)     3.2624 (2.41)     658.8191 (1.67)     4.9605 (3.30)          2;0  1.5182 (0.60)          5           3
test_plots-plots-show[main]       639.2145 (1.63)     645.7547 (1.64)     641.5437 (1.63)     2.5981 (1.92)     641.1727 (1.63)     3.3335 (2.22)          1;0  1.5587 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     404.4061 (1.0)      412.4303 (1.0)      408.6086 (1.0)      3.3508 (1.82)     407.8951 (1.0)       5.6086 (1.80)          2;0  2.4473 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     802.7677 (1.99)     818.7791 (1.99)     809.5595 (1.98)     6.5185 (3.55)     808.0949 (1.98)     10.3869 (3.34)          2;0  1.2352 (0.50)          5           3
test_plots-plots-show-json[main]       689.6959 (1.71)     693.9796 (1.68)     691.5053 (1.69)     1.8388 (1.0)      690.8532 (1.69)      3.1120 (1.0)           1;0  1.4461 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     3.4770 (2.29)     3.4770 (2.29)     3.4770 (2.29)     0.0000 (1.0)      3.4770 (2.29)     0.0000 (1.0)           0;0  0.2876 (0.44)          1           1
test_push-push[3.10.0]     1.9746 (1.30)     1.9746 (1.30)     1.9746 (1.30)     0.0000 (1.0)      1.9746 (1.30)     0.0000 (1.0)           0;0  0.5064 (0.77)          1           1
test_push-push[main]       1.5190 (1.0)      1.5190 (1.0)      1.5190 (1.0)      0.0000 (1.0)      1.5190 (1.0)      0.0000 (1.0)           0;0  0.6583 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     3.5479 (1.05)     3.5479 (1.05)     3.5479 (1.05)     0.0000 (1.0)      3.5479 (1.05)     0.0000 (1.0)           0;0  0.2819 (0.95)          1           1
test_sharing-add[3.10.0]     3.6084 (1.07)     3.6084 (1.07)     3.6084 (1.07)     0.0000 (1.0)      3.6084 (1.07)     0.0000 (1.0)           0;0  0.2771 (0.94)          1           1
test_sharing-add[main]       3.3805 (1.0)      3.3805 (1.0)      3.3805 (1.0)      0.0000 (1.0)      3.3805 (1.0)      0.0000 (1.0)           0;0  0.2958 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     2.4810 (1.09)     2.4810 (1.09)     2.4810 (1.09)     0.0000 (1.0)      2.4810 (1.09)     0.0000 (1.0)           0;0  0.4031 (0.92)          1           1
test_sharing-add-noop[3.10.0]     2.4514 (1.08)     2.4514 (1.08)     2.4514 (1.08)     0.0000 (1.0)      2.4514 (1.08)     0.0000 (1.0)           0;0  0.4079 (0.93)          1           1
test_sharing-add-noop[main]       2.2755 (1.0)      2.2755 (1.0)      2.2755 (1.0)      0.0000 (1.0)      2.2755 (1.0)      0.0000 (1.0)           0;0  0.4395 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     1.7125 (1.24)     1.7125 (1.24)     1.7125 (1.24)     0.0000 (1.0)      1.7125 (1.24)     0.0000 (1.0)           0;0  0.5839 (0.80)          1           1
test_sharing-checkout[3.10.0]     3.6710 (2.66)     3.6710 (2.66)     3.6710 (2.66)     0.0000 (1.0)      3.6710 (2.66)     0.0000 (1.0)           0;0  0.2724 (0.38)          1           1
test_sharing-checkout[main]       1.3778 (1.0)      1.3778 (1.0)      1.3778 (1.0)      0.0000 (1.0)      1.3778 (1.0)      0.0000 (1.0)           0;0  0.7258 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     562.4665 (1.01)     562.4665 (1.01)     562.4665 (1.01)     0.0000 (1.0)      562.4665 (1.01)     0.0000 (1.0)           0;0  1.7779 (0.99)          1           1
test_sharing-checkout-noop[3.10.0]     575.8560 (1.03)     575.8560 (1.03)     575.8560 (1.03)     0.0000 (1.0)      575.8560 (1.03)     0.0000 (1.0)           0;0  1.7365 (0.97)          1           1
test_sharing-checkout-noop[main]       558.7943 (1.0)      558.7943 (1.0)      558.7943 (1.0)      0.0000 (1.0)      558.7943 (1.0)      0.0000 (1.0)           0;0  1.7896 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     3.8264 (2.09)     3.8264 (2.09)     3.8264 (2.09)     0.0000 (1.0)      3.8264 (2.09)     0.0000 (1.0)           0;0  0.2613 (0.48)          1           1
test_sharing-fetch[3.10.0]     4.2831 (2.33)     4.2831 (2.33)     4.2831 (2.33)     0.0000 (1.0)      4.2831 (2.33)     0.0000 (1.0)           0;0  0.2335 (0.43)          1           1
test_sharing-fetch[main]       1.8348 (1.0)      1.8348 (1.0)      1.8348 (1.0)      0.0000 (1.0)      1.8348 (1.0)      0.0000 (1.0)           0;0  0.5450 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     421.5094 (1.0)      421.5094 (1.0)      421.5094 (1.0)      0.0000 (1.0)      421.5094 (1.0)      0.0000 (1.0)           0;0  2.3724 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     504.5205 (1.20)     504.5205 (1.20)     504.5205 (1.20)     0.0000 (1.0)      504.5205 (1.20)     0.0000 (1.0)           0;0  1.9821 (0.84)          1           1
test_sharing-fetch-noop[main]       817.1243 (1.94)     817.1243 (1.94)     817.1243 (1.94)     0.0000 (1.0)      817.1243 (1.94)     0.0000 (1.0)           0;0  1.2238 (0.52)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     3.3873 (2.30)     3.3873 (2.30)     3.3873 (2.30)     0.0000 (1.0)      3.3873 (2.30)     0.0000 (1.0)           0;0  0.2952 (0.44)          1           1
test_sharing-push[3.10.0]     1.9558 (1.33)     1.9558 (1.33)     1.9558 (1.33)     0.0000 (1.0)      1.9558 (1.33)     0.0000 (1.0)           0;0  0.5113 (0.75)          1           1
test_sharing-push[main]       1.4739 (1.0)      1.4739 (1.0)      1.4739 (1.0)      0.0000 (1.0)      1.4739 (1.0)      0.0000 (1.0)           0;0  0.6785 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     435.4088 (1.0)      435.4088 (1.0)      435.4088 (1.0)      0.0000 (1.0)      435.4088 (1.0)      0.0000 (1.0)           0;0  2.2967 (1.0)           1           1
test_sharing-push-noop[3.10.0]     456.6261 (1.05)     456.6261 (1.05)     456.6261 (1.05)     0.0000 (1.0)      456.6261 (1.05)     0.0000 (1.0)           0;0  2.1900 (0.95)          1           1
test_sharing-push-noop[main]       833.8896 (1.92)     833.8896 (1.92)     833.8896 (1.92)     0.0000 (1.0)      833.8896 (1.92)     0.0000 (1.0)           0;0  1.1992 (0.52)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     1.2159 (1.01)     1.2159 (1.01)     1.2159 (1.01)     0.0000 (1.0)      1.2159 (1.01)     0.0000 (1.0)           0;0  0.8224 (0.99)          1           1
test_status-status[3.10.0]     1.2322 (1.03)     1.2322 (1.03)     1.2322 (1.03)     0.0000 (1.0)      1.2322 (1.03)     0.0000 (1.0)           0;0  0.8116 (0.97)          1           1
test_status-status[main]       1.2010 (1.0)      1.2010 (1.0)      1.2010 (1.0)      0.0000 (1.0)      1.2010 (1.0)      0.0000 (1.0)           0;0  0.8326 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     554.8788 (1.02)     554.8788 (1.02)     554.8788 (1.02)     0.0000 (1.0)      554.8788 (1.02)     0.0000 (1.0)           0;0  1.8022 (0.98)          1           1
test_status-status-changed[3.10.0]     551.7394 (1.02)     551.7394 (1.02)     551.7394 (1.02)     0.0000 (1.0)      551.7394 (1.02)     0.0000 (1.0)           0;0  1.8125 (0.98)          1           1
test_status-status-changed[main]       542.2804 (1.0)      542.2804 (1.0)      542.2804 (1.0)      0.0000 (1.0)      542.2804 (1.0)      0.0000 (1.0)           0;0  1.8441 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     531.8383 (1.01)     531.8383 (1.01)     531.8383 (1.01)     0.0000 (1.0)      531.8383 (1.01)     0.0000 (1.0)           0;0  1.8803 (0.99)          1           1
test_status-status-changed-noop[3.10.0]     554.9673 (1.06)     554.9673 (1.06)     554.9673 (1.06)     0.0000 (1.0)      554.9673 (1.06)     0.0000 (1.0)           0;0  1.8019 (0.95)          1           1
test_status-status-changed-noop[main]       524.8231 (1.0)      524.8231 (1.0)      524.8231 (1.0)      0.0000 (1.0)      524.8231 (1.0)      0.0000 (1.0)           0;0  1.9054 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     533.9435 (1.0)      533.9435 (1.0)      533.9435 (1.0)      0.0000 (1.0)      533.9435 (1.0)      0.0000 (1.0)           0;0  1.8729 (1.0)           1           1
test_status-status-noop[3.10.0]     546.3261 (1.02)     546.3261 (1.02)     546.3261 (1.02)     0.0000 (1.0)      546.3261 (1.02)     0.0000 (1.0)           0;0  1.8304 (0.98)          1           1
test_status-status-noop[main]       543.0758 (1.02)     543.0758 (1.02)     543.0758 (1.02)     0.0000 (1.0)      543.0758 (1.02)     0.0000 (1.0)           0;0  1.8414 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     7.5814 (1.47)     7.5814 (1.47)     7.5814 (1.47)     0.0000 (1.0)      7.5814 (1.47)     0.0000 (1.0)           0;0  0.1319 (0.68)          1           1
test_update-import-url[3.10.0]     7.6515 (1.48)     7.6515 (1.48)     7.6515 (1.48)     0.0000 (1.0)      7.6515 (1.48)     0.0000 (1.0)           0;0  0.1307 (0.68)          1           1
test_update-import-url[main]       5.1708 (1.0)      5.1708 (1.0)      5.1708 (1.0)      0.0000 (1.0)      5.1708 (1.0)      0.0000 (1.0)           0;0  0.1934 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     6.7387 (1.51)     6.7387 (1.51)     6.7387 (1.51)     0.0000 (1.0)      6.7387 (1.51)     0.0000 (1.0)           0;0  0.1484 (0.66)          1           1
test_update-update[3.10.0]     6.7853 (1.52)     6.7853 (1.52)     6.7853 (1.52)     0.0000 (1.0)      6.7853 (1.52)     0.0000 (1.0)           0;0  0.1474 (0.66)          1           1
test_update-update[main]       4.4499 (1.0)      4.4499 (1.0)      4.4499 (1.0)      0.0000 (1.0)      4.4499 (1.0)      0.0000 (1.0)           0;0  0.2247 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                          Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]       991.6644 (1.02)       991.6644 (1.02)       991.6644 (1.02)     0.0000 (1.0)        991.6644 (1.02)     0.0000 (1.0)           0;0  1.0084 (0.98)          1           1
test_update-update-noop[3.10.0]     1,025.7993 (1.06)     1,025.7993 (1.06)     1,025.7993 (1.06)     0.0000 (1.0)      1,025.7993 (1.06)     0.0000 (1.0)           0;0  0.9748 (0.94)          1           1
test_update-update-noop[main]         967.7804 (1.0)        967.7804 (1.0)        967.7804 (1.0)      0.0000 (1.0)        967.7804 (1.0)      0.0000 (1.0)           0;0  1.0333 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean