iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

build(deps): bump actions/setup-python from 4 to 5 #498

Closed dependabot[bot] closed 10 months ago

dependabot[bot] commented 10 months ago

Bumps actions/setup-python from 4 to 5.

Release notes

Sourced from actions/setup-python's releases.

v5.0.0

What's Changed

In scope of this release, we update node version runtime from node16 to node20 (actions/setup-python#772). Besides, we update dependencies to the latest versions.

Full Changelog: https://github.com/actions/setup-python/compare/v4.8.0...v5.0.0

v4.8.0

What's Changed

In scope of this release we added support for GraalPy (actions/setup-python#694). You can use this snippet to set up GraalPy:

steps:
- uses: actions/checkout@v4
- uses: actions/setup-python@v4 
  with:
    python-version: 'graalpy-22.3' 
- run: python my_script.py

Besides, the release contains such changes as:

New Contributors

Full Changelog: https://github.com/actions/setup-python/compare/v4...v4.8.0

v4.7.1

What's Changed

Full Changelog: https://github.com/actions/setup-python/compare/v4...v4.7.1

v4.7.0

In scope of this release, the support for reading python version from pyproject.toml was added (actions/setup-python#669).

      - name: Setup Python
        uses: actions/setup-python@v4
</tr></table> 

... (truncated)

Commits


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
github-actions[bot] commented 10 months ago

Thu Dec  7 09:54:04 UTC 2023
dataset: small
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[3.0.0]      3.6121 (1.02)     3.6121 (1.02)     3.6121 (1.02)     0.0000 (1.0)      3.6121 (1.02)     0.0000 (1.0)           0;0  0.2768 (0.98)          1           1
test_add-add[3.10.0]     3.6322 (1.03)     3.6322 (1.03)     3.6322 (1.03)     0.0000 (1.0)      3.6322 (1.03)     0.0000 (1.0)           0;0  0.2753 (0.97)          1           1
test_add-add[main]       3.5258 (1.0)      3.5258 (1.0)      3.5258 (1.0)      0.0000 (1.0)      3.5258 (1.0)      0.0000 (1.0)           0;0  0.2836 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[3.0.0]      3.8597 (2.42)     3.8597 (2.42)     3.8597 (2.42)     0.0000 (1.0)      3.8597 (2.42)     0.0000 (1.0)           0;0  0.2591 (0.41)          1           1
test_checkout_copy-checkout[3.10.0]     3.8011 (2.38)     3.8011 (2.38)     3.8011 (2.38)     0.0000 (1.0)      3.8011 (2.38)     0.0000 (1.0)           0;0  0.2631 (0.42)          1           1
test_checkout_copy-checkout[main]       1.5945 (1.0)      1.5945 (1.0)      1.5945 (1.0)      0.0000 (1.0)      1.5945 (1.0)      0.0000 (1.0)           0;0  0.6271 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[3.0.0]      567.6276 (1.02)     567.6276 (1.02)     567.6276 (1.02)     0.0000 (1.0)      567.6276 (1.02)     0.0000 (1.0)           0;0  1.7617 (0.98)          1           1
test_checkout_copy-checkout-noop[3.10.0]     565.6504 (1.01)     565.6504 (1.01)     565.6504 (1.01)     0.0000 (1.0)      565.6504 (1.01)     0.0000 (1.0)           0;0  1.7679 (0.99)          1           1
test_checkout_copy-checkout-noop[main]       559.1065 (1.0)      559.1065 (1.0)      559.1065 (1.0)      0.0000 (1.0)      559.1065 (1.0)      0.0000 (1.0)           0;0  1.7886 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[3.0.0]      618.0104 (1.00)     618.0104 (1.00)     618.0104 (1.00)     0.0000 (1.0)      618.0104 (1.00)     0.0000 (1.0)           0;0  1.6181 (1.00)          1           1
test_checkout_copy-checkout-update[3.10.0]     615.5395 (1.0)      615.5395 (1.0)      615.5395 (1.0)      0.0000 (1.0)      615.5395 (1.0)      0.0000 (1.0)           0;0  1.6246 (1.0)           1           1
test_checkout_copy-checkout-update[main]       621.4805 (1.01)     621.4805 (1.01)     621.4805 (1.01)     0.0000 (1.0)      621.4805 (1.01)     0.0000 (1.0)           0;0  1.6091 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[3.0.0]      1.0522 (1.00)     1.0522 (1.00)     1.0522 (1.00)     0.0000 (1.0)      1.0522 (1.00)     0.0000 (1.0)           0;0  0.9504 (1.00)          1           1
test_checkout_hardlink-checkout[3.10.0]     1.0615 (1.01)     1.0615 (1.01)     1.0615 (1.01)     0.0000 (1.0)      1.0615 (1.01)     0.0000 (1.0)           0;0  0.9421 (0.99)          1           1
test_checkout_hardlink-checkout[main]       1.0498 (1.0)      1.0498 (1.0)      1.0498 (1.0)      0.0000 (1.0)      1.0498 (1.0)      0.0000 (1.0)           0;0  0.9526 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[3.0.0]      567.5555 (1.02)     567.5555 (1.02)     567.5555 (1.02)     0.0000 (1.0)      567.5555 (1.02)     0.0000 (1.0)           0;0  1.7619 (0.98)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     564.0449 (1.01)     564.0449 (1.01)     564.0449 (1.01)     0.0000 (1.0)      564.0449 (1.01)     0.0000 (1.0)           0;0  1.7729 (0.99)          1           1
test_checkout_hardlink-checkout-noop[main]       556.3038 (1.0)      556.3038 (1.0)      556.3038 (1.0)      0.0000 (1.0)      556.3038 (1.0)      0.0000 (1.0)           0;0  1.7976 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[3.0.0]      615.3494 (1.00)     615.3494 (1.00)     615.3494 (1.00)     0.0000 (1.0)      615.3494 (1.00)     0.0000 (1.0)           0;0  1.6251 (1.00)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     614.5632 (1.00)     614.5632 (1.00)     614.5632 (1.00)     0.0000 (1.0)      614.5632 (1.00)     0.0000 (1.0)           0;0  1.6272 (1.00)          1           1
test_checkout_hardlink-checkout-update[main]       612.9455 (1.0)      612.9455 (1.0)      612.9455 (1.0)      0.0000 (1.0)      612.9455 (1.0)      0.0000 (1.0)           0;0  1.6315 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[3.0.0]      1.1573 (1.03)     1.1573 (1.03)     1.1573 (1.03)     0.0000 (1.0)      1.1573 (1.03)     0.0000 (1.0)           0;0  0.8641 (0.97)          1           1
test_checkout_symlink-checkout[3.10.0]     1.1372 (1.01)     1.1372 (1.01)     1.1372 (1.01)     0.0000 (1.0)      1.1372 (1.01)     0.0000 (1.0)           0;0  0.8794 (0.99)          1           1
test_checkout_symlink-checkout[main]       1.1276 (1.0)      1.1276 (1.0)      1.1276 (1.0)      0.0000 (1.0)      1.1276 (1.0)      0.0000 (1.0)           0;0  0.8868 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[3.0.0]      624.2653 (1.04)     624.2653 (1.04)     624.2653 (1.04)     0.0000 (1.0)      624.2653 (1.04)     0.0000 (1.0)           0;0  1.6019 (0.96)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     600.8837 (1.0)      600.8837 (1.0)      600.8837 (1.0)      0.0000 (1.0)      600.8837 (1.0)      0.0000 (1.0)           0;0  1.6642 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       621.0052 (1.03)     621.0052 (1.03)     621.0052 (1.03)     0.0000 (1.0)      621.0052 (1.03)     0.0000 (1.0)           0;0  1.6103 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[3.0.0]      678.9263 (1.0)      678.9263 (1.0)      678.9263 (1.0)      0.0000 (1.0)      678.9263 (1.0)      0.0000 (1.0)           0;0  1.4729 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     679.2492 (1.00)     679.2492 (1.00)     679.2492 (1.00)     0.0000 (1.0)      679.2492 (1.00)     0.0000 (1.0)           0;0  1.4722 (1.00)          1           1
test_checkout_symlink-checkout-update[main]       700.3775 (1.03)     700.3775 (1.03)     700.3775 (1.03)     0.0000 (1.0)      700.3775 (1.03)     0.0000 (1.0)           0;0  1.4278 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[3.0.0]      591.0907 (1.03)     591.0907 (1.03)     591.0907 (1.03)     0.0000 (1.0)      591.0907 (1.03)     0.0000 (1.0)           0;0  1.6918 (0.97)          1           1
test_data_status-data-changed[3.10.0]     573.8392 (1.00)     573.8392 (1.00)     573.8392 (1.00)     0.0000 (1.0)      573.8392 (1.00)     0.0000 (1.0)           0;0  1.7426 (1.00)          1           1
test_data_status-data-changed[main]       572.5214 (1.0)      572.5214 (1.0)      572.5214 (1.0)      0.0000 (1.0)      572.5214 (1.0)      0.0000 (1.0)           0;0  1.7467 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[3.0.0]      596.4438 (1.04)     596.4438 (1.04)     596.4438 (1.04)     0.0000 (1.0)      596.4438 (1.04)     0.0000 (1.0)           0;0  1.6766 (0.96)          1           1
test_data_status-data-changed-noop[3.10.0]     570.7853 (1.0)      570.7853 (1.0)      570.7853 (1.0)      0.0000 (1.0)      570.7853 (1.0)      0.0000 (1.0)           0;0  1.7520 (1.0)           1           1
test_data_status-data-changed-noop[main]       577.0760 (1.01)     577.0760 (1.01)     577.0760 (1.01)     0.0000 (1.0)      577.0760 (1.01)     0.0000 (1.0)           0;0  1.7329 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[3.0.0]      1.2858 (1.05)     1.2858 (1.05)     1.2858 (1.05)     0.0000 (1.0)      1.2858 (1.05)     0.0000 (1.0)           0;0  0.7777 (0.96)          1           1
test_data_status-data-new[3.10.0]     1.2330 (1.00)     1.2330 (1.00)     1.2330 (1.00)     0.0000 (1.0)      1.2330 (1.00)     0.0000 (1.0)           0;0  0.8111 (1.00)          1           1
test_data_status-data-new[main]       1.2298 (1.0)      1.2298 (1.0)      1.2298 (1.0)      0.0000 (1.0)      1.2298 (1.0)      0.0000 (1.0)           0;0  0.8132 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[3.0.0]      602.6837 (1.06)     602.6837 (1.06)     602.6837 (1.06)     0.0000 (1.0)      602.6837 (1.06)     0.0000 (1.0)           0;0  1.6592 (0.94)          1           1
test_data_status-data-noop[3.10.0]     567.1144 (1.0)      567.1144 (1.0)      567.1144 (1.0)      0.0000 (1.0)      567.1144 (1.0)      0.0000 (1.0)           0;0  1.7633 (1.0)           1           1
test_data_status-data-noop[main]       570.5717 (1.01)     570.5717 (1.01)     570.5717 (1.01)     0.0000 (1.0)      570.5717 (1.01)     0.0000 (1.0)           0;0  1.7526 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[3.0.0]      1.0480 (1.04)     1.0480 (1.04)     1.0480 (1.04)     0.0000 (1.0)      1.0480 (1.04)     0.0000 (1.0)           0;0  0.9542 (0.96)          1           1
test_data_status_all_flags-data-changed[3.10.0]     1.0078 (1.0)      1.0078 (1.0)      1.0078 (1.0)      0.0000 (1.0)      1.0078 (1.0)      0.0000 (1.0)           0;0  0.9923 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       1.0206 (1.01)     1.0206 (1.01)     1.0206 (1.01)     0.0000 (1.0)      1.0206 (1.01)     0.0000 (1.0)           0;0  0.9798 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[3.0.0]      1.0338 (1.01)     1.0338 (1.01)     1.0338 (1.01)     0.0000 (1.0)      1.0338 (1.01)     0.0000 (1.0)           0;0  0.9673 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     1.0487 (1.02)     1.0487 (1.02)     1.0487 (1.02)     0.0000 (1.0)      1.0487 (1.02)     0.0000 (1.0)           0;0  0.9535 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       1.0281 (1.0)      1.0281 (1.0)      1.0281 (1.0)      0.0000 (1.0)      1.0281 (1.0)      0.0000 (1.0)           0;0  0.9727 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[3.0.0]      1.6720 (1.00)     1.6720 (1.00)     1.6720 (1.00)     0.0000 (1.0)      1.6720 (1.00)     0.0000 (1.0)           0;0  0.5981 (1.00)          1           1
test_data_status_all_flags-data-new[3.10.0]     1.6660 (1.0)      1.6660 (1.0)      1.6660 (1.0)      0.0000 (1.0)      1.6660 (1.0)      0.0000 (1.0)           0;0  0.6003 (1.0)           1           1
test_data_status_all_flags-data-new[main]       1.7507 (1.05)     1.7507 (1.05)     1.7507 (1.05)     0.0000 (1.0)      1.7507 (1.05)     0.0000 (1.0)           0;0  0.5712 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[3.0.0]      1.0029 (1.0)      1.0029 (1.0)      1.0029 (1.0)      0.0000 (1.0)      1.0029 (1.0)      0.0000 (1.0)           0;0  0.9971 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     1.0039 (1.00)     1.0039 (1.00)     1.0039 (1.00)     0.0000 (1.0)      1.0039 (1.00)     0.0000 (1.0)           0;0  0.9962 (1.00)          1           1
test_data_status_all_flags-data-noop[main]       1.0109 (1.01)     1.0109 (1.01)     1.0109 (1.01)     0.0000 (1.0)      1.0109 (1.01)     0.0000 (1.0)           0;0  0.9892 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[3.0.0]      1.2880 (1.0)      1.2880 (1.0)      1.2880 (1.0)      0.0000 (1.0)      1.2880 (1.0)      0.0000 (1.0)           0;0  0.7764 (1.0)           1           1
test_diff-diff[3.10.0]     1.3102 (1.02)     1.3102 (1.02)     1.3102 (1.02)     0.0000 (1.0)      1.3102 (1.02)     0.0000 (1.0)           0;0  0.7632 (0.98)          1           1
test_diff-diff[main]       1.3335 (1.04)     1.3335 (1.04)     1.3335 (1.04)     0.0000 (1.0)      1.3335 (1.04)     0.0000 (1.0)           0;0  0.7499 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[3.0.0]      690.2371 (1.02)     690.2371 (1.02)     690.2371 (1.02)     0.0000 (1.0)      690.2371 (1.02)     0.0000 (1.0)           0;0  1.4488 (0.98)          1           1
test_diff-diff-changed[3.10.0]     725.7755 (1.07)     725.7755 (1.07)     725.7755 (1.07)     0.0000 (1.0)      725.7755 (1.07)     0.0000 (1.0)           0;0  1.3778 (0.93)          1           1
test_diff-diff-changed[main]       676.1066 (1.0)      676.1066 (1.0)      676.1066 (1.0)      0.0000 (1.0)      676.1066 (1.0)      0.0000 (1.0)           0;0  1.4791 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[3.0.0]      678.2120 (1.03)     678.2120 (1.03)     678.2120 (1.03)     0.0000 (1.0)      678.2120 (1.03)     0.0000 (1.0)           0;0  1.4745 (0.97)          1           1
test_diff-diff-changed-noop[3.10.0]     677.9412 (1.03)     677.9412 (1.03)     677.9412 (1.03)     0.0000 (1.0)      677.9412 (1.03)     0.0000 (1.0)           0;0  1.4751 (0.97)          1           1
test_diff-diff-changed-noop[main]       657.1561 (1.0)      657.1561 (1.0)      657.1561 (1.0)      0.0000 (1.0)      657.1561 (1.0)      0.0000 (1.0)           0;0  1.5217 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[3.0.0]      621.7566 (1.0)      621.7566 (1.0)      621.7566 (1.0)      0.0000 (1.0)      621.7566 (1.0)      0.0000 (1.0)           0;0  1.6083 (1.0)           1           1
test_diff-diff-noop[3.10.0]     628.2614 (1.01)     628.2614 (1.01)     628.2614 (1.01)     0.0000 (1.0)      628.2614 (1.01)     0.0000 (1.0)           0;0  1.5917 (0.99)          1           1
test_diff-diff-noop[main]       652.3847 (1.05)     652.3847 (1.05)     652.3847 (1.05)     0.0000 (1.0)      652.3847 (1.05)     0.0000 (1.0)           0;0  1.5328 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[3.0.0]      14.1850 (1.20)     14.1850 (1.20)     14.1850 (1.20)     0.0000 (1.0)      14.1850 (1.20)     0.0000 (1.0)           0;0  0.0705 (0.83)          1           1
test_exp_show-exp[3.10.0]     13.8032 (1.17)     13.8032 (1.17)     13.8032 (1.17)     0.0000 (1.0)      13.8032 (1.17)     0.0000 (1.0)           0;0  0.0724 (0.86)          1           1
test_exp_show-exp[main]       11.8426 (1.0)      11.8426 (1.0)      11.8426 (1.0)      0.0000 (1.0)      11.8426 (1.0)      0.0000 (1.0)           0;0  0.0844 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[3.0.0]      4.5181 (2.26)     4.5181 (2.26)     4.5181 (2.26)     0.0000 (1.0)      4.5181 (2.26)     0.0000 (1.0)           0;0  0.2213 (0.44)          1           1
test_fetch-fetch[3.10.0]     4.4889 (2.25)     4.4889 (2.25)     4.4889 (2.25)     0.0000 (1.0)      4.4889 (2.25)     0.0000 (1.0)           0;0  0.2228 (0.45)          1           1
test_fetch-fetch[main]       1.9988 (1.0)      1.9988 (1.0)      1.9988 (1.0)      0.0000 (1.0)      1.9988 (1.0)      0.0000 (1.0)           0;0  0.5003 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[3.0.0]      497.2706 (1.0)      497.2706 (1.0)      497.2706 (1.0)      0.0000 (1.0)      497.2706 (1.0)      0.0000 (1.0)           0;0  2.0110 (1.0)           1           1
test_gc-gc[3.10.0]     500.8113 (1.01)     500.8113 (1.01)     500.8113 (1.01)     0.0000 (1.0)      500.8113 (1.01)     0.0000 (1.0)           0;0  1.9968 (0.99)          1           1
test_gc-gc[main]       504.8035 (1.02)     504.8035 (1.02)     504.8035 (1.02)     0.0000 (1.0)      504.8035 (1.02)     0.0000 (1.0)           0;0  1.9810 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[3.0.0]      6.1073 (1.08)     6.1073 (1.08)     6.1073 (1.08)     0.0000 (1.0)      6.1073 (1.08)     0.0000 (1.0)           0;0  0.1637 (0.93)          1           1
test_get-get[3.10.0]     7.2081 (1.28)     7.2081 (1.28)     7.2081 (1.28)     0.0000 (1.0)      7.2081 (1.28)     0.0000 (1.0)           0;0  0.1387 (0.78)          1           1
test_get-get[main]       5.6499 (1.0)      5.6499 (1.0)      5.6499 (1.0)      0.0000 (1.0)      5.6499 (1.0)      0.0000 (1.0)           0;0  0.1770 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[3.0.0]      3.0911 (3.14)     3.0911 (3.14)     3.0911 (3.14)     0.0000 (1.0)      3.0911 (3.14)     0.0000 (1.0)           0;0  0.3235 (0.32)          1           1
test_get_url-get-url[3.10.0]     3.2260 (3.27)     3.2260 (3.27)     3.2260 (3.27)     0.0000 (1.0)      3.2260 (3.27)     0.0000 (1.0)           0;0  0.3100 (0.31)          1           1
test_get_url-get-url[main]       0.9854 (1.0)      0.9854 (1.0)      0.9854 (1.0)      0.0000 (1.0)      0.9854 (1.0)      0.0000 (1.0)           0;0  1.0148 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[3.0.0]      123.7063 (1.0)      141.5839 (1.06)     126.3201 (1.00)     2.2413 (1.55)     125.8424 (1.00)     2.6683 (2.71)         14;2  7.9164 (1.00)        100           1
test_help---help[3.10.0]     124.0137 (1.00)     134.4624 (1.01)     125.9841 (1.0)      1.5312 (1.06)     125.6877 (1.0)      0.9836 (1.0)          10;7  7.9375 (1.0)         100           1
test_help---help[main]       124.4534 (1.01)     133.4998 (1.0)      126.9065 (1.01)     1.4418 (1.0)      126.4924 (1.01)     1.3140 (1.34)         13;4  7.8798 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[3.0.0]       9.2757 (1.03)      9.2757 (1.03)      9.2757 (1.03)     0.0000 (1.0)       9.2757 (1.03)     0.0000 (1.0)           0;0  0.1078 (0.97)          1           1
test_import-import[3.10.0]     10.3315 (1.15)     10.3315 (1.15)     10.3315 (1.15)     0.0000 (1.0)      10.3315 (1.15)     0.0000 (1.0)           0;0  0.0968 (0.87)          1           1
test_import-import[main]        8.9966 (1.0)       8.9966 (1.0)       8.9966 (1.0)      0.0000 (1.0)       8.9966 (1.0)      0.0000 (1.0)           0;0  0.1112 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[3.0.0]      7.4256 (1.41)     7.4256 (1.41)     7.4256 (1.41)     0.0000 (1.0)      7.4256 (1.41)     0.0000 (1.0)           0;0  0.1347 (0.71)          1           1
test_import_url-import-url[3.10.0]     7.8576 (1.49)     7.8576 (1.49)     7.8576 (1.49)     0.0000 (1.0)      7.8576 (1.49)     0.0000 (1.0)           0;0  0.1273 (0.67)          1           1
test_import_url-import-url[main]       5.2707 (1.0)      5.2707 (1.0)      5.2707 (1.0)      0.0000 (1.0)      5.2707 (1.0)      0.0000 (1.0)           0;0  0.1897 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[3.0.0]      352.7791 (1.0)      393.0607 (1.0)      370.4994 (1.0)      10.1523 (2.80)     372.0967 (1.0)      16.8294 (5.75)         43;0  2.6991 (1.0)         100           1
test_init-init[3.10.0]     365.2992 (1.04)     418.9937 (1.07)     378.1176 (1.02)     11.3146 (3.13)     373.1987 (1.00)     14.4270 (4.93)         22;2  2.6447 (0.98)        100           1
test_init-init[main]       373.5342 (1.06)     397.9759 (1.01)     379.6082 (1.02)      3.6202 (1.0)      379.3969 (1.02)      2.9262 (1.0)          19;5  2.6343 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[3.0.0]      431.4497 (1.09)     431.4497 (1.09)     431.4497 (1.09)     0.0000 (1.0)      431.4497 (1.09)     0.0000 (1.0)           0;0  2.3178 (0.92)          1           1
test_list-list[3.10.0]     402.9495 (1.02)     402.9495 (1.02)     402.9495 (1.02)     0.0000 (1.0)      402.9495 (1.02)     0.0000 (1.0)           0;0  2.4817 (0.98)          1           1
test_list-list[main]       395.3138 (1.0)      395.3138 (1.0)      395.3138 (1.0)      0.0000 (1.0)      395.3138 (1.0)      0.0000 (1.0)           0;0  2.5296 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[3.0.0]      392.0274 (1.01)     392.0274 (1.01)     392.0274 (1.01)     0.0000 (1.0)      392.0274 (1.01)     0.0000 (1.0)           0;0  2.5508 (0.99)          1           1
test_list-list-dvc-only[3.10.0]     389.4676 (1.0)      389.4676 (1.0)      389.4676 (1.0)      0.0000 (1.0)      389.4676 (1.0)      0.0000 (1.0)           0;0  2.5676 (1.0)           1           1
test_list-list-dvc-only[main]       398.1723 (1.02)     398.1723 (1.02)     398.1723 (1.02)     0.0000 (1.0)      398.1723 (1.02)     0.0000 (1.0)           0;0  2.5115 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[3.0.0]      472.8524 (1.01)     472.8524 (1.01)     472.8524 (1.01)     0.0000 (1.0)      472.8524 (1.01)     0.0000 (1.0)           0;0  2.1148 (0.99)          1           1
test_list-list-recursive[3.10.0]     470.6191 (1.00)     470.6191 (1.00)     470.6191 (1.00)     0.0000 (1.0)      470.6191 (1.00)     0.0000 (1.0)           0;0  2.1249 (1.00)          1           1
test_list-list-recursive[main]       469.3680 (1.0)      469.3680 (1.0)      469.3680 (1.0)      0.0000 (1.0)      469.3680 (1.0)      0.0000 (1.0)           0;0  2.1305 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[3.0.0]      395.2935 (1.01)     395.2935 (1.01)     395.2935 (1.01)     0.0000 (1.0)      395.2935 (1.01)     0.0000 (1.0)           0;0  2.5298 (0.99)          1           1
test_list-list-shallow[3.10.0]     389.7591 (1.0)      389.7591 (1.0)      389.7591 (1.0)      0.0000 (1.0)      389.7591 (1.0)      0.0000 (1.0)           0;0  2.5657 (1.0)           1           1
test_list-list-shallow[main]       390.9589 (1.00)     390.9589 (1.00)     390.9589 (1.00)     0.0000 (1.0)      390.9589 (1.00)     0.0000 (1.0)           0;0  2.5578 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[3.0.0]      2.0630 (1.03)     2.0630 (1.03)     2.0630 (1.03)     0.0000 (1.0)      2.0630 (1.03)     0.0000 (1.0)           0;0  0.4847 (0.97)          1           1
test_partial_add-add[3.10.0]     2.0040 (1.0)      2.0040 (1.0)      2.0040 (1.0)      0.0000 (1.0)      2.0040 (1.0)      0.0000 (1.0)           0;0  0.4990 (1.0)           1           1
test_partial_add-add[main]       2.0153 (1.01)     2.0153 (1.01)     2.0153 (1.01)     0.0000 (1.0)      2.0153 (1.01)     0.0000 (1.0)           0;0  0.4962 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[3.0.0]      2.9228 (1.02)     2.9228 (1.02)     2.9228 (1.02)     0.0000 (1.0)      2.9228 (1.02)     0.0000 (1.0)           0;0  0.3421 (0.98)          1           1
test_partial_add-add-partial[3.10.0]     3.1294 (1.09)     3.1294 (1.09)     3.1294 (1.09)     0.0000 (1.0)      3.1294 (1.09)     0.0000 (1.0)           0;0  0.3195 (0.92)          1           1
test_partial_add-add-partial[main]       2.8695 (1.0)      2.8695 (1.0)      2.8695 (1.0)      0.0000 (1.0)      2.8695 (1.0)      0.0000 (1.0)           0;0  0.3485 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[3.0.0]      623.1828 (1.0)      623.1828 (1.0)      623.1828 (1.0)      0.0000 (1.0)      623.1828 (1.0)      0.0000 (1.0)           0;0  1.6047 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     624.7696 (1.00)     624.7696 (1.00)     624.7696 (1.00)     0.0000 (1.0)      624.7696 (1.00)     0.0000 (1.0)           0;0  1.6006 (1.00)          1           1
test_partial_add-gc-cloud-noop[main]       686.1646 (1.10)     686.1646 (1.10)     686.1646 (1.10)     0.0000 (1.0)      686.1646 (1.10)     0.0000 (1.0)           0;0  1.4574 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[3.0.0]      532.8439 (1.0)      532.8439 (1.0)      532.8439 (1.0)      0.0000 (1.0)      532.8439 (1.0)      0.0000 (1.0)           0;0  1.8767 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     554.1218 (1.04)     554.1218 (1.04)     554.1218 (1.04)     0.0000 (1.0)      554.1218 (1.04)     0.0000 (1.0)           0;0  1.8047 (0.96)          1           1
test_partial_add-gc-noop[main]       553.4111 (1.04)     553.4111 (1.04)     553.4111 (1.04)     0.0000 (1.0)      553.4111 (1.04)     0.0000 (1.0)           0;0  1.8070 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[3.0.0]      1.1512 (1.06)     1.1512 (1.06)     1.1512 (1.06)     0.0000 (1.0)      1.1512 (1.06)     0.0000 (1.0)           0;0  0.8686 (0.94)          1           1
test_partial_add-push[3.10.0]     1.1471 (1.06)     1.1471 (1.06)     1.1471 (1.06)     0.0000 (1.0)      1.1471 (1.06)     0.0000 (1.0)           0;0  0.8718 (0.95)          1           1
test_partial_add-push[main]       1.0849 (1.0)      1.0849 (1.0)      1.0849 (1.0)      0.0000 (1.0)      1.0849 (1.0)      0.0000 (1.0)           0;0  0.9217 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[3.0.0]      1.2355 (1.06)     1.2355 (1.06)     1.2355 (1.06)     0.0000 (1.0)      1.2355 (1.06)     0.0000 (1.0)           0;0  0.8094 (0.94)          1           1
test_partial_add-push-partial[3.10.0]     1.1864 (1.02)     1.1864 (1.02)     1.1864 (1.02)     0.0000 (1.0)      1.1864 (1.02)     0.0000 (1.0)           0;0  0.8429 (0.98)          1           1
test_partial_add-push-partial[main]       1.1673 (1.0)      1.1673 (1.0)      1.1673 (1.0)      0.0000 (1.0)      1.1673 (1.0)      0.0000 (1.0)           0;0  0.8567 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[3.0.0]      3.5630 (1.04)     3.5630 (1.04)     3.5630 (1.04)     0.0000 (1.0)      3.5630 (1.04)     0.0000 (1.0)           0;0  0.2807 (0.97)          1           1
test_partial_remove-add[3.10.0]     3.5318 (1.03)     3.5318 (1.03)     3.5318 (1.03)     0.0000 (1.0)      3.5318 (1.03)     0.0000 (1.0)           0;0  0.2831 (0.97)          1           1
test_partial_remove-add[main]       3.4418 (1.0)      3.4418 (1.0)      3.4418 (1.0)      0.0000 (1.0)      3.4418 (1.0)      0.0000 (1.0)           0;0  0.2905 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[3.0.0]      1.4318 (1.00)     1.4318 (1.00)     1.4318 (1.00)     0.0000 (1.0)      1.4318 (1.00)     0.0000 (1.0)           0;0  0.6984 (1.00)          1           1
test_partial_remove-add-update[3.10.0]     1.4352 (1.01)     1.4352 (1.01)     1.4352 (1.01)     0.0000 (1.0)      1.4352 (1.01)     0.0000 (1.0)           0;0  0.6968 (0.99)          1           1
test_partial_remove-add-update[main]       1.4253 (1.0)      1.4253 (1.0)      1.4253 (1.0)      0.0000 (1.0)      1.4253 (1.0)      0.0000 (1.0)           0;0  0.7016 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[3.0.0]      525.9376 (1.0)      525.9376 (1.0)      525.9376 (1.0)      0.0000 (1.0)      525.9376 (1.0)      0.0000 (1.0)           0;0  1.9014 (1.0)           1           1
test_partial_remove-gc[3.10.0]     545.5931 (1.04)     545.5931 (1.04)     545.5931 (1.04)     0.0000 (1.0)      545.5931 (1.04)     0.0000 (1.0)           0;0  1.8329 (0.96)          1           1
test_partial_remove-gc[main]       538.2363 (1.02)     538.2363 (1.02)     538.2363 (1.02)     0.0000 (1.0)      538.2363 (1.02)     0.0000 (1.0)           0;0  1.8579 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[3.0.0]      589.1484 (1.0)      589.1484 (1.0)      589.1484 (1.0)      0.0000 (1.0)      589.1484 (1.0)      0.0000 (1.0)           0;0  1.6974 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     590.7086 (1.00)     590.7086 (1.00)     590.7086 (1.00)     0.0000 (1.0)      590.7086 (1.00)     0.0000 (1.0)           0;0  1.6929 (1.00)          1           1
test_partial_remove-gc-cloud[main]       631.1381 (1.07)     631.1381 (1.07)     631.1381 (1.07)     0.0000 (1.0)      631.1381 (1.07)     0.0000 (1.0)           0;0  1.5844 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[3.0.0]      1.8842 (1.27)     1.8842 (1.27)     1.8842 (1.27)     0.0000 (1.0)      1.8842 (1.27)     0.0000 (1.0)           0;0  0.5307 (0.79)          1           1
test_partial_remove-push[3.10.0]     1.9033 (1.28)     1.9033 (1.28)     1.9033 (1.28)     0.0000 (1.0)      1.9033 (1.28)     0.0000 (1.0)           0;0  0.5254 (0.78)          1           1
test_partial_remove-push[main]       1.4869 (1.0)      1.4869 (1.0)      1.4869 (1.0)      0.0000 (1.0)      1.4869 (1.0)      0.0000 (1.0)           0;0  0.6726 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[3.0.0]      470.8457 (1.02)     470.8457 (1.02)     470.8457 (1.02)     0.0000 (1.0)      470.8457 (1.02)     0.0000 (1.0)           0;0  2.1238 (0.98)          1           1
test_partial_remove-push-update[3.10.0]     462.0327 (1.0)      462.0327 (1.0)      462.0327 (1.0)      0.0000 (1.0)      462.0327 (1.0)      0.0000 (1.0)           0;0  2.1643 (1.0)           1           1
test_partial_remove-push-update[main]       787.7829 (1.71)     787.7829 (1.71)     787.7829 (1.71)     0.0000 (1.0)      787.7829 (1.71)     0.0000 (1.0)           0;0  1.2694 (0.59)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[3.0.0]      838.9052 (1.03)     858.6640 (1.02)     851.1303 (1.03)      8.5316 (1.0)      853.2286 (1.03)     14.2578 (1.0)           1;0  1.1749 (0.98)          5           3
test_plots-plots-diff[3.10.0]     839.3603 (1.03)     875.3406 (1.04)     855.5089 (1.03)     13.0832 (1.53)     854.8047 (1.03)     14.3694 (1.01)          2;0  1.1689 (0.97)          5           3
test_plots-plots-diff[main]       816.2382 (1.0)      845.0689 (1.0)      830.2685 (1.0)      11.1136 (1.30)     831.4010 (1.0)      16.3964 (1.15)          2;0  1.2044 (1.0)           5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[3.0.0]      1.1113 (1.24)     1.1187 (1.23)     1.1143 (1.23)     0.0035 (1.0)      1.1123 (1.22)     0.0063 (1.0)           1;0  0.8974 (0.81)          5           3
test_plots-plots-diff-json[3.10.0]     1.1127 (1.24)     1.1344 (1.24)     1.1239 (1.24)     0.0094 (2.64)     1.1244 (1.24)     0.0168 (2.68)          2;0  0.8898 (0.81)          5           3
test_plots-plots-diff-json[main]       0.8966 (1.0)      0.9117 (1.0)      0.9063 (1.0)      0.0067 (1.88)     0.9102 (1.0)      0.0103 (1.64)          1;0  1.1034 (1.0)           5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[3.0.0]      706.8667 (1.00)     725.2097 (1.0)      719.0997 (1.01)     7.5554 (1.0)      723.0995 (1.02)      9.6844 (1.0)           1;0  1.3906 (0.99)          5           3
test_plots-plots-show[3.10.0]     708.9317 (1.00)     726.0035 (1.00)     717.6583 (1.00)     7.8457 (1.04)     717.7656 (1.01)     14.8945 (1.54)          2;0  1.3934 (1.00)          5           3
test_plots-plots-show[main]       706.7501 (1.0)      726.3535 (1.00)     714.1025 (1.0)      9.2970 (1.23)     707.7762 (1.0)      15.5367 (1.60)          1;0  1.4004 (1.0)           5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[3.0.0]      854.0646 (1.13)     883.7620 (1.14)     865.9196 (1.13)     13.2250 (1.44)     859.8202 (1.12)     22.5549 (1.50)          1;0  1.1548 (0.89)          5           3
test_plots-plots-show-json[3.10.0]     863.5055 (1.14)     889.5024 (1.15)     871.8503 (1.14)     10.9352 (1.19)     867.2078 (1.13)     15.0278 (1.0)           1;0  1.1470 (0.88)          5           3
test_plots-plots-show-json[main]       756.8819 (1.0)      776.5855 (1.0)      766.5615 (1.0)       9.1997 (1.0)      765.6631 (1.0)      17.6274 (1.17)          2;0  1.3045 (1.0)           5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[3.0.0]      1.9112 (1.24)     1.9112 (1.24)     1.9112 (1.24)     0.0000 (1.0)      1.9112 (1.24)     0.0000 (1.0)           0;0  0.5232 (0.81)          1           1
test_push-push[3.10.0]     1.9094 (1.23)     1.9094 (1.23)     1.9094 (1.23)     0.0000 (1.0)      1.9094 (1.23)     0.0000 (1.0)           0;0  0.5237 (0.81)          1           1
test_push-push[main]       1.5475 (1.0)      1.5475 (1.0)      1.5475 (1.0)      0.0000 (1.0)      1.5475 (1.0)      0.0000 (1.0)           0;0  0.6462 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[3.0.0]      3.5493 (1.03)     3.5493 (1.03)     3.5493 (1.03)     0.0000 (1.0)      3.5493 (1.03)     0.0000 (1.0)           0;0  0.2817 (0.97)          1           1
test_sharing-add[3.10.0]     3.4909 (1.02)     3.4909 (1.02)     3.4909 (1.02)     0.0000 (1.0)      3.4909 (1.02)     0.0000 (1.0)           0;0  0.2865 (0.98)          1           1
test_sharing-add[main]       3.4339 (1.0)      3.4339 (1.0)      3.4339 (1.0)      0.0000 (1.0)      3.4339 (1.0)      0.0000 (1.0)           0;0  0.2912 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[3.0.0]      2.4092 (1.04)     2.4092 (1.04)     2.4092 (1.04)     0.0000 (1.0)      2.4092 (1.04)     0.0000 (1.0)           0;0  0.4151 (0.97)          1           1
test_sharing-add-noop[3.10.0]     2.4088 (1.04)     2.4088 (1.04)     2.4088 (1.04)     0.0000 (1.0)      2.4088 (1.04)     0.0000 (1.0)           0;0  0.4151 (0.97)          1           1
test_sharing-add-noop[main]       2.3263 (1.0)      2.3263 (1.0)      2.3263 (1.0)      0.0000 (1.0)      2.3263 (1.0)      0.0000 (1.0)           0;0  0.4299 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[3.0.0]      3.6595 (2.60)     3.6595 (2.60)     3.6595 (2.60)     0.0000 (1.0)      3.6595 (2.60)     0.0000 (1.0)           0;0  0.2733 (0.39)          1           1
test_sharing-checkout[3.10.0]     3.6869 (2.62)     3.6869 (2.62)     3.6869 (2.62)     0.0000 (1.0)      3.6869 (2.62)     0.0000 (1.0)           0;0  0.2712 (0.38)          1           1
test_sharing-checkout[main]       1.4091 (1.0)      1.4091 (1.0)      1.4091 (1.0)      0.0000 (1.0)      1.4091 (1.0)      0.0000 (1.0)           0;0  0.7097 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[3.0.0]      564.6873 (1.01)     564.6873 (1.01)     564.6873 (1.01)     0.0000 (1.0)      564.6873 (1.01)     0.0000 (1.0)           0;0  1.7709 (0.99)          1           1
test_sharing-checkout-noop[3.10.0]     576.9559 (1.03)     576.9559 (1.03)     576.9559 (1.03)     0.0000 (1.0)      576.9559 (1.03)     0.0000 (1.0)           0;0  1.7332 (0.97)          1           1
test_sharing-checkout-noop[main]       558.1729 (1.0)      558.1729 (1.0)      558.1729 (1.0)      0.0000 (1.0)      558.1729 (1.0)      0.0000 (1.0)           0;0  1.7916 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[3.0.0]      4.1671 (2.30)     4.1671 (2.30)     4.1671 (2.30)     0.0000 (1.0)      4.1671 (2.30)     0.0000 (1.0)           0;0  0.2400 (0.43)          1           1
test_sharing-fetch[3.10.0]     4.2084 (2.32)     4.2084 (2.32)     4.2084 (2.32)     0.0000 (1.0)      4.2084 (2.32)     0.0000 (1.0)           0;0  0.2376 (0.43)          1           1
test_sharing-fetch[main]       1.8120 (1.0)      1.8120 (1.0)      1.8120 (1.0)      0.0000 (1.0)      1.8120 (1.0)      0.0000 (1.0)           0;0  0.5519 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[3.0.0]      489.7112 (1.0)      489.7112 (1.0)      489.7112 (1.0)      0.0000 (1.0)      489.7112 (1.0)      0.0000 (1.0)           0;0  2.0420 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     491.3401 (1.00)     491.3401 (1.00)     491.3401 (1.00)     0.0000 (1.0)      491.3401 (1.00)     0.0000 (1.0)           0;0  2.0353 (1.00)          1           1
test_sharing-fetch-noop[main]       771.9500 (1.58)     771.9500 (1.58)     771.9500 (1.58)     0.0000 (1.0)      771.9500 (1.58)     0.0000 (1.0)           0;0  1.2954 (0.63)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[3.0.0]      1.9213 (1.33)     1.9213 (1.33)     1.9213 (1.33)     0.0000 (1.0)      1.9213 (1.33)     0.0000 (1.0)           0;0  0.5205 (0.75)          1           1
test_sharing-push[3.10.0]     2.0081 (1.39)     2.0081 (1.39)     2.0081 (1.39)     0.0000 (1.0)      2.0081 (1.39)     0.0000 (1.0)           0;0  0.4980 (0.72)          1           1
test_sharing-push[main]       1.4490 (1.0)      1.4490 (1.0)      1.4490 (1.0)      0.0000 (1.0)      1.4490 (1.0)      0.0000 (1.0)           0;0  0.6901 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[3.0.0]      429.7856 (1.0)      429.7856 (1.0)      429.7856 (1.0)      0.0000 (1.0)      429.7856 (1.0)      0.0000 (1.0)           0;0  2.3267 (1.0)           1           1
test_sharing-push-noop[3.10.0]     438.4853 (1.02)     438.4853 (1.02)     438.4853 (1.02)     0.0000 (1.0)      438.4853 (1.02)     0.0000 (1.0)           0;0  2.2806 (0.98)          1           1
test_sharing-push-noop[main]       789.6493 (1.84)     789.6493 (1.84)     789.6493 (1.84)     0.0000 (1.0)      789.6493 (1.84)     0.0000 (1.0)           0;0  1.2664 (0.54)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[3.0.0]      1.2170 (1.0)      1.2170 (1.0)      1.2170 (1.0)      0.0000 (1.0)      1.2170 (1.0)      0.0000 (1.0)           0;0  0.8217 (1.0)           1           1
test_status-status[3.10.0]     1.2478 (1.03)     1.2478 (1.03)     1.2478 (1.03)     0.0000 (1.0)      1.2478 (1.03)     0.0000 (1.0)           0;0  0.8014 (0.98)          1           1
test_status-status[main]       1.2334 (1.01)     1.2334 (1.01)     1.2334 (1.01)     0.0000 (1.0)      1.2334 (1.01)     0.0000 (1.0)           0;0  0.8107 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[3.0.0]      580.7630 (1.04)     580.7630 (1.04)     580.7630 (1.04)     0.0000 (1.0)      580.7630 (1.04)     0.0000 (1.0)           0;0  1.7219 (0.96)          1           1
test_status-status-changed[3.10.0]     582.3173 (1.04)     582.3173 (1.04)     582.3173 (1.04)     0.0000 (1.0)      582.3173 (1.04)     0.0000 (1.0)           0;0  1.7173 (0.96)          1           1
test_status-status-changed[main]       557.5736 (1.0)      557.5736 (1.0)      557.5736 (1.0)      0.0000 (1.0)      557.5736 (1.0)      0.0000 (1.0)           0;0  1.7935 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[3.0.0]      543.0223 (1.0)      543.0223 (1.0)      543.0223 (1.0)      0.0000 (1.0)      543.0223 (1.0)      0.0000 (1.0)           0;0  1.8415 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     585.5426 (1.08)     585.5426 (1.08)     585.5426 (1.08)     0.0000 (1.0)      585.5426 (1.08)     0.0000 (1.0)           0;0  1.7078 (0.93)          1           1
test_status-status-changed-noop[main]       572.4612 (1.05)     572.4612 (1.05)     572.4612 (1.05)     0.0000 (1.0)      572.4612 (1.05)     0.0000 (1.0)           0;0  1.7468 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[3.0.0]      540.4026 (1.0)      540.4026 (1.0)      540.4026 (1.0)      0.0000 (1.0)      540.4026 (1.0)      0.0000 (1.0)           0;0  1.8505 (1.0)           1           1
test_status-status-noop[3.10.0]     556.1284 (1.03)     556.1284 (1.03)     556.1284 (1.03)     0.0000 (1.0)      556.1284 (1.03)     0.0000 (1.0)           0;0  1.7981 (0.97)          1           1
test_status-status-noop[main]       558.8482 (1.03)     558.8482 (1.03)     558.8482 (1.03)     0.0000 (1.0)      558.8482 (1.03)     0.0000 (1.0)           0;0  1.7894 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[3.0.0]      7.3738 (1.43)     7.3738 (1.43)     7.3738 (1.43)     0.0000 (1.0)      7.3738 (1.43)     0.0000 (1.0)           0;0  0.1356 (0.70)          1           1
test_update-import-url[3.10.0]     7.5153 (1.46)     7.5153 (1.46)     7.5153 (1.46)     0.0000 (1.0)      7.5153 (1.46)     0.0000 (1.0)           0;0  0.1331 (0.69)          1           1
test_update-import-url[main]       5.1588 (1.0)      5.1588 (1.0)      5.1588 (1.0)      0.0000 (1.0)      5.1588 (1.0)      0.0000 (1.0)           0;0  0.1938 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[3.0.0]      6.6379 (1.51)     6.6379 (1.51)     6.6379 (1.51)     0.0000 (1.0)      6.6379 (1.51)     0.0000 (1.0)           0;0  0.1507 (0.66)          1           1
test_update-update[3.10.0]     6.7166 (1.53)     6.7166 (1.53)     6.7166 (1.53)     0.0000 (1.0)      6.7166 (1.53)     0.0000 (1.0)           0;0  0.1489 (0.65)          1           1
test_update-update[main]       4.3914 (1.0)      4.3914 (1.0)      4.3914 (1.0)      0.0000 (1.0)      4.3914 (1.0)      0.0000 (1.0)           0;0  0.2277 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[3.0.0]      949.9172 (1.0)      949.9172 (1.0)      949.9172 (1.0)      0.0000 (1.0)      949.9172 (1.0)      0.0000 (1.0)           0;0  1.0527 (1.0)           1           1
test_update-update-noop[3.10.0]     986.3810 (1.04)     986.3810 (1.04)     986.3810 (1.04)     0.0000 (1.0)      986.3810 (1.04)     0.0000 (1.0)           0;0  1.0138 (0.96)          1           1
test_update-update-noop[main]       967.4628 (1.02)     967.4628 (1.02)     967.4628 (1.02)     0.0000 (1.0)      967.4628 (1.02)     0.0000 (1.0)           0;0  1.0336 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean