iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

build(deps): bump actions/upload-pages-artifact from 2 to 3 #506

Closed dependabot[bot] closed 4 months ago

dependabot[bot] commented 7 months ago

Bumps actions/upload-pages-artifact from 2 to 3.

Release notes

Sourced from actions/upload-pages-artifact's releases.

v3.0.0

Changelog

To deploy a GitHub Pages site which has been uploaded with his version of actions/upload-pages-artifact, you must also use actions/deploy-pages@v4 or newer.

See details of all code changes since previous release.

Commits
  • 0252fc4 Merge pull request #81 from actions/artifacts-next
  • 2a5c144 Use actions/download-artifact@v4 in test
  • 7e3f6bb Merge pull request #80 from robherley/patch-1
  • 257e666 Use v4 upload-artifact tag
  • 0313a19 Merge pull request #78 from konradpabjan/main
  • 1228e65 Update action.yml
  • eb31309 Update artifact names in tests
  • 241a975 Correct artifact name during download
  • ef95519 Unique artifact name per job
  • ecdd3ed Switch to using download@v4-beta
  • Additional commits viewable in compare view


Dependabot compatibility score

You can trigger a rebase of this PR by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Note Automatic rebases have been disabled on this pull request as it has been open for over 30 days.

github-actions[bot] commented 7 months ago

Wed Dec 20 09:16:14 UTC 2023
dataset: small
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     3.6422 (1.06)     3.6422 (1.06)     3.6422 (1.06)     0.0000 (1.0)      3.6422 (1.06)     0.0000 (1.0)           0;0  0.2746 (0.94)          1           1
test_add-add[3.10.0]     3.6238 (1.06)     3.6238 (1.06)     3.6238 (1.06)     0.0000 (1.0)      3.6238 (1.06)     0.0000 (1.0)           0;0  0.2760 (0.95)          1           1
test_add-add[main]       3.4315 (1.0)      3.4315 (1.0)      3.4315 (1.0)      0.0000 (1.0)      3.4315 (1.0)      0.0000 (1.0)           0;0  0.2914 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     1.8950 (1.20)     1.8950 (1.20)     1.8950 (1.20)     0.0000 (1.0)      1.8950 (1.20)     0.0000 (1.0)           0;0  0.5277 (0.83)          1           1
test_checkout_copy-checkout[3.10.0]     3.8217 (2.42)     3.8217 (2.42)     3.8217 (2.42)     0.0000 (1.0)      3.8217 (2.42)     0.0000 (1.0)           0;0  0.2617 (0.41)          1           1
test_checkout_copy-checkout[main]       1.5761 (1.0)      1.5761 (1.0)      1.5761 (1.0)      0.0000 (1.0)      1.5761 (1.0)      0.0000 (1.0)           0;0  0.6345 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     551.8632 (1.0)      551.8632 (1.0)      551.8632 (1.0)      0.0000 (1.0)      551.8632 (1.0)      0.0000 (1.0)           0;0  1.8120 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     573.3123 (1.04)     573.3123 (1.04)     573.3123 (1.04)     0.0000 (1.0)      573.3123 (1.04)     0.0000 (1.0)           0;0  1.7443 (0.96)          1           1
test_checkout_copy-checkout-noop[main]       562.3939 (1.02)     562.3939 (1.02)     562.3939 (1.02)     0.0000 (1.0)      562.3939 (1.02)     0.0000 (1.0)           0;0  1.7781 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     685.8551 (1.13)     685.8551 (1.13)     685.8551 (1.13)     0.0000 (1.0)      685.8551 (1.13)     0.0000 (1.0)           0;0  1.4580 (0.89)          1           1
test_checkout_copy-checkout-update[3.10.0]     622.3623 (1.02)     622.3623 (1.02)     622.3623 (1.02)     0.0000 (1.0)      622.3623 (1.02)     0.0000 (1.0)           0;0  1.6068 (0.98)          1           1
test_checkout_copy-checkout-update[main]       608.9691 (1.0)      608.9691 (1.0)      608.9691 (1.0)      0.0000 (1.0)      608.9691 (1.0)      0.0000 (1.0)           0;0  1.6421 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     1.2323 (1.17)     1.2323 (1.17)     1.2323 (1.17)     0.0000 (1.0)      1.2323 (1.17)     0.0000 (1.0)           0;0  0.8115 (0.85)          1           1
test_checkout_hardlink-checkout[3.10.0]     1.0885 (1.04)     1.0885 (1.04)     1.0885 (1.04)     0.0000 (1.0)      1.0885 (1.04)     0.0000 (1.0)           0;0  0.9187 (0.96)          1           1
test_checkout_hardlink-checkout[main]       1.0495 (1.0)      1.0495 (1.0)      1.0495 (1.0)      0.0000 (1.0)      1.0495 (1.0)      0.0000 (1.0)           0;0  0.9528 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     546.7706 (1.0)      546.7706 (1.0)      546.7706 (1.0)      0.0000 (1.0)      546.7706 (1.0)      0.0000 (1.0)           0;0  1.8289 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     571.2488 (1.04)     571.2488 (1.04)     571.2488 (1.04)     0.0000 (1.0)      571.2488 (1.04)     0.0000 (1.0)           0;0  1.7506 (0.96)          1           1
test_checkout_hardlink-checkout-noop[main]       554.2256 (1.01)     554.2256 (1.01)     554.2256 (1.01)     0.0000 (1.0)      554.2256 (1.01)     0.0000 (1.0)           0;0  1.8043 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     693.2858 (1.16)     693.2858 (1.16)     693.2858 (1.16)     0.0000 (1.0)      693.2858 (1.16)     0.0000 (1.0)           0;0  1.4424 (0.86)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     637.3953 (1.06)     637.3953 (1.06)     637.3953 (1.06)     0.0000 (1.0)      637.3953 (1.06)     0.0000 (1.0)           0;0  1.5689 (0.94)          1           1
test_checkout_hardlink-checkout-update[main]       599.5773 (1.0)      599.5773 (1.0)      599.5773 (1.0)      0.0000 (1.0)      599.5773 (1.0)      0.0000 (1.0)           0;0  1.6678 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     1.3241 (1.13)     1.3241 (1.13)     1.3241 (1.13)     0.0000 (1.0)      1.3241 (1.13)     0.0000 (1.0)           0;0  0.7552 (0.88)          1           1
test_checkout_symlink-checkout[3.10.0]     1.2423 (1.06)     1.2423 (1.06)     1.2423 (1.06)     0.0000 (1.0)      1.2423 (1.06)     0.0000 (1.0)           0;0  0.8050 (0.94)          1           1
test_checkout_symlink-checkout[main]       1.1716 (1.0)      1.1716 (1.0)      1.1716 (1.0)      0.0000 (1.0)      1.1716 (1.0)      0.0000 (1.0)           0;0  0.8535 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     600.2245 (1.0)      600.2245 (1.0)      600.2245 (1.0)      0.0000 (1.0)      600.2245 (1.0)      0.0000 (1.0)           0;0  1.6660 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     641.1920 (1.07)     641.1920 (1.07)     641.1920 (1.07)     0.0000 (1.0)      641.1920 (1.07)     0.0000 (1.0)           0;0  1.5596 (0.94)          1           1
test_checkout_symlink-checkout-noop[main]       600.5903 (1.00)     600.5903 (1.00)     600.5903 (1.00)     0.0000 (1.0)      600.5903 (1.00)     0.0000 (1.0)           0;0  1.6650 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     782.8085 (1.13)     782.8085 (1.13)     782.8085 (1.13)     0.0000 (1.0)      782.8085 (1.13)     0.0000 (1.0)           0;0  1.2775 (0.89)          1           1
test_checkout_symlink-checkout-update[3.10.0]     726.7985 (1.05)     726.7985 (1.05)     726.7985 (1.05)     0.0000 (1.0)      726.7985 (1.05)     0.0000 (1.0)           0;0  1.3759 (0.95)          1           1
test_checkout_symlink-checkout-update[main]       693.7201 (1.0)      693.7201 (1.0)      693.7201 (1.0)      0.0000 (1.0)      693.7201 (1.0)      0.0000 (1.0)           0;0  1.4415 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     576.2192 (1.04)     576.2192 (1.04)     576.2192 (1.04)     0.0000 (1.0)      576.2192 (1.04)     0.0000 (1.0)           0;0  1.7355 (0.97)          1           1
test_data_status-data-changed[3.10.0]     563.3615 (1.01)     563.3615 (1.01)     563.3615 (1.01)     0.0000 (1.0)      563.3615 (1.01)     0.0000 (1.0)           0;0  1.7751 (0.99)          1           1
test_data_status-data-changed[main]       556.1210 (1.0)      556.1210 (1.0)      556.1210 (1.0)      0.0000 (1.0)      556.1210 (1.0)      0.0000 (1.0)           0;0  1.7982 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     587.3643 (1.05)     587.3643 (1.05)     587.3643 (1.05)     0.0000 (1.0)      587.3643 (1.05)     0.0000 (1.0)           0;0  1.7025 (0.95)          1           1
test_data_status-data-changed-noop[3.10.0]     568.6839 (1.02)     568.6839 (1.02)     568.6839 (1.02)     0.0000 (1.0)      568.6839 (1.02)     0.0000 (1.0)           0;0  1.7584 (0.98)          1           1
test_data_status-data-changed-noop[main]       559.2321 (1.0)      559.2321 (1.0)      559.2321 (1.0)      0.0000 (1.0)      559.2321 (1.0)      0.0000 (1.0)           0;0  1.7882 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     1.2453 (1.04)     1.2453 (1.04)     1.2453 (1.04)     0.0000 (1.0)      1.2453 (1.04)     0.0000 (1.0)           0;0  0.8030 (0.96)          1           1
test_data_status-data-new[3.10.0]     1.2471 (1.04)     1.2471 (1.04)     1.2471 (1.04)     0.0000 (1.0)      1.2471 (1.04)     0.0000 (1.0)           0;0  0.8019 (0.96)          1           1
test_data_status-data-new[main]       1.1986 (1.0)      1.1986 (1.0)      1.1986 (1.0)      0.0000 (1.0)      1.1986 (1.0)      0.0000 (1.0)           0;0  0.8343 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     585.6928 (1.05)     585.6928 (1.05)     585.6928 (1.05)     0.0000 (1.0)      585.6928 (1.05)     0.0000 (1.0)           0;0  1.7074 (0.96)          1           1
test_data_status-data-noop[3.10.0]     573.0231 (1.02)     573.0231 (1.02)     573.0231 (1.02)     0.0000 (1.0)      573.0231 (1.02)     0.0000 (1.0)           0;0  1.7451 (0.98)          1           1
test_data_status-data-noop[main]       559.5328 (1.0)      559.5328 (1.0)      559.5328 (1.0)      0.0000 (1.0)      559.5328 (1.0)      0.0000 (1.0)           0;0  1.7872 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     1.0666 (1.03)     1.0666 (1.03)     1.0666 (1.03)     0.0000 (1.0)      1.0666 (1.03)     0.0000 (1.0)           0;0  0.9375 (0.97)          1           1
test_data_status_all_flags-data-changed[3.10.0]     1.0843 (1.05)     1.0843 (1.05)     1.0843 (1.05)     0.0000 (1.0)      1.0843 (1.05)     0.0000 (1.0)           0;0  0.9223 (0.95)          1           1
test_data_status_all_flags-data-changed[main]       1.0326 (1.0)      1.0326 (1.0)      1.0326 (1.0)      0.0000 (1.0)      1.0326 (1.0)      0.0000 (1.0)           0;0  0.9685 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     1.0942 (1.06)     1.0942 (1.06)     1.0942 (1.06)     0.0000 (1.0)      1.0942 (1.06)     0.0000 (1.0)           0;0  0.9139 (0.94)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     1.0521 (1.02)     1.0521 (1.02)     1.0521 (1.02)     0.0000 (1.0)      1.0521 (1.02)     0.0000 (1.0)           0;0  0.9505 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       1.0318 (1.0)      1.0318 (1.0)      1.0318 (1.0)      0.0000 (1.0)      1.0318 (1.0)      0.0000 (1.0)           0;0  0.9692 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     1.7029 (1.00)     1.7029 (1.00)     1.7029 (1.00)     0.0000 (1.0)      1.7029 (1.00)     0.0000 (1.0)           0;0  0.5872 (1.00)          1           1
test_data_status_all_flags-data-new[3.10.0]     1.8137 (1.07)     1.8137 (1.07)     1.8137 (1.07)     0.0000 (1.0)      1.8137 (1.07)     0.0000 (1.0)           0;0  0.5514 (0.94)          1           1
test_data_status_all_flags-data-new[main]       1.6969 (1.0)      1.6969 (1.0)      1.6969 (1.0)      0.0000 (1.0)      1.6969 (1.0)      0.0000 (1.0)           0;0  0.5893 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     1.0151 (1.01)     1.0151 (1.01)     1.0151 (1.01)     0.0000 (1.0)      1.0151 (1.01)     0.0000 (1.0)           0;0  0.9852 (0.99)          1           1
test_data_status_all_flags-data-noop[3.10.0]     1.0347 (1.03)     1.0347 (1.03)     1.0347 (1.03)     0.0000 (1.0)      1.0347 (1.03)     0.0000 (1.0)           0;0  0.9665 (0.98)          1           1
test_data_status_all_flags-data-noop[main]       1.0092 (1.0)      1.0092 (1.0)      1.0092 (1.0)      0.0000 (1.0)      1.0092 (1.0)      0.0000 (1.0)           0;0  0.9908 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     1.2062 (1.0)      1.2062 (1.0)      1.2062 (1.0)      0.0000 (1.0)      1.2062 (1.0)      0.0000 (1.0)           0;0  0.8291 (1.0)           1           1
test_diff-diff[3.10.0]     1.2548 (1.04)     1.2548 (1.04)     1.2548 (1.04)     0.0000 (1.0)      1.2548 (1.04)     0.0000 (1.0)           0;0  0.7969 (0.96)          1           1
test_diff-diff[main]       1.2532 (1.04)     1.2532 (1.04)     1.2532 (1.04)     0.0000 (1.0)      1.2532 (1.04)     0.0000 (1.0)           0;0  0.7979 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     634.5361 (1.04)     634.5361 (1.04)     634.5361 (1.04)     0.0000 (1.0)      634.5361 (1.04)     0.0000 (1.0)           0;0  1.5760 (0.96)          1           1
test_diff-diff-changed[3.10.0]     657.2509 (1.08)     657.2509 (1.08)     657.2509 (1.08)     0.0000 (1.0)      657.2509 (1.08)     0.0000 (1.0)           0;0  1.5215 (0.93)          1           1
test_diff-diff-changed[main]       608.9075 (1.0)      608.9075 (1.0)      608.9075 (1.0)      0.0000 (1.0)      608.9075 (1.0)      0.0000 (1.0)           0;0  1.6423 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     602.0699 (1.00)     602.0699 (1.00)     602.0699 (1.00)     0.0000 (1.0)      602.0699 (1.00)     0.0000 (1.0)           0;0  1.6609 (1.00)          1           1
test_diff-diff-changed-noop[3.10.0]     636.9879 (1.06)     636.9879 (1.06)     636.9879 (1.06)     0.0000 (1.0)      636.9879 (1.06)     0.0000 (1.0)           0;0  1.5699 (0.95)          1           1
test_diff-diff-changed-noop[main]       601.9632 (1.0)      601.9632 (1.0)      601.9632 (1.0)      0.0000 (1.0)      601.9632 (1.0)      0.0000 (1.0)           0;0  1.6612 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     578.1698 (1.0)      578.1698 (1.0)      578.1698 (1.0)      0.0000 (1.0)      578.1698 (1.0)      0.0000 (1.0)           0;0  1.7296 (1.0)           1           1
test_diff-diff-noop[3.10.0]     592.6052 (1.02)     592.6052 (1.02)     592.6052 (1.02)     0.0000 (1.0)      592.6052 (1.02)     0.0000 (1.0)           0;0  1.6875 (0.98)          1           1
test_diff-diff-noop[main]       595.6648 (1.03)     595.6648 (1.03)     595.6648 (1.03)     0.0000 (1.0)      595.6648 (1.03)     0.0000 (1.0)           0;0  1.6788 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       852.7428 (1.0)        852.7428 (1.0)        852.7428 (1.0)      0.0000 (1.0)        852.7428 (1.0)      0.0000 (1.0)           0;0  1.1727 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,672.6904 (5.48)     4,672.6904 (5.48)     4,672.6904 (5.48)     0.0000 (1.0)      4,672.6904 (5.48)     0.0000 (1.0)           0;0  0.2140 (0.18)          1           1
test_exp_show-exp[main]       4,249.2868 (4.98)     4,249.2868 (4.98)     4,249.2868 (4.98)     0.0000 (1.0)      4,249.2868 (4.98)     0.0000 (1.0)           0;0  0.2353 (0.20)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     3.9540 (2.15)     3.9540 (2.15)     3.9540 (2.15)     0.0000 (1.0)      3.9540 (2.15)     0.0000 (1.0)           0;0  0.2529 (0.47)          1           1
test_fetch-fetch[3.10.0]     4.3918 (2.38)     4.3918 (2.38)     4.3918 (2.38)     0.0000 (1.0)      4.3918 (2.38)     0.0000 (1.0)           0;0  0.2277 (0.42)          1           1
test_fetch-fetch[main]       1.8425 (1.0)      1.8425 (1.0)      1.8425 (1.0)      0.0000 (1.0)      1.8425 (1.0)      0.0000 (1.0)           0;0  0.5427 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     482.0328 (1.05)     482.0328 (1.05)     482.0328 (1.05)     0.0000 (1.0)      482.0328 (1.05)     0.0000 (1.0)           0;0  2.0745 (0.95)          1           1
test_gc-gc[3.10.0]     525.1255 (1.14)     525.1255 (1.14)     525.1255 (1.14)     0.0000 (1.0)      525.1255 (1.14)     0.0000 (1.0)           0;0  1.9043 (0.87)          1           1
test_gc-gc[main]       459.2626 (1.0)      459.2626 (1.0)      459.2626 (1.0)      0.0000 (1.0)      459.2626 (1.0)      0.0000 (1.0)           0;0  2.1774 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     5.9576 (1.09)     5.9576 (1.09)     5.9576 (1.09)     0.0000 (1.0)      5.9576 (1.09)     0.0000 (1.0)           0;0  0.1679 (0.92)          1           1
test_get-get[3.10.0]     7.0401 (1.29)     7.0401 (1.29)     7.0401 (1.29)     0.0000 (1.0)      7.0401 (1.29)     0.0000 (1.0)           0;0  0.1420 (0.77)          1           1
test_get-get[main]       5.4550 (1.0)      5.4550 (1.0)      5.4550 (1.0)      0.0000 (1.0)      5.4550 (1.0)      0.0000 (1.0)           0;0  0.1833 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     3.0689 (3.18)     3.0689 (3.18)     3.0689 (3.18)     0.0000 (1.0)      3.0689 (3.18)     0.0000 (1.0)           0;0  0.3259 (0.31)          1           1
test_get_url-get-url[3.10.0]     3.1263 (3.24)     3.1263 (3.24)     3.1263 (3.24)     0.0000 (1.0)      3.1263 (3.24)     0.0000 (1.0)           0;0  0.3199 (0.31)          1           1
test_get_url-get-url[main]       0.9662 (1.0)      0.9662 (1.0)      0.9662 (1.0)      0.0000 (1.0)      0.9662 (1.0)      0.0000 (1.0)           0;0  1.0350 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.2765 (1.02)     150.1385 (1.12)     128.9226 (1.02)     2.4015 (1.75)     128.4515 (1.02)     1.1654 (1.0)           5;5  7.7566 (0.98)        100           1
test_help---help[3.10.0]     124.5010 (1.0)      134.1342 (1.0)      126.2764 (1.0)      1.3754 (1.0)      125.9822 (1.0)      1.2438 (1.07)         20;8  7.9191 (1.0)         100           1
test_help---help[main]       126.2189 (1.01)     135.0974 (1.01)     128.2916 (1.02)     1.5712 (1.14)     127.8176 (1.01)     2.0588 (1.77)         27;1  7.7947 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]      9.4931 (1.07)      9.4931 (1.07)      9.4931 (1.07)     0.0000 (1.0)       9.4931 (1.07)     0.0000 (1.0)           0;0  0.1053 (0.94)          1           1
test_import-import[3.10.0]     10.5803 (1.19)     10.5803 (1.19)     10.5803 (1.19)     0.0000 (1.0)      10.5803 (1.19)     0.0000 (1.0)           0;0  0.0945 (0.84)          1           1
test_import-import[main]        8.8911 (1.0)       8.8911 (1.0)       8.8911 (1.0)      0.0000 (1.0)       8.8911 (1.0)      0.0000 (1.0)           0;0  0.1125 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     7.4871 (1.45)     7.4871 (1.45)     7.4871 (1.45)     0.0000 (1.0)      7.4871 (1.45)     0.0000 (1.0)           0;0  0.1336 (0.69)          1           1
test_import_url-import-url[3.10.0]     7.5342 (1.46)     7.5342 (1.46)     7.5342 (1.46)     0.0000 (1.0)      7.5342 (1.46)     0.0000 (1.0)           0;0  0.1327 (0.68)          1           1
test_import_url-import-url[main]       5.1556 (1.0)      5.1556 (1.0)      5.1556 (1.0)      0.0000 (1.0)      5.1556 (1.0)      0.0000 (1.0)           0;0  0.1940 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     359.3836 (1.00)     386.1808 (1.01)     365.0214 (1.00)     4.5126 (1.0)      363.8195 (1.00)     3.4206 (1.0)          15;8  2.7396 (1.00)        100           1
test_init-init[3.10.0]     365.8841 (1.02)     417.6429 (1.09)     372.5096 (1.02)     5.9436 (1.32)     371.2578 (1.02)     5.0747 (1.48)          8;2  2.6845 (0.98)        100           1
test_init-init[main]       357.9063 (1.0)      382.9040 (1.0)      364.2564 (1.0)      4.7246 (1.05)     363.4508 (1.0)      4.1560 (1.22)         20;6  2.7453 (1.0)         100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     426.1726 (1.10)     426.1726 (1.10)     426.1726 (1.10)     0.0000 (1.0)      426.1726 (1.10)     0.0000 (1.0)           0;0  2.3465 (0.91)          1           1
test_list-list[3.10.0]     402.2934 (1.04)     402.2934 (1.04)     402.2934 (1.04)     0.0000 (1.0)      402.2934 (1.04)     0.0000 (1.0)           0;0  2.4857 (0.96)          1           1
test_list-list[main]       385.9034 (1.0)      385.9034 (1.0)      385.9034 (1.0)      0.0000 (1.0)      385.9034 (1.0)      0.0000 (1.0)           0;0  2.5913 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     408.2569 (1.10)     408.2569 (1.10)     408.2569 (1.10)     0.0000 (1.0)      408.2569 (1.10)     0.0000 (1.0)           0;0  2.4494 (0.91)          1           1
test_list-list-dvc-only[3.10.0]     386.2856 (1.04)     386.2856 (1.04)     386.2856 (1.04)     0.0000 (1.0)      386.2856 (1.04)     0.0000 (1.0)           0;0  2.5888 (0.96)          1           1
test_list-list-dvc-only[main]       371.4564 (1.0)      371.4564 (1.0)      371.4564 (1.0)      0.0000 (1.0)      371.4564 (1.0)      0.0000 (1.0)           0;0  2.6921 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     477.8847 (1.05)     477.8847 (1.05)     477.8847 (1.05)     0.0000 (1.0)      477.8847 (1.05)     0.0000 (1.0)           0;0  2.0926 (0.95)          1           1
test_list-list-recursive[3.10.0]     474.9598 (1.04)     474.9598 (1.04)     474.9598 (1.04)     0.0000 (1.0)      474.9598 (1.04)     0.0000 (1.0)           0;0  2.1054 (0.96)          1           1
test_list-list-recursive[main]       455.2072 (1.0)      455.2072 (1.0)      455.2072 (1.0)      0.0000 (1.0)      455.2072 (1.0)      0.0000 (1.0)           0;0  2.1968 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     396.3598 (1.06)     396.3598 (1.06)     396.3598 (1.06)     0.0000 (1.0)      396.3598 (1.06)     0.0000 (1.0)           0;0  2.5230 (0.94)          1           1
test_list-list-shallow[3.10.0]     388.8658 (1.04)     388.8658 (1.04)     388.8658 (1.04)     0.0000 (1.0)      388.8658 (1.04)     0.0000 (1.0)           0;0  2.5716 (0.96)          1           1
test_list-list-shallow[main]       374.5587 (1.0)      374.5587 (1.0)      374.5587 (1.0)      0.0000 (1.0)      374.5587 (1.0)      0.0000 (1.0)           0;0  2.6698 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     2.2547 (1.08)     2.2547 (1.08)     2.2547 (1.08)     0.0000 (1.0)      2.2547 (1.08)     0.0000 (1.0)           0;0  0.4435 (0.93)          1           1
test_partial_add-add[3.10.0]     2.1823 (1.05)     2.1823 (1.05)     2.1823 (1.05)     0.0000 (1.0)      2.1823 (1.05)     0.0000 (1.0)           0;0  0.4582 (0.96)          1           1
test_partial_add-add[main]       2.0859 (1.0)      2.0859 (1.0)      2.0859 (1.0)      0.0000 (1.0)      2.0859 (1.0)      0.0000 (1.0)           0;0  0.4794 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     3.2360 (1.06)     3.2360 (1.06)     3.2360 (1.06)     0.0000 (1.0)      3.2360 (1.06)     0.0000 (1.0)           0;0  0.3090 (0.94)          1           1
test_partial_add-add-partial[3.10.0]     3.1384 (1.03)     3.1384 (1.03)     3.1384 (1.03)     0.0000 (1.0)      3.1384 (1.03)     0.0000 (1.0)           0;0  0.3186 (0.97)          1           1
test_partial_add-add-partial[main]       3.0432 (1.0)      3.0432 (1.0)      3.0432 (1.0)      0.0000 (1.0)      3.0432 (1.0)      0.0000 (1.0)           0;0  0.3286 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     609.7649 (1.0)      609.7649 (1.0)      609.7649 (1.0)      0.0000 (1.0)      609.7649 (1.0)      0.0000 (1.0)           0;0  1.6400 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     685.5193 (1.12)     685.5193 (1.12)     685.5193 (1.12)     0.0000 (1.0)      685.5193 (1.12)     0.0000 (1.0)           0;0  1.4587 (0.89)          1           1
test_partial_add-gc-cloud-noop[main]       706.6763 (1.16)     706.6763 (1.16)     706.6763 (1.16)     0.0000 (1.0)      706.6763 (1.16)     0.0000 (1.0)           0;0  1.4151 (0.86)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     528.4123 (1.0)      528.4123 (1.0)      528.4123 (1.0)      0.0000 (1.0)      528.4123 (1.0)      0.0000 (1.0)           0;0  1.8925 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     613.4824 (1.16)     613.4824 (1.16)     613.4824 (1.16)     0.0000 (1.0)      613.4824 (1.16)     0.0000 (1.0)           0;0  1.6300 (0.86)          1           1
test_partial_add-gc-noop[main]       589.6249 (1.12)     589.6249 (1.12)     589.6249 (1.12)     0.0000 (1.0)      589.6249 (1.12)     0.0000 (1.0)           0;0  1.6960 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     2.0204 (1.78)     2.0204 (1.78)     2.0204 (1.78)     0.0000 (1.0)      2.0204 (1.78)     0.0000 (1.0)           0;0  0.4950 (0.56)          1           1
test_partial_add-push[3.10.0]     1.2045 (1.06)     1.2045 (1.06)     1.2045 (1.06)     0.0000 (1.0)      1.2045 (1.06)     0.0000 (1.0)           0;0  0.8302 (0.94)          1           1
test_partial_add-push[main]       1.1332 (1.0)      1.1332 (1.0)      1.1332 (1.0)      0.0000 (1.0)      1.1332 (1.0)      0.0000 (1.0)           0;0  0.8825 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     2.0716 (1.65)     2.0716 (1.65)     2.0716 (1.65)     0.0000 (1.0)      2.0716 (1.65)     0.0000 (1.0)           0;0  0.4827 (0.61)          1           1
test_partial_add-push-partial[3.10.0]     1.2949 (1.03)     1.2949 (1.03)     1.2949 (1.03)     0.0000 (1.0)      1.2949 (1.03)     0.0000 (1.0)           0;0  0.7722 (0.97)          1           1
test_partial_add-push-partial[main]       1.2538 (1.0)      1.2538 (1.0)      1.2538 (1.0)      0.0000 (1.0)      1.2538 (1.0)      0.0000 (1.0)           0;0  0.7976 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     3.5510 (1.04)     3.5510 (1.04)     3.5510 (1.04)     0.0000 (1.0)      3.5510 (1.04)     0.0000 (1.0)           0;0  0.2816 (0.96)          1           1
test_partial_remove-add[3.10.0]     3.5980 (1.05)     3.5980 (1.05)     3.5980 (1.05)     0.0000 (1.0)      3.5980 (1.05)     0.0000 (1.0)           0;0  0.2779 (0.95)          1           1
test_partial_remove-add[main]       3.4164 (1.0)      3.4164 (1.0)      3.4164 (1.0)      0.0000 (1.0)      3.4164 (1.0)      0.0000 (1.0)           0;0  0.2927 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     1.4297 (1.05)     1.4297 (1.05)     1.4297 (1.05)     0.0000 (1.0)      1.4297 (1.05)     0.0000 (1.0)           0;0  0.6995 (0.95)          1           1
test_partial_remove-add-update[3.10.0]     1.4484 (1.06)     1.4484 (1.06)     1.4484 (1.06)     0.0000 (1.0)      1.4484 (1.06)     0.0000 (1.0)           0;0  0.6904 (0.94)          1           1
test_partial_remove-add-update[main]       1.3611 (1.0)      1.3611 (1.0)      1.3611 (1.0)      0.0000 (1.0)      1.3611 (1.0)      0.0000 (1.0)           0;0  0.7347 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     487.4588 (1.0)      487.4588 (1.0)      487.4588 (1.0)      0.0000 (1.0)      487.4588 (1.0)      0.0000 (1.0)           0;0  2.0515 (1.0)           1           1
test_partial_remove-gc[3.10.0]     536.1419 (1.10)     536.1419 (1.10)     536.1419 (1.10)     0.0000 (1.0)      536.1419 (1.10)     0.0000 (1.0)           0;0  1.8652 (0.91)          1           1
test_partial_remove-gc[main]       520.8903 (1.07)     520.8903 (1.07)     520.8903 (1.07)     0.0000 (1.0)      520.8903 (1.07)     0.0000 (1.0)           0;0  1.9198 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     546.5490 (1.0)      546.5490 (1.0)      546.5490 (1.0)      0.0000 (1.0)      546.5490 (1.0)      0.0000 (1.0)           0;0  1.8297 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     598.0431 (1.09)     598.0431 (1.09)     598.0431 (1.09)     0.0000 (1.0)      598.0431 (1.09)     0.0000 (1.0)           0;0  1.6721 (0.91)          1           1
test_partial_remove-gc-cloud[main]       621.0571 (1.14)     621.0571 (1.14)     621.0571 (1.14)     0.0000 (1.0)      621.0571 (1.14)     0.0000 (1.0)           0;0  1.6102 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     3.3584 (2.28)     3.3584 (2.28)     3.3584 (2.28)     0.0000 (1.0)      3.3584 (2.28)     0.0000 (1.0)           0;0  0.2978 (0.44)          1           1
test_partial_remove-push[3.10.0]     1.8595 (1.26)     1.8595 (1.26)     1.8595 (1.26)     0.0000 (1.0)      1.8595 (1.26)     0.0000 (1.0)           0;0  0.5378 (0.79)          1           1
test_partial_remove-push[main]       1.4751 (1.0)      1.4751 (1.0)      1.4751 (1.0)      0.0000 (1.0)      1.4751 (1.0)      0.0000 (1.0)           0;0  0.6779 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     515.4562 (1.09)     515.4562 (1.09)     515.4562 (1.09)     0.0000 (1.0)      515.4562 (1.09)     0.0000 (1.0)           0;0  1.9400 (0.92)          1           1
test_partial_remove-push-update[3.10.0]     471.9009 (1.0)      471.9009 (1.0)      471.9009 (1.0)      0.0000 (1.0)      471.9009 (1.0)      0.0000 (1.0)           0;0  2.1191 (1.0)           1           1
test_partial_remove-push-update[main]       793.8418 (1.68)     793.8418 (1.68)     793.8418 (1.68)     0.0000 (1.0)      793.8418 (1.68)     0.0000 (1.0)           0;0  1.2597 (0.59)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     419.8581 (1.0)      430.0220 (1.0)      423.9250 (1.0)       3.9039 (1.37)     423.5226 (1.0)       5.0872 (1.73)          2;0  2.3589 (1.0)           5           3
test_plots-plots-diff[3.10.0]     770.1509 (1.83)     777.8920 (1.81)     773.3804 (1.82)      2.8442 (1.0)      773.2295 (1.83)      2.9482 (1.0)           2;0  1.2930 (0.55)          5           3
test_plots-plots-diff[main]       724.6464 (1.73)     759.4189 (1.77)     737.2361 (1.74)     16.1480 (5.68)     727.0995 (1.72)     26.7418 (9.07)          1;0  1.3564 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       431.1735 (1.0)        443.9880 (1.0)        437.7159 (1.0)      5.3231 (1.22)       436.2819 (1.0)      8.7852 (1.52)          2;0  2.2846 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,028.9941 (2.39)     1,040.5100 (2.34)     1,034.0662 (2.36)     4.3742 (1.0)      1,032.7449 (2.37)     5.7915 (1.0)           2;0  0.9671 (0.42)          5           3
test_plots-plots-diff-json[main]         804.0702 (1.86)       816.3322 (1.84)       808.3440 (1.85)     5.1608 (1.18)       806.1990 (1.85)     7.6430 (1.32)          1;0  1.2371 (0.54)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     390.1588 (1.0)      412.4819 (1.0)      398.3906 (1.0)      9.5827 (3.39)     392.6582 (1.0)      14.3348 (2.93)          1;0  2.5101 (1.0)           5           3
test_plots-plots-show[3.10.0]     638.6234 (1.64)     657.3164 (1.59)     644.7806 (1.62)     7.3841 (2.61)     643.6060 (1.64)      7.6960 (1.57)          1;0  1.5509 (0.62)          5           3
test_plots-plots-show[main]       615.5803 (1.58)     622.2099 (1.51)     619.1102 (1.55)     2.8243 (1.0)      619.8363 (1.58)      4.8865 (1.0)           2;0  1.6152 (0.64)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     402.2881 (1.0)      416.5716 (1.0)      407.9985 (1.0)      6.2081 (2.27)     404.9165 (1.0)      10.1549 (2.53)          1;0  2.4510 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     786.5391 (1.96)     793.3576 (1.90)     789.4419 (1.93)     2.7353 (1.0)      788.2434 (1.95)      4.0078 (1.0)           2;0  1.2667 (0.52)          5           3
test_plots-plots-show-json[main]       661.7270 (1.64)     669.6613 (1.61)     665.6695 (1.63)     3.6582 (1.34)     666.9146 (1.65)      6.6869 (1.67)          3;0  1.5022 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     3.4391 (2.22)     3.4391 (2.22)     3.4391 (2.22)     0.0000 (1.0)      3.4391 (2.22)     0.0000 (1.0)           0;0  0.2908 (0.45)          1           1
test_push-push[3.10.0]     1.8859 (1.22)     1.8859 (1.22)     1.8859 (1.22)     0.0000 (1.0)      1.8859 (1.22)     0.0000 (1.0)           0;0  0.5302 (0.82)          1           1
test_push-push[main]       1.5505 (1.0)      1.5505 (1.0)      1.5505 (1.0)      0.0000 (1.0)      1.5505 (1.0)      0.0000 (1.0)           0;0  0.6450 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     3.6387 (1.06)     3.6387 (1.06)     3.6387 (1.06)     0.0000 (1.0)      3.6387 (1.06)     0.0000 (1.0)           0;0  0.2748 (0.94)          1           1
test_sharing-add[3.10.0]     3.5593 (1.04)     3.5593 (1.04)     3.5593 (1.04)     0.0000 (1.0)      3.5593 (1.04)     0.0000 (1.0)           0;0  0.2810 (0.97)          1           1
test_sharing-add[main]       3.4353 (1.0)      3.4353 (1.0)      3.4353 (1.0)      0.0000 (1.0)      3.4353 (1.0)      0.0000 (1.0)           0;0  0.2911 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     2.4056 (1.03)     2.4056 (1.03)     2.4056 (1.03)     0.0000 (1.0)      2.4056 (1.03)     0.0000 (1.0)           0;0  0.4157 (0.97)          1           1
test_sharing-add-noop[3.10.0]     2.4686 (1.05)     2.4686 (1.05)     2.4686 (1.05)     0.0000 (1.0)      2.4686 (1.05)     0.0000 (1.0)           0;0  0.4051 (0.95)          1           1
test_sharing-add-noop[main]       2.3428 (1.0)      2.3428 (1.0)      2.3428 (1.0)      0.0000 (1.0)      2.3428 (1.0)      0.0000 (1.0)           0;0  0.4268 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     1.7505 (1.24)     1.7505 (1.24)     1.7505 (1.24)     0.0000 (1.0)      1.7505 (1.24)     0.0000 (1.0)           0;0  0.5713 (0.80)          1           1
test_sharing-checkout[3.10.0]     3.6786 (2.61)     3.6786 (2.61)     3.6786 (2.61)     0.0000 (1.0)      3.6786 (2.61)     0.0000 (1.0)           0;0  0.2718 (0.38)          1           1
test_sharing-checkout[main]       1.4089 (1.0)      1.4089 (1.0)      1.4089 (1.0)      0.0000 (1.0)      1.4089 (1.0)      0.0000 (1.0)           0;0  0.7098 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     579.2683 (1.04)     579.2683 (1.04)     579.2683 (1.04)     0.0000 (1.0)      579.2683 (1.04)     0.0000 (1.0)           0;0  1.7263 (0.96)          1           1
test_sharing-checkout-noop[3.10.0]     574.9631 (1.03)     574.9631 (1.03)     574.9631 (1.03)     0.0000 (1.0)      574.9631 (1.03)     0.0000 (1.0)           0;0  1.7392 (0.97)          1           1
test_sharing-checkout-noop[main]       556.5078 (1.0)      556.5078 (1.0)      556.5078 (1.0)      0.0000 (1.0)      556.5078 (1.0)      0.0000 (1.0)           0;0  1.7969 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     3.8295 (2.04)     3.8295 (2.04)     3.8295 (2.04)     0.0000 (1.0)      3.8295 (2.04)     0.0000 (1.0)           0;0  0.2611 (0.49)          1           1
test_sharing-fetch[3.10.0]     4.2882 (2.28)     4.2882 (2.28)     4.2882 (2.28)     0.0000 (1.0)      4.2882 (2.28)     0.0000 (1.0)           0;0  0.2332 (0.44)          1           1
test_sharing-fetch[main]       1.8768 (1.0)      1.8768 (1.0)      1.8768 (1.0)      0.0000 (1.0)      1.8768 (1.0)      0.0000 (1.0)           0;0  0.5328 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     439.2282 (1.0)      439.2282 (1.0)      439.2282 (1.0)      0.0000 (1.0)      439.2282 (1.0)      0.0000 (1.0)           0;0  2.2767 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     503.1894 (1.15)     503.1894 (1.15)     503.1894 (1.15)     0.0000 (1.0)      503.1894 (1.15)     0.0000 (1.0)           0;0  1.9873 (0.87)          1           1
test_sharing-fetch-noop[main]       799.0982 (1.82)     799.0982 (1.82)     799.0982 (1.82)     0.0000 (1.0)      799.0982 (1.82)     0.0000 (1.0)           0;0  1.2514 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     3.3880 (2.25)     3.3880 (2.25)     3.3880 (2.25)     0.0000 (1.0)      3.3880 (2.25)     0.0000 (1.0)           0;0  0.2952 (0.44)          1           1
test_sharing-push[3.10.0]     1.8847 (1.25)     1.8847 (1.25)     1.8847 (1.25)     0.0000 (1.0)      1.8847 (1.25)     0.0000 (1.0)           0;0  0.5306 (0.80)          1           1
test_sharing-push[main]       1.5032 (1.0)      1.5032 (1.0)      1.5032 (1.0)      0.0000 (1.0)      1.5032 (1.0)      0.0000 (1.0)           0;0  0.6652 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     448.9480 (1.03)     448.9480 (1.03)     448.9480 (1.03)     0.0000 (1.0)      448.9480 (1.03)     0.0000 (1.0)           0;0  2.2274 (0.97)          1           1
test_sharing-push-noop[3.10.0]     436.5034 (1.0)      436.5034 (1.0)      436.5034 (1.0)      0.0000 (1.0)      436.5034 (1.0)      0.0000 (1.0)           0;0  2.2909 (1.0)           1           1
test_sharing-push-noop[main]       836.9806 (1.92)     836.9806 (1.92)     836.9806 (1.92)     0.0000 (1.0)      836.9806 (1.92)     0.0000 (1.0)           0;0  1.1948 (0.52)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     1.1987 (1.00)     1.1987 (1.00)     1.1987 (1.00)     0.0000 (1.0)      1.1987 (1.00)     0.0000 (1.0)           0;0  0.8343 (1.00)          1           1
test_status-status[3.10.0]     1.2187 (1.02)     1.2187 (1.02)     1.2187 (1.02)     0.0000 (1.0)      1.2187 (1.02)     0.0000 (1.0)           0;0  0.8205 (0.98)          1           1
test_status-status[main]       1.1971 (1.0)      1.1971 (1.0)      1.1971 (1.0)      0.0000 (1.0)      1.1971 (1.0)      0.0000 (1.0)           0;0  0.8353 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     529.1568 (1.0)      529.1568 (1.0)      529.1568 (1.0)      0.0000 (1.0)      529.1568 (1.0)      0.0000 (1.0)           0;0  1.8898 (1.0)           1           1
test_status-status-changed[3.10.0]     558.5229 (1.06)     558.5229 (1.06)     558.5229 (1.06)     0.0000 (1.0)      558.5229 (1.06)     0.0000 (1.0)           0;0  1.7904 (0.95)          1           1
test_status-status-changed[main]       535.7195 (1.01)     535.7195 (1.01)     535.7195 (1.01)     0.0000 (1.0)      535.7195 (1.01)     0.0000 (1.0)           0;0  1.8666 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     538.7677 (1.03)     538.7677 (1.03)     538.7677 (1.03)     0.0000 (1.0)      538.7677 (1.03)     0.0000 (1.0)           0;0  1.8561 (0.97)          1           1
test_status-status-changed-noop[3.10.0]     557.0436 (1.07)     557.0436 (1.07)     557.0436 (1.07)     0.0000 (1.0)      557.0436 (1.07)     0.0000 (1.0)           0;0  1.7952 (0.94)          1           1
test_status-status-changed-noop[main]       522.9308 (1.0)      522.9308 (1.0)      522.9308 (1.0)      0.0000 (1.0)      522.9308 (1.0)      0.0000 (1.0)           0;0  1.9123 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     537.1845 (1.01)     537.1845 (1.01)     537.1845 (1.01)     0.0000 (1.0)      537.1845 (1.01)     0.0000 (1.0)           0;0  1.8616 (0.99)          1           1
test_status-status-noop[3.10.0]     555.7470 (1.04)     555.7470 (1.04)     555.7470 (1.04)     0.0000 (1.0)      555.7470 (1.04)     0.0000 (1.0)           0;0  1.7994 (0.96)          1           1
test_status-status-noop[main]       534.4877 (1.0)      534.4877 (1.0)      534.4877 (1.0)      0.0000 (1.0)      534.4877 (1.0)      0.0000 (1.0)           0;0  1.8710 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     7.3846 (1.44)     7.3846 (1.44)     7.3846 (1.44)     0.0000 (1.0)      7.3846 (1.44)     0.0000 (1.0)           0;0  0.1354 (0.69)          1           1
test_update-import-url[3.10.0]     7.5109 (1.47)     7.5109 (1.47)     7.5109 (1.47)     0.0000 (1.0)      7.5109 (1.47)     0.0000 (1.0)           0;0  0.1331 (0.68)          1           1
test_update-import-url[main]       5.1118 (1.0)      5.1118 (1.0)      5.1118 (1.0)      0.0000 (1.0)      5.1118 (1.0)      0.0000 (1.0)           0;0  0.1956 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     6.5653 (1.49)     6.5653 (1.49)     6.5653 (1.49)     0.0000 (1.0)      6.5653 (1.49)     0.0000 (1.0)           0;0  0.1523 (0.67)          1           1
test_update-update[3.10.0]     6.8275 (1.55)     6.8275 (1.55)     6.8275 (1.55)     0.0000 (1.0)      6.8275 (1.55)     0.0000 (1.0)           0;0  0.1465 (0.65)          1           1
test_update-update[main]       4.4145 (1.0)      4.4145 (1.0)      4.4145 (1.0)      0.0000 (1.0)      4.4145 (1.0)      0.0000 (1.0)           0;0  0.2265 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                          Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]       978.6964 (1.01)       978.6964 (1.01)       978.6964 (1.01)     0.0000 (1.0)        978.6964 (1.01)     0.0000 (1.0)           0;0  1.0218 (0.99)          1           1
test_update-update-noop[3.10.0]     1,012.5790 (1.05)     1,012.5790 (1.05)     1,012.5790 (1.05)     0.0000 (1.0)      1,012.5790 (1.05)     0.0000 (1.0)           0;0  0.9876 (0.95)          1           1
test_update-update-noop[main]         966.8281 (1.0)        966.8281 (1.0)        966.8281 (1.0)      0.0000 (1.0)        966.8281 (1.0)      0.0000 (1.0)           0;0  1.0343 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean