iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

build(deps): bump pre-commit from 2.21.0 to 3.4.0 #466

Closed dependabot[bot] closed 10 months ago

dependabot[bot] commented 1 year ago

Bumps pre-commit from 2.21.0 to 3.4.0.

Release notes

Sourced from pre-commit's releases.

pre-commit v3.4.0

Features

Fixes

pre-commit v3.3.3

Fixes

pre-commit v3.3.2

Fixes

pre-commit v3.3.1

Fixes

pre-commit v3.3.0

Features

pre-commit v3.2.2

Fixes

pre-commit v3.2.1

Fixes

  • Fix language_version for language: rust without global rustup.

... (truncated)

Changelog

Sourced from pre-commit's changelog.

3.4.0 - 2023-09-02

Features

Fixes

3.3.3 - 2023-06-13

Fixes

3.3.2 - 2023-05-17

Fixes

3.3.1 - 2023-05-02

Fixes

3.3.0 - 2023-05-01

Features

... (truncated)

Commits
  • fe9ba6b v3.4.0
  • ac42dc5 Merge pull request #2979 from jdb8/cpu-sched-getaffinity
  • ea8244b Use os.sched_getaffinity for cpu counts when available
  • 9ebda91 Merge pull request #2980 from pre-commit/pre-commit-ci-update-config
  • 3dd1875 [pre-commit.ci] pre-commit autoupdate
  • bde292b Merge pull request #2972 from pre-commit/pre-commit-ci-update-config
  • a4ae868 [pre-commit.ci] pre-commit autoupdate
  • 0c3d605 Merge pull request #2971 from chriskuehl/fix-signal-death
  • 5a4b5b1 Fix exit code for commands terminated by signals
  • a1f1d19 Merge pull request #2961 from pre-commit/pre-commit-ci-update-config
  • Additional commits viewable in compare view


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
github-actions[bot] commented 1 year ago

Mon Sep  4 10:17:05 UTC 2023
dataset: small
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0]     6.9446 (1.75)     6.9446 (1.75)     6.9446 (1.75)     0.0000 (1.0)      6.9446 (1.75)     0.0000 (1.0)           0;0  0.1440 (0.57)          1           1
test_add-add[2.40.0]     5.9114 (1.49)     5.9114 (1.49)     5.9114 (1.49)     0.0000 (1.0)      5.9114 (1.49)     0.0000 (1.0)           0;0  0.1692 (0.67)          1           1
test_add-add[2.58.2]     4.2976 (1.08)     4.2976 (1.08)     4.2976 (1.08)     0.0000 (1.0)      4.2976 (1.08)     0.0000 (1.0)           0;0  0.2327 (0.92)          1           1
test_add-add[3.0.0]      4.1100 (1.03)     4.1100 (1.03)     4.1100 (1.03)     0.0000 (1.0)      4.1100 (1.03)     0.0000 (1.0)           0;0  0.2433 (0.97)          1           1
test_add-add[main]       3.9718 (1.0)      3.9718 (1.0)      3.9718 (1.0)      0.0000 (1.0)      3.9718 (1.0)      0.0000 (1.0)           0;0  0.2518 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.40.0]     1.0182 (1.05)     1.0182 (1.05)     1.0182 (1.05)     0.0000 (1.0)      1.0182 (1.05)     0.0000 (1.0)           0;0  0.9821 (0.95)          1           1
test_data_status-data-changed[2.58.2]     1.0068 (1.04)     1.0068 (1.04)     1.0068 (1.04)     0.0000 (1.0)      1.0068 (1.04)     0.0000 (1.0)           0;0  0.9933 (0.96)          1           1
test_data_status-data-changed[3.0.0]      1.0301 (1.06)     1.0301 (1.06)     1.0301 (1.06)     0.0000 (1.0)      1.0301 (1.06)     0.0000 (1.0)           0;0  0.9708 (0.94)          1           1
test_data_status-data-changed[main]       0.9704 (1.0)      0.9704 (1.0)      0.9704 (1.0)      0.0000 (1.0)      0.9704 (1.0)      0.0000 (1.0)           0;0  1.0305 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.40.0]     1.0034 (1.03)     1.0034 (1.03)     1.0034 (1.03)     0.0000 (1.0)      1.0034 (1.03)     0.0000 (1.0)           0;0  0.9966 (0.97)          1           1
test_data_status-data-changed-noop[2.58.2]     1.0251 (1.05)     1.0251 (1.05)     1.0251 (1.05)     0.0000 (1.0)      1.0251 (1.05)     0.0000 (1.0)           0;0  0.9755 (0.95)          1           1
test_data_status-data-changed-noop[3.0.0]      1.0214 (1.05)     1.0214 (1.05)     1.0214 (1.05)     0.0000 (1.0)      1.0214 (1.05)     0.0000 (1.0)           0;0  0.9790 (0.95)          1           1
test_data_status-data-changed-noop[main]       0.9725 (1.0)      0.9725 (1.0)      0.9725 (1.0)      0.0000 (1.0)      0.9725 (1.0)      0.0000 (1.0)           0;0  1.0283 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.40.0]     2.2266 (1.06)     2.2266 (1.06)     2.2266 (1.06)     0.0000 (1.0)      2.2266 (1.06)     0.0000 (1.0)           0;0  0.4491 (0.94)          1           1
test_data_status-data-new[2.58.2]     2.1030 (1.00)     2.1030 (1.00)     2.1030 (1.00)     0.0000 (1.0)      2.1030 (1.00)     0.0000 (1.0)           0;0  0.4755 (1.00)          1           1
test_data_status-data-new[3.0.0]      2.1146 (1.01)     2.1146 (1.01)     2.1146 (1.01)     0.0000 (1.0)      2.1146 (1.01)     0.0000 (1.0)           0;0  0.4729 (0.99)          1           1
test_data_status-data-new[main]       2.0982 (1.0)      2.0982 (1.0)      2.0982 (1.0)      0.0000 (1.0)      2.0982 (1.0)      0.0000 (1.0)           0;0  0.4766 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.40.0]     1.0052 (1.01)     1.0052 (1.01)     1.0052 (1.01)     0.0000 (1.0)      1.0052 (1.01)     0.0000 (1.0)           0;0  0.9948 (0.99)          1           1
test_data_status-data-noop[2.58.2]     0.9993 (1.0)      0.9993 (1.0)      0.9993 (1.0)      0.0000 (1.0)      0.9993 (1.0)      0.0000 (1.0)           0;0  1.0007 (1.0)           1           1
test_data_status-data-noop[3.0.0]      1.0378 (1.04)     1.0378 (1.04)     1.0378 (1.04)     0.0000 (1.0)      1.0378 (1.04)     0.0000 (1.0)           0;0  0.9635 (0.96)          1           1
test_data_status-data-noop[main]       1.0024 (1.00)     1.0024 (1.00)     1.0024 (1.00)     0.0000 (1.0)      1.0024 (1.00)     0.0000 (1.0)           0;0  0.9976 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0]      7.2919 (1.28)      7.2919 (1.28)      7.2919 (1.28)     0.0000 (1.0)       7.2919 (1.28)     0.0000 (1.0)           0;0  0.1371 (0.78)          1           1
test_get-get[2.40.0]      5.6814 (1.0)       5.6814 (1.0)       5.6814 (1.0)      0.0000 (1.0)       5.6814 (1.0)      0.0000 (1.0)           0;0  0.1760 (1.0)           1           1
test_get-get[2.58.2]      8.8458 (1.56)      8.8458 (1.56)      8.8458 (1.56)     0.0000 (1.0)       8.8458 (1.56)     0.0000 (1.0)           0;0  0.1130 (0.64)          1           1
test_get-get[3.0.0]       9.0072 (1.59)      9.0072 (1.59)      9.0072 (1.59)     0.0000 (1.0)       9.0072 (1.59)     0.0000 (1.0)           0;0  0.1110 (0.63)          1           1
test_get-get[main]       10.5035 (1.85)     10.5035 (1.85)     10.5035 (1.85)     0.0000 (1.0)      10.5035 (1.85)     0.0000 (1.0)           0;0  0.0952 (0.54)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0]     3.9349 (1.49)     3.9349 (1.49)     3.9349 (1.49)     0.0000 (1.0)      3.9349 (1.49)     0.0000 (1.0)           0;0  0.2541 (0.67)          1           1
test_checkout_copy-checkout[2.40.0]     3.6827 (1.40)     3.6827 (1.40)     3.6827 (1.40)     0.0000 (1.0)      3.6827 (1.40)     0.0000 (1.0)           0;0  0.2715 (0.72)          1           1
test_checkout_copy-checkout[2.58.2]     2.6349 (1.0)      2.6349 (1.0)      2.6349 (1.0)      0.0000 (1.0)      2.6349 (1.0)      0.0000 (1.0)           0;0  0.3795 (1.0)           1           1
test_checkout_copy-checkout[3.0.0]      4.7017 (1.78)     4.7017 (1.78)     4.7017 (1.78)     0.0000 (1.0)      4.7017 (1.78)     0.0000 (1.0)           0;0  0.2127 (0.56)          1           1
test_checkout_copy-checkout[main]       4.5683 (1.73)     4.5683 (1.73)     4.5683 (1.73)     0.0000 (1.0)      4.5683 (1.73)     0.0000 (1.0)           0;0  0.2189 (0.58)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0]     595.2930 (1.0)      595.2930 (1.0)      595.2930 (1.0)      0.0000 (1.0)      595.2930 (1.0)      0.0000 (1.0)           0;0  1.6798 (1.0)           1           1
test_checkout_copy-checkout-noop[2.40.0]     652.6892 (1.10)     652.6892 (1.10)     652.6892 (1.10)     0.0000 (1.0)      652.6892 (1.10)     0.0000 (1.0)           0;0  1.5321 (0.91)          1           1
test_checkout_copy-checkout-noop[2.58.2]     807.2512 (1.36)     807.2512 (1.36)     807.2512 (1.36)     0.0000 (1.0)      807.2512 (1.36)     0.0000 (1.0)           0;0  1.2388 (0.74)          1           1
test_checkout_copy-checkout-noop[3.0.0]      794.1892 (1.33)     794.1892 (1.33)     794.1892 (1.33)     0.0000 (1.0)      794.1892 (1.33)     0.0000 (1.0)           0;0  1.2591 (0.75)          1           1
test_checkout_copy-checkout-noop[main]       787.3110 (1.32)     787.3110 (1.32)     787.3110 (1.32)     0.0000 (1.0)      787.3110 (1.32)     0.0000 (1.0)           0;0  1.2701 (0.76)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0]     1.5505 (2.04)     1.5505 (2.04)     1.5505 (2.04)     0.0000 (1.0)      1.5505 (2.04)     0.0000 (1.0)           0;0  0.6450 (0.49)          1           1
test_checkout_copy-checkout-update[2.40.0]     0.7594 (1.0)      0.7594 (1.0)      0.7594 (1.0)      0.0000 (1.0)      0.7594 (1.0)      0.0000 (1.0)           0;0  1.3168 (1.0)           1           1
test_checkout_copy-checkout-update[2.58.2]     1.0247 (1.35)     1.0247 (1.35)     1.0247 (1.35)     0.0000 (1.0)      1.0247 (1.35)     0.0000 (1.0)           0;0  0.9759 (0.74)          1           1
test_checkout_copy-checkout-update[3.0.0]      0.9232 (1.22)     0.9232 (1.22)     0.9232 (1.22)     0.0000 (1.0)      0.9232 (1.22)     0.0000 (1.0)           0;0  1.0832 (0.82)          1           1
test_checkout_copy-checkout-update[main]       0.8651 (1.14)     0.8651 (1.14)     0.8651 (1.14)     0.0000 (1.0)      0.8651 (1.14)     0.0000 (1.0)           0;0  1.1559 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0]     613.0380 (1.0)      613.0380 (1.0)      613.0380 (1.0)      0.0000 (1.0)      613.0380 (1.0)      0.0000 (1.0)           0;0  1.6312 (1.0)           1           1
test_gc-gc[2.40.0]     658.1499 (1.07)     658.1499 (1.07)     658.1499 (1.07)     0.0000 (1.0)      658.1499 (1.07)     0.0000 (1.0)           0;0  1.5194 (0.93)          1           1
test_gc-gc[2.58.2]     791.0257 (1.29)     791.0257 (1.29)     791.0257 (1.29)     0.0000 (1.0)      791.0257 (1.29)     0.0000 (1.0)           0;0  1.2642 (0.77)          1           1
test_gc-gc[3.0.0]      727.6945 (1.19)     727.6945 (1.19)     727.6945 (1.19)     0.0000 (1.0)      727.6945 (1.19)     0.0000 (1.0)           0;0  1.3742 (0.84)          1           1
test_gc-gc[main]       716.6569 (1.17)     716.6569 (1.17)     716.6569 (1.17)     0.0000 (1.0)      716.6569 (1.17)     0.0000 (1.0)           0;0  1.3954 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0]     1.7832 (1.23)     1.7832 (1.23)     1.7832 (1.23)     0.0000 (1.0)      1.7832 (1.23)     0.0000 (1.0)           0;0  0.5608 (0.81)          1           1
test_checkout_symlink-checkout[2.40.0]     1.5640 (1.08)     1.5640 (1.08)     1.5640 (1.08)     0.0000 (1.0)      1.5640 (1.08)     0.0000 (1.0)           0;0  0.6394 (0.93)          1           1
test_checkout_symlink-checkout[2.58.2]     1.6831 (1.16)     1.6831 (1.16)     1.6831 (1.16)     0.0000 (1.0)      1.6831 (1.16)     0.0000 (1.0)           0;0  0.5941 (0.86)          1           1
test_checkout_symlink-checkout[3.0.0]      1.8648 (1.29)     1.8648 (1.29)     1.8648 (1.29)     0.0000 (1.0)      1.8648 (1.29)     0.0000 (1.0)           0;0  0.5363 (0.78)          1           1
test_checkout_symlink-checkout[main]       1.4494 (1.0)      1.4494 (1.0)      1.4494 (1.0)      0.0000 (1.0)      1.4494 (1.0)      0.0000 (1.0)           0;0  0.6900 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0]     559.3640 (1.0)      559.3640 (1.0)      559.3640 (1.0)      0.0000 (1.0)      559.3640 (1.0)      0.0000 (1.0)           0;0  1.7877 (1.0)           1           1
test_checkout_symlink-checkout-noop[2.40.0]     685.1610 (1.22)     685.1610 (1.22)     685.1610 (1.22)     0.0000 (1.0)      685.1610 (1.22)     0.0000 (1.0)           0;0  1.4595 (0.82)          1           1
test_checkout_symlink-checkout-noop[2.58.2]     836.1389 (1.49)     836.1389 (1.49)     836.1389 (1.49)     0.0000 (1.0)      836.1389 (1.49)     0.0000 (1.0)           0;0  1.1960 (0.67)          1           1
test_checkout_symlink-checkout-noop[3.0.0]      854.8814 (1.53)     854.8814 (1.53)     854.8814 (1.53)     0.0000 (1.0)      854.8814 (1.53)     0.0000 (1.0)           0;0  1.1698 (0.65)          1           1
test_checkout_symlink-checkout-noop[main]       800.9033 (1.43)     800.9033 (1.43)     800.9033 (1.43)     0.0000 (1.0)      800.9033 (1.43)     0.0000 (1.0)           0;0  1.2486 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0]     1.5915 (2.05)     1.5915 (2.05)     1.5915 (2.05)     0.0000 (1.0)      1.5915 (2.05)     0.0000 (1.0)           0;0  0.6284 (0.49)          1           1
test_checkout_symlink-checkout-update[2.40.0]     0.7759 (1.0)      0.7759 (1.0)      0.7759 (1.0)      0.0000 (1.0)      0.7759 (1.0)      0.0000 (1.0)           0;0  1.2889 (1.0)           1           1
test_checkout_symlink-checkout-update[2.58.2]     1.0151 (1.31)     1.0151 (1.31)     1.0151 (1.31)     0.0000 (1.0)      1.0151 (1.31)     0.0000 (1.0)           0;0  0.9851 (0.76)          1           1
test_checkout_symlink-checkout-update[3.0.0]      0.9704 (1.25)     0.9704 (1.25)     0.9704 (1.25)     0.0000 (1.0)      0.9704 (1.25)     0.0000 (1.0)           0;0  1.0305 (0.80)          1           1
test_checkout_symlink-checkout-update[main]       0.8618 (1.11)     0.8618 (1.11)     0.8618 (1.11)     0.0000 (1.0)      0.8618 (1.11)     0.0000 (1.0)           0;0  1.1603 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_pull-pull': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0]     10.3397 (1.29)     10.3397 (1.29)     10.3397 (1.29)     0.0000 (1.0)      10.3397 (1.29)     0.0000 (1.0)           0;0  0.0967 (0.77)          1           1
test_pull-pull[2.40.0]     12.2539 (1.53)     12.2539 (1.53)     12.2539 (1.53)     0.0000 (1.0)      12.2539 (1.53)     0.0000 (1.0)           0;0  0.0816 (0.65)          1           1
test_pull-pull[2.58.2]      8.0003 (1.0)       8.0003 (1.0)       8.0003 (1.0)      0.0000 (1.0)       8.0003 (1.0)      0.0000 (1.0)           0;0  0.1250 (1.0)           1           1
test_pull-pull[3.0.0]      11.7527 (1.47)     11.7527 (1.47)     11.7527 (1.47)     0.0000 (1.0)      11.7527 (1.47)     0.0000 (1.0)           0;0  0.0851 (0.68)          1           1
test_pull-pull[main]       11.1841 (1.40)     11.1841 (1.40)     11.1841 (1.40)     0.0000 (1.0)      11.1841 (1.40)     0.0000 (1.0)           0;0  0.0894 (0.72)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0]     6.6128 (1.82)     6.6128 (1.82)     6.6128 (1.82)     0.0000 (1.0)      6.6128 (1.82)     0.0000 (1.0)           0;0  0.1512 (0.55)          1           1
test_sharing-add[2.40.0]     5.4199 (1.49)     5.4199 (1.49)     5.4199 (1.49)     0.0000 (1.0)      5.4199 (1.49)     0.0000 (1.0)           0;0  0.1845 (0.67)          1           1
test_sharing-add[2.58.2]     3.8065 (1.05)     3.8065 (1.05)     3.8065 (1.05)     0.0000 (1.0)      3.8065 (1.05)     0.0000 (1.0)           0;0  0.2627 (0.96)          1           1
test_sharing-add[3.0.0]      3.9998 (1.10)     3.9998 (1.10)     3.9998 (1.10)     0.0000 (1.0)      3.9998 (1.10)     0.0000 (1.0)           0;0  0.2500 (0.91)          1           1
test_sharing-add[main]       3.6393 (1.0)      3.6393 (1.0)      3.6393 (1.0)      0.0000 (1.0)      3.6393 (1.0)      0.0000 (1.0)           0;0  0.2748 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0]     3.2510 (1.44)     3.2510 (1.44)     3.2510 (1.44)     0.0000 (1.0)      3.2510 (1.44)     0.0000 (1.0)           0;0  0.3076 (0.70)          1           1
test_sharing-add-noop[2.40.0]     2.2601 (1.0)      2.2601 (1.0)      2.2601 (1.0)      0.0000 (1.0)      2.2601 (1.0)      0.0000 (1.0)           0;0  0.4425 (1.0)           1           1
test_sharing-add-noop[2.58.2]     2.4405 (1.08)     2.4405 (1.08)     2.4405 (1.08)     0.0000 (1.0)      2.4405 (1.08)     0.0000 (1.0)           0;0  0.4098 (0.93)          1           1
test_sharing-add-noop[3.0.0]      2.4531 (1.09)     2.4531 (1.09)     2.4531 (1.09)     0.0000 (1.0)      2.4531 (1.09)     0.0000 (1.0)           0;0  0.4076 (0.92)          1           1
test_sharing-add-noop[main]       2.4556 (1.09)     2.4556 (1.09)     2.4556 (1.09)     0.0000 (1.0)      2.4556 (1.09)     0.0000 (1.0)           0;0  0.4072 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0]     483.8601 (1.0)      483.8601 (1.0)      483.8601 (1.0)      0.0000 (1.0)      483.8601 (1.0)      0.0000 (1.0)           0;0  2.0667 (1.0)           1           1
test_sharing-checkout-noop[2.40.0]     566.2831 (1.17)     566.2831 (1.17)     566.2831 (1.17)     0.0000 (1.0)      566.2831 (1.17)     0.0000 (1.0)           0;0  1.7659 (0.85)          1           1
test_sharing-checkout-noop[2.58.2]     634.0162 (1.31)     634.0162 (1.31)     634.0162 (1.31)     0.0000 (1.0)      634.0162 (1.31)     0.0000 (1.0)           0;0  1.5772 (0.76)          1           1
test_sharing-checkout-noop[3.0.0]      653.5905 (1.35)     653.5905 (1.35)     653.5905 (1.35)     0.0000 (1.0)      653.5905 (1.35)     0.0000 (1.0)           0;0  1.5300 (0.74)          1           1
test_sharing-checkout-noop[main]       643.6926 (1.33)     643.6926 (1.33)     643.6926 (1.33)     0.0000 (1.0)      643.6926 (1.33)     0.0000 (1.0)           0;0  1.5535 (0.75)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-pull': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0]     6.6246 (1.32)     6.6246 (1.32)     6.6246 (1.32)     0.0000 (1.0)      6.6246 (1.32)     0.0000 (1.0)           0;0  0.1510 (0.76)          1           1
test_sharing-pull[2.40.0]     7.8145 (1.56)     7.8145 (1.56)     7.8145 (1.56)     0.0000 (1.0)      7.8145 (1.56)     0.0000 (1.0)           0;0  0.1280 (0.64)          1           1
test_sharing-pull[2.58.2]     5.0151 (1.0)      5.0151 (1.0)      5.0151 (1.0)      0.0000 (1.0)      5.0151 (1.0)      0.0000 (1.0)           0;0  0.1994 (1.0)           1           1
test_sharing-pull[3.0.0]      7.2059 (1.44)     7.2059 (1.44)     7.2059 (1.44)     0.0000 (1.0)      7.2059 (1.44)     0.0000 (1.0)           0;0  0.1388 (0.70)          1           1
test_sharing-pull[main]       7.1508 (1.43)     7.1508 (1.43)     7.1508 (1.43)     0.0000 (1.0)      7.1508 (1.43)     0.0000 (1.0)           0;0  0.1398 (0.70)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0]     517.1591 (1.0)      517.1591 (1.0)      517.1591 (1.0)      0.0000 (1.0)      517.1591 (1.0)      0.0000 (1.0)           0;0  1.9336 (1.0)           1           1
test_sharing-pull-noop[2.40.0]     605.1575 (1.17)     605.1575 (1.17)     605.1575 (1.17)     0.0000 (1.0)      605.1575 (1.17)     0.0000 (1.0)           0;0  1.6525 (0.85)          1           1
test_sharing-pull-noop[2.58.2]     679.1987 (1.31)     679.1987 (1.31)     679.1987 (1.31)     0.0000 (1.0)      679.1987 (1.31)     0.0000 (1.0)           0;0  1.4723 (0.76)          1           1
test_sharing-pull-noop[3.0.0]      788.7674 (1.53)     788.7674 (1.53)     788.7674 (1.53)     0.0000 (1.0)      788.7674 (1.53)     0.0000 (1.0)           0;0  1.2678 (0.66)          1           1
test_sharing-pull-noop[main]       784.0721 (1.52)     784.0721 (1.52)     784.0721 (1.52)     0.0000 (1.0)      784.0721 (1.52)     0.0000 (1.0)           0;0  1.2754 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0]     3.7023 (2.21)     3.7023 (2.21)     3.7023 (2.21)     0.0000 (1.0)      3.7023 (2.21)     0.0000 (1.0)           0;0  0.2701 (0.45)          1           1
test_sharing-push[2.40.0]     4.7930 (2.86)     4.7930 (2.86)     4.7930 (2.86)     0.0000 (1.0)      4.7930 (2.86)     0.0000 (1.0)           0;0  0.2086 (0.35)          1           1
test_sharing-push[2.58.2]     3.2618 (1.95)     3.2618 (1.95)     3.2618 (1.95)     0.0000 (1.0)      3.2618 (1.95)     0.0000 (1.0)           0;0  0.3066 (0.51)          1           1
test_sharing-push[3.0.0]      1.6767 (1.0)      1.6767 (1.0)      1.6767 (1.0)      0.0000 (1.0)      1.6767 (1.0)      0.0000 (1.0)           0;0  0.5964 (1.0)           1           1
test_sharing-push[main]       3.2554 (1.94)     3.2554 (1.94)     3.2554 (1.94)     0.0000 (1.0)      3.2554 (1.94)     0.0000 (1.0)           0;0  0.3072 (0.52)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0]     430.5413 (1.0)      430.5413 (1.0)      430.5413 (1.0)      0.0000 (1.0)      430.5413 (1.0)      0.0000 (1.0)           0;0  2.3227 (1.0)           1           1
test_sharing-push-noop[2.40.0]     466.6364 (1.08)     466.6364 (1.08)     466.6364 (1.08)     0.0000 (1.0)      466.6364 (1.08)     0.0000 (1.0)           0;0  2.1430 (0.92)          1           1
test_sharing-push-noop[2.58.2]     520.4212 (1.21)     520.4212 (1.21)     520.4212 (1.21)     0.0000 (1.0)      520.4212 (1.21)     0.0000 (1.0)           0;0  1.9215 (0.83)          1           1
test_sharing-push-noop[3.0.0]      518.9170 (1.21)     518.9170 (1.21)     518.9170 (1.21)     0.0000 (1.0)      518.9170 (1.21)     0.0000 (1.0)           0;0  1.9271 (0.83)          1           1
test_sharing-push-noop[main]       518.5048 (1.20)     518.5048 (1.20)     518.5048 (1.20)     0.0000 (1.0)      518.5048 (1.20)     0.0000 (1.0)           0;0  1.9286 (0.83)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 5 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0]     2.4503 (1.23)     2.4503 (1.23)     2.4503 (1.23)     0.0000 (1.0)      2.4503 (1.23)     0.0000 (1.0)           0;0  0.4081 (0.82)          1           1
test_diff-diff[2.40.0]     1.9978 (1.0)      1.9978 (1.0)      1.9978 (1.0)      0.0000 (1.0)      1.9978 (1.0)      0.0000 (1.0)           0;0  0.5006 (1.0)           1           1
test_diff-diff[2.58.2]     2.1564 (1.08)     2.1564 (1.08)     2.1564 (1.08)     0.0000 (1.0)      2.1564 (1.08)     0.0000 (1.0)           0;0  0.4637 (0.93)          1           1
test_diff-diff[3.0.0]      2.0356 (1.02)     2.0356 (1.02)     2.0356 (1.02)     0.0000 (1.0)      2.0356 (1.02)     0.0000 (1.0)           0;0  0.4913 (0.98)          1           1
test_diff-diff[main]       2.1461 (1.07)     2.1461 (1.07)     2.1461 (1.07)     0.0000 (1.0)      2.1461 (1.07)     0.0000 (1.0)           0;0  0.4660 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0]     1.5734 (1.68)     1.5734 (1.68)     1.5734 (1.68)     0.0000 (1.0)      1.5734 (1.68)     0.0000 (1.0)           0;0  0.6356 (0.60)          1           1
test_diff-diff-changed[2.40.0]     0.9386 (1.0)      0.9386 (1.0)      0.9386 (1.0)      0.0000 (1.0)      0.9386 (1.0)      0.0000 (1.0)           0;0  1.0654 (1.0)           1           1
test_diff-diff-changed[2.58.2]     1.0778 (1.15)     1.0778 (1.15)     1.0778 (1.15)     0.0000 (1.0)      1.0778 (1.15)     0.0000 (1.0)           0;0  0.9278 (0.87)          1           1
test_diff-diff-changed[3.0.0]      1.1315 (1.21)     1.1315 (1.21)     1.1315 (1.21)     0.0000 (1.0)      1.1315 (1.21)     0.0000 (1.0)           0;0  0.8838 (0.83)          1           1
test_diff-diff-changed[main]       1.0761 (1.15)     1.0761 (1.15)     1.0761 (1.15)     0.0000 (1.0)      1.0761 (1.15)     0.0000 (1.0)           0;0  0.9293 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                              Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0]       646.5915 (1.0)        646.5915 (1.0)        646.5915 (1.0)      0.0000 (1.0)        646.5915 (1.0)      0.0000 (1.0)           0;0  1.5466 (1.0)           1           1
test_diff-diff-changed-noop[2.40.0]       921.1783 (1.42)       921.1783 (1.42)       921.1783 (1.42)     0.0000 (1.0)        921.1783 (1.42)     0.0000 (1.0)           0;0  1.0856 (0.70)          1           1
test_diff-diff-changed-noop[2.58.2]     1,025.5123 (1.59)     1,025.5123 (1.59)     1,025.5123 (1.59)     0.0000 (1.0)      1,025.5123 (1.59)     0.0000 (1.0)           0;0  0.9751 (0.63)          1           1
test_diff-diff-changed-noop[3.0.0]      1,037.5223 (1.60)     1,037.5223 (1.60)     1,037.5223 (1.60)     0.0000 (1.0)      1,037.5223 (1.60)     0.0000 (1.0)           0;0  0.9638 (0.62)          1           1
test_diff-diff-changed-noop[main]       1,004.8763 (1.55)     1,004.8763 (1.55)     1,004.8763 (1.55)     0.0000 (1.0)      1,004.8763 (1.55)     0.0000 (1.0)           0;0  0.9951 (0.64)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0]     603.6723 (1.0)      603.6723 (1.0)      603.6723 (1.0)      0.0000 (1.0)      603.6723 (1.0)      0.0000 (1.0)           0;0  1.6565 (1.0)           1           1
test_diff-diff-noop[2.40.0]     876.2140 (1.45)     876.2140 (1.45)     876.2140 (1.45)     0.0000 (1.0)      876.2140 (1.45)     0.0000 (1.0)           0;0  1.1413 (0.69)          1           1
test_diff-diff-noop[2.58.2]     955.7772 (1.58)     955.7772 (1.58)     955.7772 (1.58)     0.0000 (1.0)      955.7772 (1.58)     0.0000 (1.0)           0;0  1.0463 (0.63)          1           1
test_diff-diff-noop[3.0.0]      954.1528 (1.58)     954.1528 (1.58)     954.1528 (1.58)     0.0000 (1.0)      954.1528 (1.58)     0.0000 (1.0)           0;0  1.0481 (0.63)          1           1
test_diff-diff-noop[main]       985.6970 (1.63)     985.6970 (1.63)     985.6970 (1.63)     0.0000 (1.0)      985.6970 (1.63)     0.0000 (1.0)           0;0  1.0145 (0.61)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0]     17.1389 (1.41)     17.1389 (1.41)     17.1389 (1.41)     0.0000 (1.0)      17.1389 (1.41)     0.0000 (1.0)           0;0  0.0583 (0.71)          1           1
test_import_url-import-url[2.40.0]     14.7843 (1.22)     14.7843 (1.22)     14.7843 (1.22)     0.0000 (1.0)      14.7843 (1.22)     0.0000 (1.0)           0;0  0.0676 (0.82)          1           1
test_import_url-import-url[2.58.2]     12.5369 (1.03)     12.5369 (1.03)     12.5369 (1.03)     0.0000 (1.0)      12.5369 (1.03)     0.0000 (1.0)           0;0  0.0798 (0.97)          1           1
test_import_url-import-url[3.0.0]      12.7441 (1.05)     12.7441 (1.05)     12.7441 (1.05)     0.0000 (1.0)      12.7441 (1.05)     0.0000 (1.0)           0;0  0.0785 (0.95)          1           1
test_import_url-import-url[main]       12.1205 (1.0)      12.1205 (1.0)      12.1205 (1.0)      0.0000 (1.0)      12.1205 (1.0)      0.0000 (1.0)           0;0  0.0825 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.40.0]       730.2960 (1.03)       759.7020 (1.05)       742.6355 (1.03)     12.6448 (1.95)       738.2045 (1.02)     21.4370 (2.90)          1;0  1.3466 (0.97)          5           3
test_plots-plots-diff[2.58.2]       707.5056 (1.0)        723.9134 (1.0)        718.3465 (1.0)       6.4715 (1.0)        720.2924 (1.0)       7.4021 (1.0)           1;0  1.3921 (1.0)           5           3
test_plots-plots-diff[3.0.0]      1,276.8189 (1.80)     1,309.5881 (1.81)     1,300.9122 (1.81)     13.7615 (2.13)     1,307.8900 (1.82)     12.6231 (1.71)          1;1  0.7687 (0.55)          5           3
test_plots-plots-diff[main]       1,305.9770 (1.85)     1,336.4919 (1.85)     1,316.3703 (1.83)     13.6816 (2.11)     1,308.3239 (1.82)     21.4452 (2.90)          1;0  0.7597 (0.55)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.40.0]       766.5531 (1.06)       784.2727 (1.04)       780.3279 (1.05)      7.7112 (1.0)        783.4107 (1.04)      4.9891 (1.0)           1;1  1.2815 (0.95)          5           3
test_plots-plots-diff-json[2.58.2]       721.7444 (1.0)        756.9189 (1.0)        743.2614 (1.0)      14.2902 (1.85)       750.7106 (1.0)      20.0061 (4.01)          1;0  1.3454 (1.0)           5           3
test_plots-plots-diff-json[3.0.0]      1,723.5064 (2.39)     1,765.8205 (2.33)     1,748.0361 (2.35)     16.2547 (2.11)     1,751.7512 (2.33)     22.2203 (4.45)          2;0  0.5721 (0.43)          5           3
test_plots-plots-diff-json[main]       1,746.8104 (2.42)     1,798.7646 (2.38)     1,783.7565 (2.40)     21.3169 (2.76)     1,790.1672 (2.38)     21.5886 (4.33)          1;0  0.5606 (0.42)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.40.0]       556.0185 (1.0)        589.3094 (1.0)        569.4823 (1.0)      12.4668 (1.06)       569.2621 (1.0)      13.9729 (1.0)           2;0  1.7560 (1.0)           5           3
test_plots-plots-show[2.58.2]       640.2239 (1.15)       676.5284 (1.15)       658.0176 (1.16)     16.5008 (1.41)       661.7718 (1.16)     30.4413 (2.18)          2;0  1.5197 (0.87)          5           3
test_plots-plots-show[3.0.0]      1,058.3262 (1.90)     1,087.8659 (1.85)     1,076.7545 (1.89)     11.7374 (1.0)      1,079.3906 (1.90)     16.2654 (1.16)          1;0  0.9287 (0.53)          5           3
test_plots-plots-show[main]       1,055.8381 (1.90)     1,145.6797 (1.94)     1,083.9478 (1.90)     38.5521 (3.28)     1,060.4729 (1.86)     51.3435 (3.67)          1;0  0.9226 (0.53)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.40.0]       618.6312 (1.0)        628.7709 (1.0)        623.5950 (1.0)       4.2990 (1.0)        625.1098 (1.0)       7.1228 (1.0)           2;0  1.6036 (1.0)           5           3
test_plots-plots-show-json[2.58.2]       670.6314 (1.08)       710.0020 (1.13)       684.2068 (1.10)     15.3972 (3.58)       681.6994 (1.09)     16.9701 (2.38)          1;0  1.4615 (0.91)          5           3
test_plots-plots-show-json[3.0.0]      1,320.8931 (2.14)     1,356.0960 (2.16)     1,341.5098 (2.15)     13.6243 (3.17)     1,341.0933 (2.15)     18.5058 (2.60)          2;0  0.7454 (0.46)          5           3
test_plots-plots-show-json[main]       1,342.6247 (2.17)     1,398.4647 (2.22)     1,367.2730 (2.19)     23.5313 (5.47)     1,359.2236 (2.17)     39.2494 (5.51)          2;0  0.7314 (0.46)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.11.0]     7.3182 (1.80)     7.3182 (1.80)     7.3182 (1.80)     0.0000 (1.0)      7.3182 (1.80)     0.0000 (1.0)           0;0  0.1366 (0.55)          1           1
test_sharing_gs-add[2.11.0]     8.7474 (2.15)     8.7474 (2.15)     8.7474 (2.15)     0.0000 (1.0)      8.7474 (2.15)     0.0000 (1.0)           0;0  0.1143 (0.46)          1           1
test_sharing_gs-add[2.40.0]     5.9936 (1.48)     5.9936 (1.48)     5.9936 (1.48)     0.0000 (1.0)      5.9936 (1.48)     0.0000 (1.0)           0;0  0.1668 (0.68)          1           1
test_sharing_gs-add[2.40.0]     5.8931 (1.45)     5.8931 (1.45)     5.8931 (1.45)     0.0000 (1.0)      5.8931 (1.45)     0.0000 (1.0)           0;0  0.1697 (0.69)          1           1
test_sharing_gs-add[2.58.2]     4.1256 (1.02)     4.1256 (1.02)     4.1256 (1.02)     0.0000 (1.0)      4.1256 (1.02)     0.0000 (1.0)           0;0  0.2424 (0.98)          1           1
test_sharing_gs-add[2.58.2]     4.0808 (1.01)     4.0808 (1.01)     4.0808 (1.01)     0.0000 (1.0)      4.0808 (1.01)     0.0000 (1.0)           0;0  0.2450 (0.99)          1           1
test_sharing_gs-add[3.0.0]      4.0719 (1.00)     4.0719 (1.00)     4.0719 (1.00)     0.0000 (1.0)      4.0719 (1.00)     0.0000 (1.0)           0;0  0.2456 (1.00)          1           1
test_sharing_gs-add[3.0.0]      4.0729 (1.00)     4.0729 (1.00)     4.0729 (1.00)     0.0000 (1.0)      4.0729 (1.00)     0.0000 (1.0)           0;0  0.2455 (1.00)          1           1
test_sharing_gs-add[main]       4.0602 (1.0)      4.0602 (1.0)      4.0602 (1.0)      0.0000 (1.0)      4.0602 (1.0)      0.0000 (1.0)           0;0  0.2463 (1.0)           1           1
test_sharing_gs-add[main]       4.2184 (1.04)     4.2184 (1.04)     4.2184 (1.04)     0.0000 (1.0)      4.2184 (1.04)     0.0000 (1.0)           0;0  0.2371 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.11.0]     3.5754 (1.42)     3.5754 (1.42)     3.5754 (1.42)     0.0000 (1.0)      3.5754 (1.42)     0.0000 (1.0)           0;0  0.2797 (0.70)          1           1
test_sharing_gs-add-noop[2.11.0]     3.5398 (1.41)     3.5398 (1.41)     3.5398 (1.41)     0.0000 (1.0)      3.5398 (1.41)     0.0000 (1.0)           0;0  0.2825 (0.71)          1           1
test_sharing_gs-add-noop[2.40.0]     2.5438 (1.01)     2.5438 (1.01)     2.5438 (1.01)     0.0000 (1.0)      2.5438 (1.01)     0.0000 (1.0)           0;0  0.3931 (0.99)          1           1
test_sharing_gs-add-noop[2.40.0]     2.5126 (1.0)      2.5126 (1.0)      2.5126 (1.0)      0.0000 (1.0)      2.5126 (1.0)      0.0000 (1.0)           0;0  0.3980 (1.0)           1           1
test_sharing_gs-add-noop[2.58.2]     2.7178 (1.08)     2.7178 (1.08)     2.7178 (1.08)     0.0000 (1.0)      2.7178 (1.08)     0.0000 (1.0)           0;0  0.3680 (0.92)          1           1
test_sharing_gs-add-noop[2.58.2]     3.6573 (1.46)     3.6573 (1.46)     3.6573 (1.46)     0.0000 (1.0)      3.6573 (1.46)     0.0000 (1.0)           0;0  0.2734 (0.69)          1           1
test_sharing_gs-add-noop[3.0.0]      2.7073 (1.08)     2.7073 (1.08)     2.7073 (1.08)     0.0000 (1.0)      2.7073 (1.08)     0.0000 (1.0)           0;0  0.3694 (0.93)          1           1
test_sharing_gs-add-noop[3.0.0]      2.7419 (1.09)     2.7419 (1.09)     2.7419 (1.09)     0.0000 (1.0)      2.7419 (1.09)     0.0000 (1.0)           0;0  0.3647 (0.92)          1           1
test_sharing_gs-add-noop[main]       2.7375 (1.09)     2.7375 (1.09)     2.7375 (1.09)     0.0000 (1.0)      2.7375 (1.09)     0.0000 (1.0)           0;0  0.3653 (0.92)          1           1
test_sharing_gs-add-noop[main]       2.7202 (1.08)     2.7202 (1.08)     2.7202 (1.08)     0.0000 (1.0)      2.7202 (1.08)     0.0000 (1.0)           0;0  0.3676 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.11.0]     516.0990 (1.00)     516.0990 (1.00)     516.0990 (1.00)     0.0000 (1.0)      516.0990 (1.00)     0.0000 (1.0)           0;0  1.9376 (1.00)          1           1
test_sharing_gs-checkout-noop[2.11.0]     515.5013 (1.0)      515.5013 (1.0)      515.5013 (1.0)      0.0000 (1.0)      515.5013 (1.0)      0.0000 (1.0)           0;0  1.9399 (1.0)           1           1
test_sharing_gs-checkout-noop[2.40.0]     586.8589 (1.14)     586.8589 (1.14)     586.8589 (1.14)     0.0000 (1.0)      586.8589 (1.14)     0.0000 (1.0)           0;0  1.7040 (0.88)          1           1
test_sharing_gs-checkout-noop[2.40.0]     598.7535 (1.16)     598.7535 (1.16)     598.7535 (1.16)     0.0000 (1.0)      598.7535 (1.16)     0.0000 (1.0)           0;0  1.6701 (0.86)          1           1
test_sharing_gs-checkout-noop[2.58.2]     661.6547 (1.28)     661.6547 (1.28)     661.6547 (1.28)     0.0000 (1.0)      661.6547 (1.28)     0.0000 (1.0)           0;0  1.5114 (0.78)          1           1
test_sharing_gs-checkout-noop[2.58.2]     653.8442 (1.27)     653.8442 (1.27)     653.8442 (1.27)     0.0000 (1.0)      653.8442 (1.27)     0.0000 (1.0)           0;0  1.5294 (0.79)          1           1
test_sharing_gs-checkout-noop[3.0.0]      685.6687 (1.33)     685.6687 (1.33)     685.6687 (1.33)     0.0000 (1.0)      685.6687 (1.33)     0.0000 (1.0)           0;0  1.4584 (0.75)          1           1
test_sharing_gs-checkout-noop[3.0.0]      680.5008 (1.32)     680.5008 (1.32)     680.5008 (1.32)     0.0000 (1.0)      680.5008 (1.32)     0.0000 (1.0)           0;0  1.4695 (0.76)          1           1
test_sharing_gs-checkout-noop[main]       674.2667 (1.31)     674.2667 (1.31)     674.2667 (1.31)     0.0000 (1.0)      674.2667 (1.31)     0.0000 (1.0)           0;0  1.4831 (0.76)          1           1
test_sharing_gs-checkout-noop[main]       678.4835 (1.32)     678.4835 (1.32)     678.4835 (1.32)     0.0000 (1.0)      678.4835 (1.32)     0.0000 (1.0)           0;0  1.4739 (0.76)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-pull': 10 tests -----------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull[2.11.0]     7.3401 (1.34)     7.3401 (1.34)     7.3401 (1.34)     0.0000 (1.0)      7.3401 (1.34)     0.0000 (1.0)           0;0  0.1362 (0.75)          1           1
test_sharing_gs-pull[2.11.0]     7.3001 (1.33)     7.3001 (1.33)     7.3001 (1.33)     0.0000 (1.0)      7.3001 (1.33)     0.0000 (1.0)           0;0  0.1370 (0.75)          1           1
test_sharing_gs-pull[2.40.0]     8.6278 (1.57)     8.6278 (1.57)     8.6278 (1.57)     0.0000 (1.0)      8.6278 (1.57)     0.0000 (1.0)           0;0  0.1159 (0.64)          1           1
test_sharing_gs-pull[2.40.0]     8.8896 (1.62)     8.8896 (1.62)     8.8896 (1.62)     0.0000 (1.0)      8.8896 (1.62)     0.0000 (1.0)           0;0  0.1125 (0.62)          1           1
test_sharing_gs-pull[2.58.2]     5.4940 (1.0)      5.4940 (1.0)      5.4940 (1.0)      0.0000 (1.0)      5.4940 (1.0)      0.0000 (1.0)           0;0  0.1820 (1.0)           1           1
test_sharing_gs-pull[2.58.2]     5.5352 (1.01)     5.5352 (1.01)     5.5352 (1.01)     0.0000 (1.0)      5.5352 (1.01)     0.0000 (1.0)           0;0  0.1807 (0.99)          1           1
test_sharing_gs-pull[3.0.0]      7.8380 (1.43)     7.8380 (1.43)     7.8380 (1.43)     0.0000 (1.0)      7.8380 (1.43)     0.0000 (1.0)           0;0  0.1276 (0.70)          1           1
test_sharing_gs-pull[3.0.0]      7.8274 (1.42)     7.8274 (1.42)     7.8274 (1.42)     0.0000 (1.0)      7.8274 (1.42)     0.0000 (1.0)           0;0  0.1278 (0.70)          1           1
test_sharing_gs-pull[main]       7.9673 (1.45)     7.9673 (1.45)     7.9673 (1.45)     0.0000 (1.0)      7.9673 (1.45)     0.0000 (1.0)           0;0  0.1255 (0.69)          1           1
test_sharing_gs-pull[main]       7.8685 (1.43)     7.8685 (1.43)     7.8685 (1.43)     0.0000 (1.0)      7.8685 (1.43)     0.0000 (1.0)           0;0  0.1271 (0.70)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull-noop[2.11.0]     549.0022 (1.0)      549.0022 (1.0)      549.0022 (1.0)      0.0000 (1.0)      549.0022 (1.0)      0.0000 (1.0)           0;0  1.8215 (1.0)           1           1
test_sharing_gs-pull-noop[2.11.0]     551.9477 (1.01)     551.9477 (1.01)     551.9477 (1.01)     0.0000 (1.0)      551.9477 (1.01)     0.0000 (1.0)           0;0  1.8118 (0.99)          1           1
test_sharing_gs-pull-noop[2.40.0]     630.3521 (1.15)     630.3521 (1.15)     630.3521 (1.15)     0.0000 (1.0)      630.3521 (1.15)     0.0000 (1.0)           0;0  1.5864 (0.87)          1           1
test_sharing_gs-pull-noop[2.40.0]     639.5980 (1.17)     639.5980 (1.17)     639.5980 (1.17)     0.0000 (1.0)      639.5980 (1.17)     0.0000 (1.0)           0;0  1.5635 (0.86)          1           1
test_sharing_gs-pull-noop[2.58.2]     704.2967 (1.28)     704.2967 (1.28)     704.2967 (1.28)     0.0000 (1.0)      704.2967 (1.28)     0.0000 (1.0)           0;0  1.4199 (0.78)          1           1
test_sharing_gs-pull-noop[2.58.2]     708.3237 (1.29)     708.3237 (1.29)     708.3237 (1.29)     0.0000 (1.0)      708.3237 (1.29)     0.0000 (1.0)           0;0  1.4118 (0.78)          1           1
test_sharing_gs-pull-noop[3.0.0]      824.3897 (1.50)     824.3897 (1.50)     824.3897 (1.50)     0.0000 (1.0)      824.3897 (1.50)     0.0000 (1.0)           0;0  1.2130 (0.67)          1           1
test_sharing_gs-pull-noop[3.0.0]      823.4987 (1.50)     823.4987 (1.50)     823.4987 (1.50)     0.0000 (1.0)      823.4987 (1.50)     0.0000 (1.0)           0;0  1.2143 (0.67)          1           1
test_sharing_gs-pull-noop[main]       809.8743 (1.48)     809.8743 (1.48)     809.8743 (1.48)     0.0000 (1.0)      809.8743 (1.48)     0.0000 (1.0)           0;0  1.2348 (0.68)          1           1
test_sharing_gs-pull-noop[main]       823.0290 (1.50)     823.0290 (1.50)     823.0290 (1.50)     0.0000 (1.0)      823.0290 (1.50)     0.0000 (1.0)           0;0  1.2150 (0.67)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests -----------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.11.0]     4.1870 (2.43)     4.1870 (2.43)     4.1870 (2.43)     0.0000 (1.0)      4.1870 (2.43)     0.0000 (1.0)           0;0  0.2388 (0.41)          1           1
test_sharing_gs-push[2.11.0]     4.0291 (2.34)     4.0291 (2.34)     4.0291 (2.34)     0.0000 (1.0)      4.0291 (2.34)     0.0000 (1.0)           0;0  0.2482 (0.43)          1           1
test_sharing_gs-push[2.40.0]     5.1557 (3.00)     5.1557 (3.00)     5.1557 (3.00)     0.0000 (1.0)      5.1557 (3.00)     0.0000 (1.0)           0;0  0.1940 (0.33)          1           1
test_sharing_gs-push[2.40.0]     5.1237 (2.98)     5.1237 (2.98)     5.1237 (2.98)     0.0000 (1.0)      5.1237 (2.98)     0.0000 (1.0)           0;0  0.1952 (0.34)          1           1
test_sharing_gs-push[2.58.2]     3.5142 (2.04)     3.5142 (2.04)     3.5142 (2.04)     0.0000 (1.0)      3.5142 (2.04)     0.0000 (1.0)           0;0  0.2846 (0.49)          1           1
test_sharing_gs-push[2.58.2]     3.5269 (2.05)     3.5269 (2.05)     3.5269 (2.05)     0.0000 (1.0)      3.5269 (2.05)     0.0000 (1.0)           0;0  0.2835 (0.49)          1           1
test_sharing_gs-push[3.0.0]      1.7205 (1.0)      1.7205 (1.0)      1.7205 (1.0)      0.0000 (1.0)      1.7205 (1.0)      0.0000 (1.0)           0;0  0.5812 (1.0)           1           1
test_sharing_gs-push[3.0.0]      2.1033 (1.22)     2.1033 (1.22)     2.1033 (1.22)     0.0000 (1.0)      2.1033 (1.22)     0.0000 (1.0)           0;0  0.4755 (0.82)          1           1
test_sharing_gs-push[main]       3.5283 (2.05)     3.5283 (2.05)     3.5283 (2.05)     0.0000 (1.0)      3.5283 (2.05)     0.0000 (1.0)           0;0  0.2834 (0.49)          1           1
test_sharing_gs-push[main]       3.5375 (2.06)     3.5375 (2.06)     3.5375 (2.06)     0.0000 (1.0)      3.5375 (2.06)     0.0000 (1.0)           0;0  0.2827 (0.49)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.11.0]     461.4610 (1.01)     461.4610 (1.01)     461.4610 (1.01)     0.0000 (1.0)      461.4610 (1.01)     0.0000 (1.0)           0;0  2.1670 (0.99)          1           1
test_sharing_gs-push-noop[2.11.0]     456.7538 (1.0)      456.7538 (1.0)      456.7538 (1.0)      0.0000 (1.0)      456.7538 (1.0)      0.0000 (1.0)           0;0  2.1894 (1.0)           1           1
test_sharing_gs-push-noop[2.40.0]     483.0645 (1.06)     483.0645 (1.06)     483.0645 (1.06)     0.0000 (1.0)      483.0645 (1.06)     0.0000 (1.0)           0;0  2.0701 (0.95)          1           1
test_sharing_gs-push-noop[2.40.0]     494.8492 (1.08)     494.8492 (1.08)     494.8492 (1.08)     0.0000 (1.0)      494.8492 (1.08)     0.0000 (1.0)           0;0  2.0208 (0.92)          1           1
test_sharing_gs-push-noop[2.58.2]     540.7812 (1.18)     540.7812 (1.18)     540.7812 (1.18)     0.0000 (1.0)      540.7812 (1.18)     0.0000 (1.0)           0;0  1.8492 (0.84)          1           1
test_sharing_gs-push-noop[2.58.2]     539.4869 (1.18)     539.4869 (1.18)     539.4869 (1.18)     0.0000 (1.0)      539.4869 (1.18)     0.0000 (1.0)           0;0  1.8536 (0.85)          1           1
test_sharing_gs-push-noop[3.0.0]      533.4858 (1.17)     533.4858 (1.17)     533.4858 (1.17)     0.0000 (1.0)      533.4858 (1.17)     0.0000 (1.0)           0;0  1.8745 (0.86)          1           1
test_sharing_gs-push-noop[3.0.0]      817.4576 (1.79)     817.4576 (1.79)     817.4576 (1.79)     0.0000 (1.0)      817.4576 (1.79)     0.0000 (1.0)           0;0  1.2233 (0.56)          1           1
test_sharing_gs-push-noop[main]       527.3940 (1.15)     527.3940 (1.15)     527.3940 (1.15)     0.0000 (1.0)      527.3940 (1.15)     0.0000 (1.0)           0;0  1.8961 (0.87)          1           1
test_sharing_gs-push-noop[main]       528.8746 (1.16)     528.8746 (1.16)     528.8746 (1.16)     0.0000 (1.0)      528.8746 (1.16)     0.0000 (1.0)           0;0  1.8908 (0.86)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0]     472.3045 (1.0)      566.6803 (1.0)      499.9766 (1.0)      16.1992 (1.0)      495.9781 (1.0)      22.6892 (1.0)          31;1  2.0001 (1.0)         100           1
test_init-init[2.40.0]     549.8548 (1.16)     688.4126 (1.21)     594.7209 (1.19)     24.7453 (1.53)     592.3937 (1.19)     27.2661 (1.20)         31;4  1.6815 (0.84)        100           1
test_init-init[2.58.2]     614.0346 (1.30)     735.8366 (1.30)     657.1665 (1.31)     24.7340 (1.53)     653.5299 (1.32)     32.6078 (1.44)         30;2  1.5217 (0.76)        100           1
test_init-init[3.0.0]      577.8935 (1.22)     741.9577 (1.31)     637.4841 (1.28)     26.0578 (1.61)     638.0170 (1.29)     28.7319 (1.27)         26;4  1.5687 (0.78)        100           1
test_init-init[main]       623.5932 (1.32)     766.8164 (1.35)     659.6124 (1.32)     22.8799 (1.41)     656.4793 (1.32)     24.6545 (1.09)         21;4  1.5160 (0.76)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0]     420.3327 (1.04)     420.3327 (1.04)     420.3327 (1.04)     0.0000 (1.0)      420.3327 (1.04)     0.0000 (1.0)           0;0  2.3791 (0.96)          1           1
test_list-list[2.40.0]     404.7331 (1.0)      404.7331 (1.0)      404.7331 (1.0)      0.0000 (1.0)      404.7331 (1.0)      0.0000 (1.0)           0;0  2.4708 (1.0)           1           1
test_list-list[2.58.2]     483.9590 (1.20)     483.9590 (1.20)     483.9590 (1.20)     0.0000 (1.0)      483.9590 (1.20)     0.0000 (1.0)           0;0  2.0663 (0.84)          1           1
test_list-list[3.0.0]      482.9229 (1.19)     482.9229 (1.19)     482.9229 (1.19)     0.0000 (1.0)      482.9229 (1.19)     0.0000 (1.0)           0;0  2.0707 (0.84)          1           1
test_list-list[main]       471.9822 (1.17)     471.9822 (1.17)     471.9822 (1.17)     0.0000 (1.0)      471.9822 (1.17)     0.0000 (1.0)           0;0  2.1187 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0]     404.3274 (1.01)     404.3274 (1.01)     404.3274 (1.01)     0.0000 (1.0)      404.3274 (1.01)     0.0000 (1.0)           0;0  2.4732 (0.99)          1           1
test_list-list-dvc-only[2.40.0]     400.5021 (1.0)      400.5021 (1.0)      400.5021 (1.0)      0.0000 (1.0)      400.5021 (1.0)      0.0000 (1.0)           0;0  2.4969 (1.0)           1           1
test_list-list-dvc-only[2.58.2]     465.7361 (1.16)     465.7361 (1.16)     465.7361 (1.16)     0.0000 (1.0)      465.7361 (1.16)     0.0000 (1.0)           0;0  2.1471 (0.86)          1           1
test_list-list-dvc-only[3.0.0]      457.0116 (1.14)     457.0116 (1.14)     457.0116 (1.14)     0.0000 (1.0)      457.0116 (1.14)     0.0000 (1.0)           0;0  2.1881 (0.88)          1           1
test_list-list-dvc-only[main]       468.4113 (1.17)     468.4113 (1.17)     468.4113 (1.17)     0.0000 (1.0)      468.4113 (1.17)     0.0000 (1.0)           0;0  2.1349 (0.86)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0]     1.6810 (3.59)     1.6810 (3.59)     1.6810 (3.59)     0.0000 (1.0)      1.6810 (3.59)     0.0000 (1.0)           0;0  0.5949 (0.28)          1           1
test_list-list-recursive[2.40.0]     0.4681 (1.0)      0.4681 (1.0)      0.4681 (1.0)      0.0000 (1.0)      0.4681 (1.0)      0.0000 (1.0)           0;0  2.1364 (1.0)           1           1
test_list-list-recursive[2.58.2]     0.5652 (1.21)     0.5652 (1.21)     0.5652 (1.21)     0.0000 (1.0)      0.5652 (1.21)     0.0000 (1.0)           0;0  1.7694 (0.83)          1           1
test_list-list-recursive[3.0.0]      0.5590 (1.19)     0.5590 (1.19)     0.5590 (1.19)     0.0000 (1.0)      0.5590 (1.19)     0.0000 (1.0)           0;0  1.7888 (0.84)          1           1
test_list-list-recursive[main]       0.5575 (1.19)     0.5575 (1.19)     0.5575 (1.19)     0.0000 (1.0)      0.5575 (1.19)     0.0000 (1.0)           0;0  1.7938 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0]     401.6731 (1.0)      401.6731 (1.0)      401.6731 (1.0)      0.0000 (1.0)      401.6731 (1.0)      0.0000 (1.0)           0;0  2.4896 (1.0)           1           1
test_list-list-shallow[2.40.0]     423.8455 (1.06)     423.8455 (1.06)     423.8455 (1.06)     0.0000 (1.0)      423.8455 (1.06)     0.0000 (1.0)           0;0  2.3594 (0.95)          1           1
test_list-list-shallow[2.58.2]     470.1048 (1.17)     470.1048 (1.17)     470.1048 (1.17)     0.0000 (1.0)      470.1048 (1.17)     0.0000 (1.0)           0;0  2.1272 (0.85)          1           1
test_list-list-shallow[3.0.0]      457.0322 (1.14)     457.0322 (1.14)     457.0322 (1.14)     0.0000 (1.0)      457.0322 (1.14)     0.0000 (1.0)           0;0  2.1880 (0.88)          1           1
test_list-list-shallow[main]       459.6019 (1.14)     459.6019 (1.14)     459.6019 (1.14)     0.0000 (1.0)      459.6019 (1.14)     0.0000 (1.0)           0;0  2.1758 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0]     7.4650 (1.82)     7.4650 (1.82)     7.4650 (1.82)     0.0000 (1.0)      7.4650 (1.82)     0.0000 (1.0)           0;0  0.1340 (0.55)          1           1
test_partial_remove-add[2.40.0]     6.0868 (1.48)     6.0868 (1.48)     6.0868 (1.48)     0.0000 (1.0)      6.0868 (1.48)     0.0000 (1.0)           0;0  0.1643 (0.67)          1           1
test_partial_remove-add[2.58.2]     4.1083 (1.0)      4.1083 (1.0)      4.1083 (1.0)      0.0000 (1.0)      4.1083 (1.0)      0.0000 (1.0)           0;0  0.2434 (1.0)           1           1
test_partial_remove-add[3.0.0]      4.1242 (1.00)     4.1242 (1.00)     4.1242 (1.00)     0.0000 (1.0)      4.1242 (1.00)     0.0000 (1.0)           0;0  0.2425 (1.00)          1           1
test_partial_remove-add[main]       4.2476 (1.03)     4.2476 (1.03)     4.2476 (1.03)     0.0000 (1.0)      4.2476 (1.03)     0.0000 (1.0)           0;0  0.2354 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.11.0]     2.7826 (1.77)     2.7826 (1.77)     2.7826 (1.77)     0.0000 (1.0)      2.7826 (1.77)     0.0000 (1.0)           0;0  0.3594 (0.56)          1           1
test_partial_remove-add-update[2.40.0]     1.5695 (1.0)      1.5695 (1.0)      1.5695 (1.0)      0.0000 (1.0)      1.5695 (1.0)      0.0000 (1.0)           0;0  0.6371 (1.0)           1           1
test_partial_remove-add-update[2.58.2]     1.6772 (1.07)     1.6772 (1.07)     1.6772 (1.07)     0.0000 (1.0)      1.6772 (1.07)     0.0000 (1.0)           0;0  0.5962 (0.94)          1           1
test_partial_remove-add-update[3.0.0]      1.6711 (1.06)     1.6711 (1.06)     1.6711 (1.06)     0.0000 (1.0)      1.6711 (1.06)     0.0000 (1.0)           0;0  0.5984 (0.94)          1           1
test_partial_remove-add-update[main]       1.6593 (1.06)     1.6593 (1.06)     1.6593 (1.06)     0.0000 (1.0)      1.6593 (1.06)     0.0000 (1.0)           0;0  0.6027 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0]     453.3915 (1.0)      453.3915 (1.0)      453.3915 (1.0)      0.0000 (1.0)      453.3915 (1.0)      0.0000 (1.0)           0;0  2.2056 (1.0)           1           1
test_partial_remove-gc[2.40.0]     537.7173 (1.19)     537.7173 (1.19)     537.7173 (1.19)     0.0000 (1.0)      537.7173 (1.19)     0.0000 (1.0)           0;0  1.8597 (0.84)          1           1
test_partial_remove-gc[2.58.2]     602.8722 (1.33)     602.8722 (1.33)     602.8722 (1.33)     0.0000 (1.0)      602.8722 (1.33)     0.0000 (1.0)           0;0  1.6587 (0.75)          1           1
test_partial_remove-gc[3.0.0]      640.4099 (1.41)     640.4099 (1.41)     640.4099 (1.41)     0.0000 (1.0)      640.4099 (1.41)     0.0000 (1.0)           0;0  1.5615 (0.71)          1           1
test_partial_remove-gc[main]       642.7483 (1.42)     642.7483 (1.42)     642.7483 (1.42)     0.0000 (1.0)      642.7483 (1.42)     0.0000 (1.0)           0;0  1.5558 (0.71)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0]     514.5392 (1.0)      514.5392 (1.0)      514.5392 (1.0)      0.0000 (1.0)      514.5392 (1.0)      0.0000 (1.0)           0;0  1.9435 (1.0)           1           1
test_partial_remove-gc-cloud[2.40.0]     582.6760 (1.13)     582.6760 (1.13)     582.6760 (1.13)     0.0000 (1.0)      582.6760 (1.13)     0.0000 (1.0)           0;0  1.7162 (0.88)          1           1
test_partial_remove-gc-cloud[2.58.2]     689.1462 (1.34)     689.1462 (1.34)     689.1462 (1.34)     0.0000 (1.0)      689.1462 (1.34)     0.0000 (1.0)           0;0  1.4511 (0.75)          1           1
test_partial_remove-gc-cloud[3.0.0]      736.1501 (1.43)     736.1501 (1.43)     736.1501 (1.43)     0.0000 (1.0)      736.1501 (1.43)     0.0000 (1.0)           0;0  1.3584 (0.70)          1           1
test_partial_remove-gc-cloud[main]       705.4239 (1.37)     705.4239 (1.37)     705.4239 (1.37)     0.0000 (1.0)      705.4239 (1.37)     0.0000 (1.0)           0;0  1.4176 (0.73)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0]     4.0196 (2.33)     4.0196 (2.33)     4.0196 (2.33)     0.0000 (1.0)      4.0196 (2.33)     0.0000 (1.0)           0;0  0.2488 (0.43)          1           1
test_partial_remove-push[2.40.0]     5.1515 (2.99)     5.1515 (2.99)     5.1515 (2.99)     0.0000 (1.0)      5.1515 (2.99)     0.0000 (1.0)           0;0  0.1941 (0.33)          1           1
test_partial_remove-push[2.58.2]     3.6016 (2.09)     3.6016 (2.09)     3.6016 (2.09)     0.0000 (1.0)      3.6016 (2.09)     0.0000 (1.0)           0;0  0.2777 (0.48)          1           1
test_partial_remove-push[3.0.0]      1.7217 (1.0)      1.7217 (1.0)      1.7217 (1.0)      0.0000 (1.0)      1.7217 (1.0)      0.0000 (1.0)           0;0  0.5808 (1.0)           1           1
test_partial_remove-push[main]       3.4825 (2.02)     3.4825 (2.02)     3.4825 (2.02)     0.0000 (1.0)      3.4825 (2.02)     0.0000 (1.0)           0;0  0.2871 (0.49)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.11.0]     495.1204 (1.0)      495.1204 (1.0)      495.1204 (1.0)      0.0000 (1.0)      495.1204 (1.0)      0.0000 (1.0)           0;0  2.0197 (1.0)           1           1
test_partial_remove-push-update[2.40.0]     554.9198 (1.12)     554.9198 (1.12)     554.9198 (1.12)     0.0000 (1.0)      554.9198 (1.12)     0.0000 (1.0)           0;0  1.8021 (0.89)          1           1
test_partial_remove-push-update[2.58.2]     597.9849 (1.21)     597.9849 (1.21)     597.9849 (1.21)     0.0000 (1.0)      597.9849 (1.21)     0.0000 (1.0)           0;0  1.6723 (0.83)          1           1
test_partial_remove-push-update[3.0.0]      591.4336 (1.19)     591.4336 (1.19)     591.4336 (1.19)     0.0000 (1.0)      591.4336 (1.19)     0.0000 (1.0)           0;0  1.6908 (0.84)          1           1
test_partial_remove-push-update[main]       570.1566 (1.15)     570.1566 (1.15)     570.1566 (1.15)     0.0000 (1.0)      570.1566 (1.15)     0.0000 (1.0)           0;0  1.7539 (0.87)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0]     185.1172 (1.0)      213.2949 (1.10)     188.7464 (1.0)      3.7726 (2.93)     187.7926 (1.0)      1.7959 (1.34)          6;9  5.2981 (1.0)         100           1
test_help---help[2.40.0]     243.0532 (1.31)     261.9216 (1.36)     246.0622 (1.30)     2.8637 (2.23)     245.4809 (1.31)     2.1040 (1.57)          7;5  4.0640 (0.77)        100           1
test_help---help[2.58.2]     195.1960 (1.05)     228.3596 (1.18)     198.6972 (1.05)     4.2904 (3.34)     197.6972 (1.05)     2.3892 (1.78)          8;8  5.0328 (0.95)        100           1
test_help---help[3.0.0]      188.7782 (1.02)     200.3819 (1.04)     191.5413 (1.01)     2.5208 (1.96)     190.9262 (1.02)     2.2862 (1.70)         20;9  5.2208 (0.99)        100           1
test_help---help[main]       185.7181 (1.00)     193.2913 (1.0)      188.7920 (1.00)     1.2860 (1.0)      188.7047 (1.00)     1.3414 (1.0)          27;6  5.2968 (1.00)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 5 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0]     4.4325 (1.0)      4.4325 (1.0)      4.4325 (1.0)      0.0000 (1.0)      4.4325 (1.0)      0.0000 (1.0)           0;0  0.2256 (1.0)           1           1
test_get_url-get-url[2.40.0]     4.5748 (1.03)     4.5748 (1.03)     4.5748 (1.03)     0.0000 (1.0)      4.5748 (1.03)     0.0000 (1.0)           0;0  0.2186 (0.97)          1           1
test_get_url-get-url[2.58.2]     4.6679 (1.05)     4.6679 (1.05)     4.6679 (1.05)     0.0000 (1.0)      4.6679 (1.05)     0.0000 (1.0)           0;0  0.2142 (0.95)          1           1
test_get_url-get-url[3.0.0]      4.4821 (1.01)     4.4821 (1.01)     4.4821 (1.01)     0.0000 (1.0)      4.4821 (1.01)     0.0000 (1.0)           0;0  0.2231 (0.99)          1           1
test_get_url-get-url[main]       4.6951 (1.06)     4.6951 (1.06)     4.6951 (1.06)     0.0000 (1.0)      4.6951 (1.06)     0.0000 (1.0)           0;0  0.2130 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.40.0]       907.8287 (1.0)        907.8287 (1.0)        907.8287 (1.0)      0.0000 (1.0)        907.8287 (1.0)      0.0000 (1.0)           0;0  1.1015 (1.0)           1           1
test_exp_show-exp[2.58.2]     1,061.8537 (1.17)     1,061.8537 (1.17)     1,061.8537 (1.17)     0.0000 (1.0)      1,061.8537 (1.17)     0.0000 (1.0)           0;0  0.9417 (0.85)          1           1
test_exp_show-exp[3.0.0]      1,478.3525 (1.63)     1,478.3525 (1.63)     1,478.3525 (1.63)     0.0000 (1.0)      1,478.3525 (1.63)     0.0000 (1.0)           0;0  0.6764 (0.61)          1           1
test_exp_show-exp[main]       1,531.4522 (1.69)     1,531.4522 (1.69)     1,531.4522 (1.69)     0.0000 (1.0)      1,531.4522 (1.69)     0.0000 (1.0)           0;0  0.6530 (0.59)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0]     1.2957 (1.05)     1.2957 (1.05)     1.2957 (1.05)     0.0000 (1.0)      1.2957 (1.05)     0.0000 (1.0)           0;0  0.7718 (0.95)          1           1
test_checkout_hardlink-checkout[2.40.0]     1.2703 (1.03)     1.2703 (1.03)     1.2703 (1.03)     0.0000 (1.0)      1.2703 (1.03)     0.0000 (1.0)           0;0  0.7872 (0.97)          1           1
test_checkout_hardlink-checkout[2.58.2]     1.7030 (1.39)     1.7030 (1.39)     1.7030 (1.39)     0.0000 (1.0)      1.7030 (1.39)     0.0000 (1.0)           0;0  0.5872 (0.72)          1           1
test_checkout_hardlink-checkout[3.0.0]      1.7986 (1.46)     1.7986 (1.46)     1.7986 (1.46)     0.0000 (1.0)      1.7986 (1.46)     0.0000 (1.0)           0;0  0.5560 (0.68)          1           1
test_checkout_hardlink-checkout[main]       1.2286 (1.0)      1.2286 (1.0)      1.2286 (1.0)      0.0000 (1.0)      1.2286 (1.0)      0.0000 (1.0)           0;0  0.8139 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0]     514.4746 (1.0)      514.4746 (1.0)      514.4746 (1.0)      0.0000 (1.0)      514.4746 (1.0)      0.0000 (1.0)           0;0  1.9437 (1.0)           1           1
test_checkout_hardlink-checkout-noop[2.40.0]     603.9255 (1.17)     603.9255 (1.17)     603.9255 (1.17)     0.0000 (1.0)      603.9255 (1.17)     0.0000 (1.0)           0;0  1.6558 (0.85)          1           1
test_checkout_hardlink-checkout-noop[2.58.2]     672.5156 (1.31)     672.5156 (1.31)     672.5156 (1.31)     0.0000 (1.0)      672.5156 (1.31)     0.0000 (1.0)           0;0  1.4870 (0.77)          1           1
test_checkout_hardlink-checkout-noop[3.0.0]      692.6631 (1.35)     692.6631 (1.35)     692.6631 (1.35)     0.0000 (1.0)      692.6631 (1.35)     0.0000 (1.0)           0;0  1.4437 (0.74)          1           1
test_checkout_hardlink-checkout-noop[main]       686.3709 (1.33)     686.3709 (1.33)     686.3709 (1.33)     0.0000 (1.0)      686.3709 (1.33)     0.0000 (1.0)           0;0  1.4569 (0.75)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0]     1.3230 (1.94)     1.3230 (1.94)     1.3230 (1.94)     0.0000 (1.0)      1.3230 (1.94)     0.0000 (1.0)           0;0  0.7559 (0.51)          1           1
test_checkout_hardlink-checkout-update[2.40.0]     0.6809 (1.0)      0.6809 (1.0)      0.6809 (1.0)      0.0000 (1.0)      0.6809 (1.0)      0.0000 (1.0)           0;0  1.4687 (1.0)           1           1
test_checkout_hardlink-checkout-update[2.58.2]     0.8882 (1.30)     0.8882 (1.30)     0.8882 (1.30)     0.0000 (1.0)      0.8882 (1.30)     0.0000 (1.0)           0;0  1.1258 (0.77)          1           1
test_checkout_hardlink-checkout-update[3.0.0]      0.7777 (1.14)     0.7777 (1.14)     0.7777 (1.14)     0.0000 (1.0)      0.7777 (1.14)     0.0000 (1.0)           0;0  1.2859 (0.88)          1           1
test_checkout_hardlink-checkout-update[main]       0.7646 (1.12)     0.7646 (1.12)     0.7646 (1.12)     0.0000 (1.0)      0.7646 (1.12)     0.0000 (1.0)           0;0  1.3078 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.11.0]     3.6168 (1.71)     3.6168 (1.71)     3.6168 (1.71)     0.0000 (1.0)      3.6168 (1.71)     0.0000 (1.0)           0;0  0.2765 (0.59)          1           1
test_partial_add-add[2.40.0]     3.0119 (1.42)     3.0119 (1.42)     3.0119 (1.42)     0.0000 (1.0)      3.0119 (1.42)     0.0000 (1.0)           0;0  0.3320 (0.70)          1           1
test_partial_add-add[2.58.2]     2.5478 (1.20)     2.5478 (1.20)     2.5478 (1.20)     0.0000 (1.0)      2.5478 (1.20)     0.0000 (1.0)           0;0  0.3925 (0.83)          1           1
test_partial_add-add[3.0.0]      2.2831 (1.08)     2.2831 (1.08)     2.2831 (1.08)     0.0000 (1.0)      2.2831 (1.08)     0.0000 (1.0)           0;0  0.4380 (0.93)          1           1
test_partial_add-add[main]       2.1207 (1.0)      2.1207 (1.0)      2.1207 (1.0)      0.0000 (1.0)      2.1207 (1.0)      0.0000 (1.0)           0;0  0.4716 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.11.0]     5.8688 (1.90)     5.8688 (1.90)     5.8688 (1.90)     0.0000 (1.0)      5.8688 (1.90)     0.0000 (1.0)           0;0  0.1704 (0.53)          1           1
test_partial_add-add-partial[2.40.0]     3.9693 (1.29)     3.9693 (1.29)     3.9693 (1.29)     0.0000 (1.0)      3.9693 (1.29)     0.0000 (1.0)           0;0  0.2519 (0.78)          1           1
test_partial_add-add-partial[2.58.2]     3.0942 (1.00)     3.0942 (1.00)     3.0942 (1.00)     0.0000 (1.0)      3.0942 (1.00)     0.0000 (1.0)           0;0  0.3232 (1.00)          1           1
test_partial_add-add-partial[3.0.0]      3.0833 (1.0)      3.0833 (1.0)      3.0833 (1.0)      0.0000 (1.0)      3.0833 (1.0)      0.0000 (1.0)           0;0  0.3243 (1.0)           1           1
test_partial_add-add-partial[main]       3.0899 (1.00)     3.0899 (1.00)     3.0899 (1.00)     0.0000 (1.0)      3.0899 (1.00)     0.0000 (1.0)           0;0  0.3236 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0]     479.7919 (1.0)      479.7919 (1.0)      479.7919 (1.0)      0.0000 (1.0)      479.7919 (1.0)      0.0000 (1.0)           0;0  2.0842 (1.0)           1           1
test_partial_add-gc-cloud-noop[2.40.0]     555.8343 (1.16)     555.8343 (1.16)     555.8343 (1.16)     0.0000 (1.0)      555.8343 (1.16)     0.0000 (1.0)           0;0  1.7991 (0.86)          1           1
test_partial_add-gc-cloud-noop[2.58.2]     669.7217 (1.40)     669.7217 (1.40)     669.7217 (1.40)     0.0000 (1.0)      669.7217 (1.40)     0.0000 (1.0)           0;0  1.4932 (0.72)          1           1
test_partial_add-gc-cloud-noop[3.0.0]      761.7355 (1.59)     761.7355 (1.59)     761.7355 (1.59)     0.0000 (1.0)      761.7355 (1.59)     0.0000 (1.0)           0;0  1.3128 (0.63)          1           1
test_partial_add-gc-cloud-noop[main]       757.7096 (1.58)     757.7096 (1.58)     757.7096 (1.58)     0.0000 (1.0)      757.7096 (1.58)     0.0000 (1.0)           0;0  1.3198 (0.63)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0]     419.3579 (1.0)      419.3579 (1.0)      419.3579 (1.0)      0.0000 (1.0)      419.3579 (1.0)      0.0000 (1.0)           0;0  2.3846 (1.0)           1           1
test_partial_add-gc-noop[2.40.0]     491.4720 (1.17)     491.4720 (1.17)     491.4720 (1.17)     0.0000 (1.0)      491.4720 (1.17)     0.0000 (1.0)           0;0  2.0347 (0.85)          1           1
test_partial_add-gc-noop[2.58.2]     577.8694 (1.38)     577.8694 (1.38)     577.8694 (1.38)     0.0000 (1.0)      577.8694 (1.38)     0.0000 (1.0)           0;0  1.7305 (0.73)          1           1
test_partial_add-gc-noop[3.0.0]      662.2147 (1.58)     662.2147 (1.58)     662.2147 (1.58)     0.0000 (1.0)      662.2147 (1.58)     0.0000 (1.0)           0;0  1.5101 (0.63)          1           1
test_partial_add-gc-noop[main]       669.4700 (1.60)     669.4700 (1.60)     669.4700 (1.60)     0.0000 (1.0)      669.4700 (1.60)     0.0000 (1.0)           0;0  1.4937 (0.63)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.11.0]     2.0430 (1.95)     2.0430 (1.95)     2.0430 (1.95)     0.0000 (1.0)      2.0430 (1.95)     0.0000 (1.0)           0;0  0.4895 (0.51)          1           1
test_partial_add-push[2.40.0]     2.5688 (2.45)     2.5688 (2.45)     2.5688 (2.45)     0.0000 (1.0)      2.5688 (2.45)     0.0000 (1.0)           0;0  0.3893 (0.41)          1           1
test_partial_add-push[2.58.2]     1.8671 (1.78)     1.8671 (1.78)     1.8671 (1.78)     0.0000 (1.0)      1.8671 (1.78)     0.0000 (1.0)           0;0  0.5356 (0.56)          1           1
test_partial_add-push[3.0.0]      1.0478 (1.0)      1.0478 (1.0)      1.0478 (1.0)      0.0000 (1.0)      1.0478 (1.0)      0.0000 (1.0)           0;0  0.9544 (1.0)           1           1
test_partial_add-push[main]       1.8571 (1.77)     1.8571 (1.77)     1.8571 (1.77)     0.0000 (1.0)      1.8571 (1.77)     0.0000 (1.0)           0;0  0.5385 (0.56)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.11.0]     2.1273 (1.92)     2.1273 (1.92)     2.1273 (1.92)     0.0000 (1.0)      2.1273 (1.92)     0.0000 (1.0)           0;0  0.4701 (0.52)          1           1
test_partial_add-push-partial[2.40.0]     2.6697 (2.41)     2.6697 (2.41)     2.6697 (2.41)     0.0000 (1.0)      2.6697 (2.41)     0.0000 (1.0)           0;0  0.3746 (0.42)          1           1
test_partial_add-push-partial[2.58.2]     1.9281 (1.74)     1.9281 (1.74)     1.9281 (1.74)     0.0000 (1.0)      1.9281 (1.74)     0.0000 (1.0)           0;0  0.5186 (0.58)          1           1
test_partial_add-push-partial[3.0.0]      1.1100 (1.0)      1.1100 (1.0)      1.1100 (1.0)      0.0000 (1.0)      1.1100 (1.0)      0.0000 (1.0)           0;0  0.9009 (1.0)           1           1
test_partial_add-push-partial[main]       1.9307 (1.74)     1.9307 (1.74)     1.9307 (1.74)     0.0000 (1.0)      1.9307 (1.74)     0.0000 (1.0)           0;0  0.5179 (0.57)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests -----------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.11.0]     8.6629 (2.02)     8.6629 (2.02)     8.6629 (2.02)     0.0000 (1.0)      8.6629 (2.02)     0.0000 (1.0)           0;0  0.1154 (0.49)          1           1
test_sharing_azure-add[2.11.0]     8.5592 (2.00)     8.5592 (2.00)     8.5592 (2.00)     0.0000 (1.0)      8.5592 (2.00)     0.0000 (1.0)           0;0  0.1168 (0.50)          1           1
test_sharing_azure-add[2.40.0]     6.4750 (1.51)     6.4750 (1.51)     6.4750 (1.51)     0.0000 (1.0)      6.4750 (1.51)     0.0000 (1.0)           0;0  0.1544 (0.66)          1           1
test_sharing_azure-add[2.40.0]     6.2010 (1.45)     6.2010 (1.45)     6.2010 (1.45)     0.0000 (1.0)      6.2010 (1.45)     0.0000 (1.0)           0;0  0.1613 (0.69)          1           1
test_sharing_azure-add[2.58.2]     4.5463 (1.06)     4.5463 (1.06)     4.5463 (1.06)     0.0000 (1.0)      4.5463 (1.06)     0.0000 (1.0)           0;0  0.2200 (0.94)          1           1
test_sharing_azure-add[2.58.2]     4.3118 (1.01)     4.3118 (1.01)     4.3118 (1.01)     0.0000 (1.0)      4.3118 (1.01)     0.0000 (1.0)           0;0  0.2319 (0.99)          1           1
test_sharing_azure-add[3.0.0]      4.2782 (1.0)      4.2782 (1.0)      4.2782 (1.0)      0.0000 (1.0)      4.2782 (1.0)      0.0000 (1.0)           0;0  0.2337 (1.0)           1           1
test_sharing_azure-add[3.0.0]      4.4646 (1.04)     4.4646 (1.04)     4.4646 (1.04)     0.0000 (1.0)      4.4646 (1.04)     0.0000 (1.0)           0;0  0.2240 (0.96)          1           1
test_sharing_azure-add[main]       4.5062 (1.05)     4.5062 (1.05)     4.5062 (1.05)     0.0000 (1.0)      4.5062 (1.05)     0.0000 (1.0)           0;0  0.2219 (0.95)          1           1
test_sharing_azure-add[main]       4.5541 (1.06)     4.5541 (1.06)     4.5541 (1.06)     0.0000 (1.0)      4.5541 (1.06)     0.0000 (1.0)           0;0  0.2196 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.11.0]     3.9487 (1.55)     3.9487 (1.55)     3.9487 (1.55)     0.0000 (1.0)      3.9487 (1.55)     0.0000 (1.0)           0;0  0.2532 (0.64)          1           1
test_sharing_azure-add-noop[2.11.0]     3.8530 (1.51)     3.8530 (1.51)     3.8530 (1.51)     0.0000 (1.0)      3.8530 (1.51)     0.0000 (1.0)           0;0  0.2595 (0.66)          1           1
test_sharing_azure-add-noop[2.40.0]     2.5789 (1.01)     2.5789 (1.01)     2.5789 (1.01)     0.0000 (1.0)      2.5789 (1.01)     0.0000 (1.0)           0;0  0.3878 (0.99)          1           1
test_sharing_azure-add-noop[2.40.0]     2.5468 (1.0)      2.5468 (1.0)      2.5468 (1.0)      0.0000 (1.0)      2.5468 (1.0)      0.0000 (1.0)           0;0  0.3926 (1.0)           1           1
test_sharing_azure-add-noop[2.58.2]     2.9996 (1.18)     2.9996 (1.18)     2.9996 (1.18)     0.0000 (1.0)      2.9996 (1.18)     0.0000 (1.0)           0;0  0.3334 (0.85)          1           1
test_sharing_azure-add-noop[2.58.2]     2.7926 (1.10)     2.7926 (1.10)     2.7926 (1.10)     0.0000 (1.0)      2.7926 (1.10)     0.0000 (1.0)           0;0  0.3581 (0.91)          1           1
test_sharing_azure-add-noop[3.0.0]      2.8422 (1.12)     2.8422 (1.12)     2.8422 (1.12)     0.0000 (1.0)      2.8422 (1.12)     0.0000 (1.0)           0;0  0.3518 (0.90)          1           1
test_sharing_azure-add-noop[3.0.0]      2.9781 (1.17)     2.9781 (1.17)     2.9781 (1.17)     0.0000 (1.0)      2.9781 (1.17)     0.0000 (1.0)           0;0  0.3358 (0.86)          1           1
test_sharing_azure-add-noop[main]       3.0536 (1.20)     3.0536 (1.20)     3.0536 (1.20)     0.0000 (1.0)      3.0536 (1.20)     0.0000 (1.0)           0;0  0.3275 (0.83)          1           1
test_sharing_azure-add-noop[main]       3.0029 (1.18)     3.0029 (1.18)     3.0029 (1.18)     0.0000 (1.0)      3.0029 (1.18)     0.0000 (1.0)           0;0  0.3330 (0.85)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.11.0]     565.2027 (1.0)      565.2027 (1.0)      565.2027 (1.0)      0.0000 (1.0)      565.2027 (1.0)      0.0000 (1.0)           0;0  1.7693 (1.0)           1           1
test_sharing_azure-checkout-noop[2.11.0]     572.8812 (1.01)     572.8812 (1.01)     572.8812 (1.01)     0.0000 (1.0)      572.8812 (1.01)     0.0000 (1.0)           0;0  1.7456 (0.99)          1           1
test_sharing_azure-checkout-noop[2.40.0]     617.2567 (1.09)     617.2567 (1.09)     617.2567 (1.09)     0.0000 (1.0)      617.2567 (1.09)     0.0000 (1.0)           0;0  1.6201 (0.92)          1           1
test_sharing_azure-checkout-noop[2.40.0]     662.2117 (1.17)     662.2117 (1.17)     662.2117 (1.17)     0.0000 (1.0)      662.2117 (1.17)     0.0000 (1.0)           0;0  1.5101 (0.85)          1           1
test_sharing_azure-checkout-noop[2.58.2]     683.0368 (1.21)     683.0368 (1.21)     683.0368 (1.21)     0.0000 (1.0)      683.0368 (1.21)     0.0000 (1.0)           0;0  1.4640 (0.83)          1           1
test_sharing_azure-checkout-noop[2.58.2]     639.9705 (1.13)     639.9705 (1.13)     639.9705 (1.13)     0.0000 (1.0)      639.9705 (1.13)     0.0000 (1.0)           0;0  1.5626 (0.88)          1           1
test_sharing_azure-checkout-noop[3.0.0]      687.4567 (1.22)     687.4567 (1.22)     687.4567 (1.22)     0.0000 (1.0)      687.4567 (1.22)     0.0000 (1.0)           0;0  1.4546 (0.82)          1           1
test_sharing_azure-checkout-noop[3.0.0]      724.8883 (1.28)     724.8883 (1.28)     724.8883 (1.28)     0.0000 (1.0)      724.8883 (1.28)     0.0000 (1.0)           0;0  1.3795 (0.78)          1           1
test_sharing_azure-checkout-noop[main]       726.6345 (1.29)     726.6345 (1.29)     726.6345 (1.29)     0.0000 (1.0)      726.6345 (1.29)     0.0000 (1.0)           0;0  1.3762 (0.78)          1           1
test_sharing_azure-checkout-noop[main]       703.2461 (1.24)     703.2461 (1.24)     703.2461 (1.24)     0.0000 (1.0)      703.2461 (1.24)     0.0000 (1.0)           0;0  1.4220 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull[2.11.0]     8.0988 (1.40)     8.0988 (1.40)     8.0988 (1.40)     0.0000 (1.0)      8.0988 (1.40)     0.0000 (1.0)           0;0  0.1235 (0.72)          1           1
test_sharing_azure-pull[2.11.0]     8.3156 (1.43)     8.3156 (1.43)     8.3156 (1.43)     0.0000 (1.0)      8.3156 (1.43)     0.0000 (1.0)           0;0  0.1203 (0.70)          1           1
test_sharing_azure-pull[2.40.0]     8.9579 (1.55)     8.9579 (1.55)     8.9579 (1.55)     0.0000 (1.0)      8.9579 (1.55)     0.0000 (1.0)           0;0  0.1116 (0.65)          1           1
test_sharing_azure-pull[2.40.0]     9.5863 (1.65)     9.5863 (1.65)     9.5863 (1.65)     0.0000 (1.0)      9.5863 (1.65)     0.0000 (1.0)           0;0  0.1043 (0.60)          1           1
test_sharing_azure-pull[2.58.2]     5.8799 (1.01)     5.8799 (1.01)     5.8799 (1.01)     0.0000 (1.0)      5.8799 (1.01)     0.0000 (1.0)           0;0  0.1701 (0.99)          1           1
test_sharing_azure-pull[2.58.2]     5.7967 (1.0)      5.7967 (1.0)      5.7967 (1.0)      0.0000 (1.0)      5.7967 (1.0)      0.0000 (1.0)           0;0  0.1725 (1.0)           1           1
test_sharing_azure-pull[3.0.0]      8.4337 (1.45)     8.4337 (1.45)     8.4337 (1.45)     0.0000 (1.0)      8.4337 (1.45)     0.0000 (1.0)           0;0  0.1186 (0.69)          1           1
test_sharing_azure-pull[3.0.0]      8.7037 (1.50)     8.7037 (1.50)     8.7037 (1.50)     0.0000 (1.0)      8.7037 (1.50)     0.0000 (1.0)           0;0  0.1149 (0.67)          1           1
test_sharing_azure-pull[main]       8.5975 (1.48)     8.5975 (1.48)     8.5975 (1.48)     0.0000 (1.0)      8.5975 (1.48)     0.0000 (1.0)           0;0  0.1163 (0.67)          1           1
test_sharing_azure-pull[main]       8.6736 (1.50)     8.6736 (1.50)     8.6736 (1.50)     0.0000 (1.0)      8.6736 (1.50)     0.0000 (1.0)           0;0  0.1153 (0.67)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull-noop[2.11.0]     599.4453 (1.00)     599.4453 (1.00)     599.4453 (1.00)     0.0000 (1.0)      599.4453 (1.00)     0.0000 (1.0)           0;0  1.6682 (1.00)          1           1
test_sharing_azure-pull-noop[2.11.0]     599.1758 (1.0)      599.1758 (1.0)      599.1758 (1.0)      0.0000 (1.0)      599.1758 (1.0)      0.0000 (1.0)           0;0  1.6690 (1.0)           1           1
test_sharing_azure-pull-noop[2.40.0]     650.5838 (1.09)     650.5838 (1.09)     650.5838 (1.09)     0.0000 (1.0)      650.5838 (1.09)     0.0000 (1.0)           0;0  1.5371 (0.92)          1           1
test_sharing_azure-pull-noop[2.40.0]     696.0546 (1.16)     696.0546 (1.16)     696.0546 (1.16)     0.0000 (1.0)      696.0546 (1.16)     0.0000 (1.0)           0;0  1.4367 (0.86)          1           1
test_sharing_azure-pull-noop[2.58.2]     766.2879 (1.28)     766.2879 (1.28)     766.2879 (1.28)     0.0000 (1.0)      766.2879 (1.28)     0.0000 (1.0)           0;0  1.3050 (0.78)          1           1
test_sharing_azure-pull-noop[2.58.2]     722.5501 (1.21)     722.5501 (1.21)     722.5501 (1.21)     0.0000 (1.0)      722.5501 (1.21)     0.0000 (1.0)           0;0  1.3840 (0.83)          1           1
test_sharing_azure-pull-noop[3.0.0]      845.4666 (1.41)     845.4666 (1.41)     845.4666 (1.41)     0.0000 (1.0)      845.4666 (1.41)     0.0000 (1.0)           0;0  1.1828 (0.71)          1           1
test_sharing_azure-pull-noop[3.0.0]      887.1377 (1.48)     887.1377 (1.48)     887.1377 (1.48)     0.0000 (1.0)      887.1377 (1.48)     0.0000 (1.0)           0;0  1.1272 (0.68)          1           1
test_sharing_azure-pull-noop[main]       879.8259 (1.47)     879.8259 (1.47)     879.8259 (1.47)     0.0000 (1.0)      879.8259 (1.47)     0.0000 (1.0)           0;0  1.1366 (0.68)          1           1
test_sharing_azure-pull-noop[main]       888.3583 (1.48)     888.3583 (1.48)     888.3583 (1.48)     0.0000 (1.0)      888.3583 (1.48)     0.0000 (1.0)           0;0  1.1257 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.11.0]     4.6965 (2.63)     4.6965 (2.63)     4.6965 (2.63)     0.0000 (1.0)      4.6965 (2.63)     0.0000 (1.0)           0;0  0.2129 (0.38)          1           1
test_sharing_azure-push[2.11.0]     4.4892 (2.52)     4.4892 (2.52)     4.4892 (2.52)     0.0000 (1.0)      4.4892 (2.52)     0.0000 (1.0)           0;0  0.2228 (0.40)          1           1
test_sharing_azure-push[2.40.0]     5.2543 (2.95)     5.2543 (2.95)     5.2543 (2.95)     0.0000 (1.0)      5.2543 (2.95)     0.0000 (1.0)           0;0  0.1903 (0.34)          1           1
test_sharing_azure-push[2.40.0]     5.3288 (2.99)     5.3288 (2.99)     5.3288 (2.99)     0.0000 (1.0)      5.3288 (2.99)     0.0000 (1.0)           0;0  0.1877 (0.33)          1           1
test_sharing_azure-push[2.58.2]     3.6726 (2.06)     3.6726 (2.06)     3.6726 (2.06)     0.0000 (1.0)      3.6726 (2.06)     0.0000 (1.0)           0;0  0.2723 (0.49)          1           1
test_sharing_azure-push[2.58.2]     3.8071 (2.13)     3.8071 (2.13)     3.8071 (2.13)     0.0000 (1.0)      3.8071 (2.13)     0.0000 (1.0)           0;0  0.2627 (0.47)          1           1
test_sharing_azure-push[3.0.0]      1.7841 (1.0)      1.7841 (1.0)      1.7841 (1.0)      0.0000 (1.0)      1.7841 (1.0)      0.0000 (1.0)           0;0  0.5605 (1.0)           1           1
test_sharing_azure-push[3.0.0]      2.1856 (1.23)     2.1856 (1.23)     2.1856 (1.23)     0.0000 (1.0)      2.1856 (1.23)     0.0000 (1.0)           0;0  0.4575 (0.82)          1           1
test_sharing_azure-push[main]       3.9754 (2.23)     3.9754 (2.23)     3.9754 (2.23)     0.0000 (1.0)      3.9754 (2.23)     0.0000 (1.0)           0;0  0.2515 (0.45)          1           1
test_sharing_azure-push[main]       3.8756 (2.17)     3.8756 (2.17)     3.8756 (2.17)     0.0000 (1.0)      3.8756 (2.17)     0.0000 (1.0)           0;0  0.2580 (0.46)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.11.0]     504.0240 (1.01)     504.0240 (1.01)     504.0240 (1.01)     0.0000 (1.0)      504.0240 (1.01)     0.0000 (1.0)           0;0  1.9840 (0.99)          1           1
test_sharing_azure-push-noop[2.11.0]     503.1814 (1.01)     503.1814 (1.01)     503.1814 (1.01)     0.0000 (1.0)      503.1814 (1.01)     0.0000 (1.0)           0;0  1.9874 (0.99)          1           1
test_sharing_azure-push-noop[2.40.0]     500.2701 (1.0)      500.2701 (1.0)      500.2701 (1.0)      0.0000 (1.0)      500.2701 (1.0)      0.0000 (1.0)           0;0  1.9989 (1.0)           1           1
test_sharing_azure-push-noop[2.40.0]     504.5855 (1.01)     504.5855 (1.01)     504.5855 (1.01)     0.0000 (1.0)      504.5855 (1.01)     0.0000 (1.0)           0;0  1.9818 (0.99)          1           1
test_sharing_azure-push-noop[2.58.2]     588.0257 (1.18)     588.0257 (1.18)     588.0257 (1.18)     0.0000 (1.0)      588.0257 (1.18)     0.0000 (1.0)           0;0  1.7006 (0.85)          1           1
test_sharing_azure-push-noop[2.58.2]     592.8144 (1.18)     592.8144 (1.18)     592.8144 (1.18)     0.0000 (1.0)      592.8144 (1.18)     0.0000 (1.0)           0;0  1.6869 (0.84)          1           1
test_sharing_azure-push-noop[3.0.0]      541.0424 (1.08)     541.0424 (1.08)     541.0424 (1.08)     0.0000 (1.0)      541.0424 (1.08)     0.0000 (1.0)           0;0  1.8483 (0.92)          1           1
test_sharing_azure-push-noop[3.0.0]      823.7803 (1.65)     823.7803 (1.65)     823.7803 (1.65)     0.0000 (1.0)      823.7803 (1.65)     0.0000 (1.0)           0;0  1.2139 (0.61)          1           1
test_sharing_azure-push-noop[main]       548.4156 (1.10)     548.4156 (1.10)     548.4156 (1.10)     0.0000 (1.0)      548.4156 (1.10)     0.0000 (1.0)           0;0  1.8234 (0.91)          1           1
test_sharing_azure-push-noop[main]       559.8834 (1.12)     559.8834 (1.12)     559.8834 (1.12)     0.0000 (1.0)      559.8834 (1.12)     0.0000 (1.0)           0;0  1.7861 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.40.0]     1.7313 (1.01)     1.7313 (1.01)     1.7313 (1.01)     0.0000 (1.0)      1.7313 (1.01)     0.0000 (1.0)           0;0  0.5776 (0.99)          1           1
test_data_status_all_flags-data-changed[2.58.2]     1.7270 (1.01)     1.7270 (1.01)     1.7270 (1.01)     0.0000 (1.0)      1.7270 (1.01)     0.0000 (1.0)           0;0  0.5791 (0.99)          1           1
test_data_status_all_flags-data-changed[3.0.0]      1.8314 (1.07)     1.8314 (1.07)     1.8314 (1.07)     0.0000 (1.0)      1.8314 (1.07)     0.0000 (1.0)           0;0  0.5460 (0.93)          1           1
test_data_status_all_flags-data-changed[main]       1.7088 (1.0)      1.7088 (1.0)      1.7088 (1.0)      0.0000 (1.0)      1.7088 (1.0)      0.0000 (1.0)           0;0  0.5852 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.40.0]     1.7552 (1.03)     1.7552 (1.03)     1.7552 (1.03)     0.0000 (1.0)      1.7552 (1.03)     0.0000 (1.0)           0;0  0.5697 (0.97)          1           1
test_data_status_all_flags-data-changed-noop[2.58.2]     1.7555 (1.03)     1.7555 (1.03)     1.7555 (1.03)     0.0000 (1.0)      1.7555 (1.03)     0.0000 (1.0)           0;0  0.5696 (0.97)          1           1
test_data_status_all_flags-data-changed-noop[3.0.0]      1.8020 (1.06)     1.8020 (1.06)     1.8020 (1.06)     0.0000 (1.0)      1.8020 (1.06)     0.0000 (1.0)           0;0  0.5550 (0.94)          1           1
test_data_status_all_flags-data-changed-noop[main]       1.7027 (1.0)      1.7027 (1.0)      1.7027 (1.0)      0.0000 (1.0)      1.7027 (1.0)      0.0000 (1.0)           0;0  0.5873 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.40.0]     3.0491 (1.11)     3.0491 (1.11)     3.0491 (1.11)     0.0000 (1.0)      3.0491 (1.11)     0.0000 (1.0)           0;0  0.3280 (0.90)          1           1
test_data_status_all_flags-data-new[2.58.2]     2.8242 (1.03)     2.8242 (1.03)     2.8242 (1.03)     0.0000 (1.0)      2.8242 (1.03)     0.0000 (1.0)           0;0  0.3541 (0.98)          1           1
test_data_status_all_flags-data-new[3.0.0]      2.9334 (1.06)     2.9334 (1.06)     2.9334 (1.06)     0.0000 (1.0)      2.9334 (1.06)     0.0000 (1.0)           0;0  0.3409 (0.94)          1           1
test_data_status_all_flags-data-new[main]       2.7547 (1.0)      2.7547 (1.0)      2.7547 (1.0)      0.0000 (1.0)      2.7547 (1.0)      0.0000 (1.0)           0;0  0.3630 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.40.0]     1.6573 (1.0)      1.6573 (1.0)      1.6573 (1.0)      0.0000 (1.0)      1.6573 (1.0)      0.0000 (1.0)           0;0  0.6034 (1.0)           1           1
test_data_status_all_flags-data-noop[2.58.2]     1.6894 (1.02)     1.6894 (1.02)     1.6894 (1.02)     0.0000 (1.0)      1.6894 (1.02)     0.0000 (1.0)           0;0  0.5919 (0.98)          1           1
test_data_status_all_flags-data-noop[3.0.0]      1.7338 (1.05)     1.7338 (1.05)     1.7338 (1.05)     0.0000 (1.0)      1.7338 (1.05)     0.0000 (1.0)           0;0  0.5768 (0.96)          1           1
test_data_status_all_flags-data-noop[main]       1.6747 (1.01)     1.6747 (1.01)     1.6747 (1.01)     0.0000 (1.0)      1.6747 (1.01)     0.0000 (1.0)           0;0  0.5971 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0]     12.2951 (1.18)     12.2951 (1.18)     12.2951 (1.18)     0.0000 (1.0)      12.2951 (1.18)     0.0000 (1.0)           0;0  0.0813 (0.85)          1           1
test_import-import[2.40.0]     10.3928 (1.0)      10.3928 (1.0)      10.3928 (1.0)      0.0000 (1.0)      10.3928 (1.0)      0.0000 (1.0)           0;0  0.0962 (1.0)           1           1
test_import-import[2.58.2]     10.5539 (1.02)     10.5539 (1.02)     10.5539 (1.02)     0.0000 (1.0)      10.5539 (1.02)     0.0000 (1.0)           0;0  0.0948 (0.98)          1           1
test_import-import[3.0.0]      10.6006 (1.02)     10.6006 (1.02)     10.6006 (1.02)     0.0000 (1.0)      10.6006 (1.02)     0.0000 (1.0)           0;0  0.0943 (0.98)          1           1
test_import-import[main]       11.4075 (1.10)     11.4075 (1.10)     11.4075 (1.10)     0.0000 (1.0)      11.4075 (1.10)     0.0000 (1.0)           0;0  0.0877 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0]     5.8592 (2.36)     5.8592 (2.36)     5.8592 (2.36)     0.0000 (1.0)      5.8592 (2.36)     0.0000 (1.0)           0;0  0.1707 (0.42)          1           1
test_push-push[2.40.0]     6.9914 (2.82)     6.9914 (2.82)     6.9914 (2.82)     0.0000 (1.0)      6.9914 (2.82)     0.0000 (1.0)           0;0  0.1430 (0.36)          1           1
test_push-push[2.58.2]     4.9928 (2.01)     4.9928 (2.01)     4.9928 (2.01)     0.0000 (1.0)      4.9928 (2.01)     0.0000 (1.0)           0;0  0.2003 (0.50)          1           1
test_push-push[3.0.0]      2.4821 (1.0)      2.4821 (1.0)      2.4821 (1.0)      0.0000 (1.0)      2.4821 (1.0)      0.0000 (1.0)           0;0  0.4029 (1.0)           1           1
test_push-push[main]       4.8449 (1.95)     4.8449 (1.95)     4.8449 (1.95)     0.0000 (1.0)      4.8449 (1.95)     0.0000 (1.0)           0;0  0.2064 (0.51)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0]     6.5070 (1.77)     6.5070 (1.77)     6.5070 (1.77)     0.0000 (1.0)      6.5070 (1.77)     0.0000 (1.0)           0;0  0.1537 (0.56)          1           1
test_sharing_s3-add[2.11.0]     6.4029 (1.75)     6.4029 (1.75)     6.4029 (1.75)     0.0000 (1.0)      6.4029 (1.75)     0.0000 (1.0)           0;0  0.1562 (0.57)          1           1
test_sharing_s3-add[2.40.0]     5.4653 (1.49)     5.4653 (1.49)     5.4653 (1.49)     0.0000 (1.0)      5.4653 (1.49)     0.0000 (1.0)           0;0  0.1830 (0.67)          1           1
test_sharing_s3-add[2.40.0]     6.4653 (1.76)     6.4653 (1.76)     6.4653 (1.76)     0.0000 (1.0)      6.4653 (1.76)     0.0000 (1.0)           0;0  0.1547 (0.57)          1           1
test_sharing_s3-add[2.58.2]     3.7144 (1.01)     3.7144 (1.01)     3.7144 (1.01)     0.0000 (1.0)      3.7144 (1.01)     0.0000 (1.0)           0;0  0.2692 (0.99)          1           1
test_sharing_s3-add[2.58.2]     3.6731 (1.00)     3.6731 (1.00)     3.6731 (1.00)     0.0000 (1.0)      3.6731 (1.00)     0.0000 (1.0)           0;0  0.2722 (1.00)          1           1
test_sharing_s3-add[3.0.0]      3.6775 (1.00)     3.6775 (1.00)     3.6775 (1.00)     0.0000 (1.0)      3.6775 (1.00)     0.0000 (1.0)           0;0  0.2719 (1.00)          1           1
test_sharing_s3-add[3.0.0]      3.6660 (1.0)      3.6660 (1.0)      3.6660 (1.0)      0.0000 (1.0)      3.6660 (1.0)      0.0000 (1.0)           0;0  0.2728 (1.0)           1           1
test_sharing_s3-add[main]       3.6956 (1.01)     3.6956 (1.01)     3.6956 (1.01)     0.0000 (1.0)      3.6956 (1.01)     0.0000 (1.0)           0;0  0.2706 (0.99)          1           1
test_sharing_s3-add[main]       3.6696 (1.00)     3.6696 (1.00)     3.6696 (1.00)     0.0000 (1.0)      3.6696 (1.00)     0.0000 (1.0)           0;0  0.2725 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0]     3.2343 (1.44)     3.2343 (1.44)     3.2343 (1.44)     0.0000 (1.0)      3.2343 (1.44)     0.0000 (1.0)           0;0  0.3092 (0.69)          1           1
test_sharing_s3-add-noop[2.11.0]     3.2483 (1.45)     3.2483 (1.45)     3.2483 (1.45)     0.0000 (1.0)      3.2483 (1.45)     0.0000 (1.0)           0;0  0.3079 (0.69)          1           1
test_sharing_s3-add-noop[2.40.0]     2.2417 (1.0)      2.2417 (1.0)      2.2417 (1.0)      0.0000 (1.0)      2.2417 (1.0)      0.0000 (1.0)           0;0  0.4461 (1.0)           1           1
test_sharing_s3-add-noop[2.40.0]     2.2806 (1.02)     2.2806 (1.02)     2.2806 (1.02)     0.0000 (1.0)      2.2806 (1.02)     0.0000 (1.0)           0;0  0.4385 (0.98)          1           1
test_sharing_s3-add-noop[2.58.2]     2.4729 (1.10)     2.4729 (1.10)     2.4729 (1.10)     0.0000 (1.0)      2.4729 (1.10)     0.0000 (1.0)           0;0  0.4044 (0.91)          1           1
test_sharing_s3-add-noop[2.58.2]     2.4624 (1.10)     2.4624 (1.10)     2.4624 (1.10)     0.0000 (1.0)      2.4624 (1.10)     0.0000 (1.0)           0;0  0.4061 (0.91)          1           1
test_sharing_s3-add-noop[3.0.0]      2.4790 (1.11)     2.4790 (1.11)     2.4790 (1.11)     0.0000 (1.0)      2.4790 (1.11)     0.0000 (1.0)           0;0  0.4034 (0.90)          1           1
test_sharing_s3-add-noop[3.0.0]      2.4712 (1.10)     2.4712 (1.10)     2.4712 (1.10)     0.0000 (1.0)      2.4712 (1.10)     0.0000 (1.0)           0;0  0.4047 (0.91)          1           1
test_sharing_s3-add-noop[main]       2.4738 (1.10)     2.4738 (1.10)     2.4738 (1.10)     0.0000 (1.0)      2.4738 (1.10)     0.0000 (1.0)           0;0  0.4042 (0.91)          1           1
test_sharing_s3-add-noop[main]       2.4751 (1.10)     2.4751 (1.10)     2.4751 (1.10)     0.0000 (1.0)      2.4751 (1.10)     0.0000 (1.0)           0;0  0.4040 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0]     496.8978 (1.02)     496.8978 (1.02)     496.8978 (1.02)     0.0000 (1.0)      496.8978 (1.02)     0.0000 (1.0)           0;0  2.0125 (0.98)          1           1
test_sharing_s3-checkout-noop[2.11.0]     486.2704 (1.0)      486.2704 (1.0)      486.2704 (1.0)      0.0000 (1.0)      486.2704 (1.0)      0.0000 (1.0)           0;0  2.0565 (1.0)           1           1
test_sharing_s3-checkout-noop[2.40.0]     584.2326 (1.20)     584.2326 (1.20)     584.2326 (1.20)     0.0000 (1.0)      584.2326 (1.20)     0.0000 (1.0)           0;0  1.7116 (0.83)          1           1
test_sharing_s3-checkout-noop[2.40.0]     576.2182 (1.18)     576.2182 (1.18)     576.2182 (1.18)     0.0000 (1.0)      576.2182 (1.18)     0.0000 (1.0)           0;0  1.7355 (0.84)          1           1
test_sharing_s3-checkout-noop[2.58.2]     642.6477 (1.32)     642.6477 (1.32)     642.6477 (1.32)     0.0000 (1.0)      642.6477 (1.32)     0.0000 (1.0)           0;0  1.5561 (0.76)          1           1
test_sharing_s3-checkout-noop[2.58.2]     634.1697 (1.30)     634.1697 (1.30)     634.1697 (1.30)     0.0000 (1.0)      634.1697 (1.30)     0.0000 (1.0)           0;0  1.5769 (0.77)          1           1
test_sharing_s3-checkout-noop[3.0.0]      823.5179 (1.69)     823.5179 (1.69)     823.5179 (1.69)     0.0000 (1.0)      823.5179 (1.69)     0.0000 (1.0)           0;0  1.2143 (0.59)          1           1
test_sharing_s3-checkout-noop[3.0.0]      832.5161 (1.71)     832.5161 (1.71)     832.5161 (1.71)     0.0000 (1.0)      832.5161 (1.71)     0.0000 (1.0)           0;0  1.2012 (0.58)          1           1
test_sharing_s3-checkout-noop[main]       667.5207 (1.37)     667.5207 (1.37)     667.5207 (1.37)     0.0000 (1.0)      667.5207 (1.37)     0.0000 (1.0)           0;0  1.4981 (0.73)          1           1
test_sharing_s3-checkout-noop[main]       663.1213 (1.36)     663.1213 (1.36)     663.1213 (1.36)     0.0000 (1.0)      663.1213 (1.36)     0.0000 (1.0)           0;0  1.5080 (0.73)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests -------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0]     13.9044 (1.34)     13.9044 (1.34)     13.9044 (1.34)     0.0000 (1.0)      13.9044 (1.34)     0.0000 (1.0)           0;0  0.0719 (0.75)          1           1
test_sharing_s3-pull[2.11.0]     13.8156 (1.33)     13.8156 (1.33)     13.8156 (1.33)     0.0000 (1.0)      13.8156 (1.33)     0.0000 (1.0)           0;0  0.0724 (0.75)          1           1
test_sharing_s3-pull[2.40.0]     15.5673 (1.50)     15.5673 (1.50)     15.5673 (1.50)     0.0000 (1.0)      15.5673 (1.50)     0.0000 (1.0)           0;0  0.0642 (0.67)          1           1
test_sharing_s3-pull[2.40.0]     15.4678 (1.49)     15.4678 (1.49)     15.4678 (1.49)     0.0000 (1.0)      15.4678 (1.49)     0.0000 (1.0)           0;0  0.0647 (0.67)          1           1
test_sharing_s3-pull[2.58.2]     10.5112 (1.01)     10.5112 (1.01)     10.5112 (1.01)     0.0000 (1.0)      10.5112 (1.01)     0.0000 (1.0)           0;0  0.0951 (0.99)          1           1
test_sharing_s3-pull[2.58.2]     10.4054 (1.0)      10.4054 (1.0)      10.4054 (1.0)      0.0000 (1.0)      10.4054 (1.0)      0.0000 (1.0)           0;0  0.0961 (1.0)           1           1
test_sharing_s3-pull[3.0.0]      12.3759 (1.19)     12.3759 (1.19)     12.3759 (1.19)     0.0000 (1.0)      12.3759 (1.19)     0.0000 (1.0)           0;0  0.0808 (0.84)          1           1
test_sharing_s3-pull[3.0.0]      12.4407 (1.20)     12.4407 (1.20)     12.4407 (1.20)     0.0000 (1.0)      12.4407 (1.20)     0.0000 (1.0)           0;0  0.0804 (0.84)          1           1
test_sharing_s3-pull[main]       12.3401 (1.19)     12.3401 (1.19)     12.3401 (1.19)     0.0000 (1.0)      12.3401 (1.19)     0.0000 (1.0)           0;0  0.0810 (0.84)          1           1
test_sharing_s3-pull[main]       12.3928 (1.19)     12.3928 (1.19)     12.3928 (1.19)     0.0000 (1.0)      12.3928 (1.19)     0.0000 (1.0)           0;0  0.0807 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms)                            Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0]       724.0317 (1.01)       724.0317 (1.01)       724.0317 (1.01)     0.0000 (1.0)        724.0317 (1.01)     0.0000 (1.0)           0;0  1.3812 (0.99)          1           1
test_sharing_s3-pull-noop[2.11.0]       717.7882 (1.0)        717.7882 (1.0)        717.7882 (1.0)      0.0000 (1.0)        717.7882 (1.0)      0.0000 (1.0)           0;0  1.3932 (1.0)           1           1
test_sharing_s3-pull-noop[2.40.0]       807.0634 (1.12)       807.0634 (1.12)       807.0634 (1.12)     0.0000 (1.0)        807.0634 (1.12)     0.0000 (1.0)           0;0  1.2391 (0.89)          1           1
test_sharing_s3-pull-noop[2.40.0]       798.7959 (1.11)       798.7959 (1.11)       798.7959 (1.11)     0.0000 (1.0)        798.7959 (1.11)     0.0000 (1.0)           0;0  1.2519 (0.90)          1           1
test_sharing_s3-pull-noop[2.58.2]       867.4406 (1.21)       867.4406 (1.21)       867.4406 (1.21)     0.0000 (1.0)        867.4406 (1.21)     0.0000 (1.0)           0;0  1.1528 (0.83)          1           1
test_sharing_s3-pull-noop[2.58.2]       859.2342 (1.20)       859.2342 (1.20)       859.2342 (1.20)     0.0000 (1.0)        859.2342 (1.20)     0.0000 (1.0)           0;0  1.1638 (0.84)          1           1
test_sharing_s3-pull-noop[3.0.0]        997.9839 (1.39)       997.9839 (1.39)       997.9839 (1.39)     0.0000 (1.0)        997.9839 (1.39)     0.0000 (1.0)           0;0  1.0020 (0.72)          1           1
test_sharing_s3-pull-noop[3.0.0]      1,004.7361 (1.40)     1,004.7361 (1.40)     1,004.7361 (1.40)     0.0000 (1.0)      1,004.7361 (1.40)     0.0000 (1.0)           0;0  0.9953 (0.71)          1           1
test_sharing_s3-pull-noop[main]       1,366.2021 (1.90)     1,366.2021 (1.90)     1,366.2021 (1.90)     0.0000 (1.0)      1,366.2021 (1.90)     0.0000 (1.0)           0;0  0.7320 (0.53)          1           1
test_sharing_s3-pull-noop[main]       1,355.5635 (1.89)     1,355.5635 (1.89)     1,355.5635 (1.89)     0.0000 (1.0)      1,355.5635 (1.89)     0.0000 (1.0)           0;0  0.7377 (0.53)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests -------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0]     22.6164 (2.66)     22.6164 (2.66)     22.6164 (2.66)     0.0000 (1.0)      22.6164 (2.66)     0.0000 (1.0)           0;0  0.0442 (0.38)          1           1
test_sharing_s3-push[2.11.0]     22.3683 (2.63)     22.3683 (2.63)     22.3683 (2.63)     0.0000 (1.0)      22.3683 (2.63)     0.0000 (1.0)           0;0  0.0447 (0.38)          1           1
test_sharing_s3-push[2.40.0]     23.7977 (2.79)     23.7977 (2.79)     23.7977 (2.79)     0.0000 (1.0)      23.7977 (2.79)     0.0000 (1.0)           0;0  0.0420 (0.36)          1           1
test_sharing_s3-push[2.40.0]     24.4524 (2.87)     24.4524 (2.87)     24.4524 (2.87)     0.0000 (1.0)      24.4524 (2.87)     0.0000 (1.0)           0;0  0.0409 (0.35)          1           1
test_sharing_s3-push[2.58.2]      9.6294 (1.13)      9.6294 (1.13)      9.6294 (1.13)     0.0000 (1.0)       9.6294 (1.13)     0.0000 (1.0)           0;0  0.1038 (0.88)          1           1
test_sharing_s3-push[2.58.2]      9.6378 (1.13)      9.6378 (1.13)      9.6378 (1.13)     0.0000 (1.0)       9.6378 (1.13)     0.0000 (1.0)           0;0  0.1038 (0.88)          1           1
test_sharing_s3-push[3.0.0]       8.5270 (1.00)      8.5270 (1.00)      8.5270 (1.00)     0.0000 (1.0)       8.5270 (1.00)     0.0000 (1.0)           0;0  0.1173 (1.00)          1           1
test_sharing_s3-push[3.0.0]       8.5163 (1.0)       8.5163 (1.0)       8.5163 (1.0)      0.0000 (1.0)       8.5163 (1.0)      0.0000 (1.0)           0;0  0.1174 (1.0)           1           1
test_sharing_s3-push[main]        9.4426 (1.11)      9.4426 (1.11)      9.4426 (1.11)     0.0000 (1.0)       9.4426 (1.11)     0.0000 (1.0)           0;0  0.1059 (0.90)          1           1
test_sharing_s3-push[main]        9.6361 (1.13)      9.6361 (1.13)      9.6361 (1.13)     0.0000 (1.0)       9.6361 (1.13)     0.0000 (1.0)           0;0  0.1038 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms)                            Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0]       982.3757 (1.0)        982.3757 (1.0)        982.3757 (1.0)      0.0000 (1.0)        982.3757 (1.0)      0.0000 (1.0)           0;0  1.0179 (1.0)           1           1
test_sharing_s3-push-noop[2.11.0]       989.9110 (1.01)       989.9110 (1.01)       989.9110 (1.01)     0.0000 (1.0)        989.9110 (1.01)     0.0000 (1.0)           0;0  1.0102 (0.99)          1           1
test_sharing_s3-push-noop[2.40.0]       999.5086 (1.02)       999.5086 (1.02)       999.5086 (1.02)     0.0000 (1.0)        999.5086 (1.02)     0.0000 (1.0)           0;0  1.0005 (0.98)          1           1
test_sharing_s3-push-noop[2.40.0]     1,023.4540 (1.04)     1,023.4540 (1.04)     1,023.4540 (1.04)     0.0000 (1.0)      1,023.4540 (1.04)     0.0000 (1.0)           0;0  0.9771 (0.96)          1           1
test_sharing_s3-push-noop[2.58.2]     1,061.4693 (1.08)     1,061.4693 (1.08)     1,061.4693 (1.08)     0.0000 (1.0)      1,061.4693 (1.08)     0.0000 (1.0)           0;0  0.9421 (0.93)          1           1
test_sharing_s3-push-noop[2.58.2]     1,057.2623 (1.08)     1,057.2623 (1.08)     1,057.2623 (1.08)     0.0000 (1.0)      1,057.2623 (1.08)     0.0000 (1.0)           0;0  0.9458 (0.93)          1           1
test_sharing_s3-push-noop[3.0.0]      1,057.5415 (1.08)     1,057.5415 (1.08)     1,057.5415 (1.08)     0.0000 (1.0)      1,057.5415 (1.08)     0.0000 (1.0)           0;0  0.9456 (0.93)          1           1
test_sharing_s3-push-noop[3.0.0]      1,039.7560 (1.06)     1,039.7560 (1.06)     1,039.7560 (1.06)     0.0000 (1.0)      1,039.7560 (1.06)     0.0000 (1.0)           0;0  0.9618 (0.94)          1           1
test_sharing_s3-push-noop[main]       1,034.9605 (1.05)     1,034.9605 (1.05)     1,034.9605 (1.05)     0.0000 (1.0)      1,034.9605 (1.05)     0.0000 (1.0)           0;0  0.9662 (0.95)          1           1
test_sharing_s3-push-noop[main]       1,059.9013 (1.08)     1,059.9013 (1.08)     1,059.9013 (1.08)     0.0000 (1.0)      1,059.9013 (1.08)     0.0000 (1.0)           0;0  0.9435 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0]     2.2995 (1.59)     2.2995 (1.59)     2.2995 (1.59)     0.0000 (1.0)      2.2995 (1.59)     0.0000 (1.0)           0;0  0.4349 (0.63)          1           1
test_status-status[2.40.0]     1.4482 (1.0)      1.4482 (1.0)      1.4482 (1.0)      0.0000 (1.0)      1.4482 (1.0)      0.0000 (1.0)           0;0  0.6905 (1.0)           1           1
test_status-status[2.58.2]     1.4672 (1.01)     1.4672 (1.01)     1.4672 (1.01)     0.0000 (1.0)      1.4672 (1.01)     0.0000 (1.0)           0;0  0.6816 (0.99)          1           1
test_status-status[3.0.0]      1.4628 (1.01)     1.4628 (1.01)     1.4628 (1.01)     0.0000 (1.0)      1.4628 (1.01)     0.0000 (1.0)           0;0  0.6836 (0.99)          1           1
test_status-status[main]       1.4661 (1.01)     1.4661 (1.01)     1.4661 (1.01)     0.0000 (1.0)      1.4661 (1.01)     0.0000 (1.0)           0;0  0.6821 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0]     1.6534 (2.79)     1.6534 (2.79)     1.6534 (2.79)     0.0000 (1.0)      1.6534 (2.79)     0.0000 (1.0)           0;0  0.6048 (0.36)          1           1
test_status-status-changed[2.40.0]     0.5916 (1.0)      0.5916 (1.0)      0.5916 (1.0)      0.0000 (1.0)      0.5916 (1.0)      0.0000 (1.0)           0;0  1.6902 (1.0)           1           1
test_status-status-changed[2.58.2]     0.6532 (1.10)     0.6532 (1.10)     0.6532 (1.10)     0.0000 (1.0)      0.6532 (1.10)     0.0000 (1.0)           0;0  1.5308 (0.91)          1           1
test_status-status-changed[3.0.0]      0.6404 (1.08)     0.6404 (1.08)     0.6404 (1.08)     0.0000 (1.0)      0.6404 (1.08)     0.0000 (1.0)           0;0  1.5614 (0.92)          1           1
test_status-status-changed[main]       0.6647 (1.12)     0.6647 (1.12)     0.6647 (1.12)     0.0000 (1.0)      0.6647 (1.12)     0.0000 (1.0)           0;0  1.5045 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0]     716.5676 (1.22)     716.5676 (1.22)     716.5676 (1.22)     0.0000 (1.0)      716.5676 (1.22)     0.0000 (1.0)           0;0  1.3955 (0.82)          1           1
test_status-status-changed-noop[2.40.0]     587.3640 (1.0)      587.3640 (1.0)      587.3640 (1.0)      0.0000 (1.0)      587.3640 (1.0)      0.0000 (1.0)           0;0  1.7025 (1.0)           1           1
test_status-status-changed-noop[2.58.2]     654.5556 (1.11)     654.5556 (1.11)     654.5556 (1.11)     0.0000 (1.0)      654.5556 (1.11)     0.0000 (1.0)           0;0  1.5278 (0.90)          1           1
test_status-status-changed-noop[3.0.0]      638.3178 (1.09)     638.3178 (1.09)     638.3178 (1.09)     0.0000 (1.0)      638.3178 (1.09)     0.0000 (1.0)           0;0  1.5666 (0.92)          1           1
test_status-status-changed-noop[main]       652.1536 (1.11)     652.1536 (1.11)     652.1536 (1.11)     0.0000 (1.0)      652.1536 (1.11)     0.0000 (1.0)           0;0  1.5334 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0]     470.2405 (1.0)      470.2405 (1.0)      470.2405 (1.0)      0.0000 (1.0)      470.2405 (1.0)      0.0000 (1.0)           0;0  2.1266 (1.0)           1           1
test_status-status-noop[2.40.0]     587.5145 (1.25)     587.5145 (1.25)     587.5145 (1.25)     0.0000 (1.0)      587.5145 (1.25)     0.0000 (1.0)           0;0  1.7021 (0.80)          1           1
test_status-status-noop[2.58.2]     646.5073 (1.37)     646.5073 (1.37)     646.5073 (1.37)     0.0000 (1.0)      646.5073 (1.37)     0.0000 (1.0)           0;0  1.5468 (0.73)          1           1
test_status-status-noop[3.0.0]      642.8318 (1.37)     642.8318 (1.37)     642.8318 (1.37)     0.0000 (1.0)      642.8318 (1.37)     0.0000 (1.0)           0;0  1.5556 (0.73)          1           1
test_status-status-noop[main]       650.3275 (1.38)     650.3275 (1.38)     650.3275 (1.38)     0.0000 (1.0)      650.3275 (1.38)     0.0000 (1.0)           0;0  1.5377 (0.72)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.11.0]     14.6386 (1.42)     14.6386 (1.42)     14.6386 (1.42)     0.0000 (1.0)      14.6386 (1.42)     0.0000 (1.0)           0;0  0.0683 (0.71)          1           1
test_update-import-url[2.40.0]     13.2743 (1.28)     13.2743 (1.28)     13.2743 (1.28)     0.0000 (1.0)      13.2743 (1.28)     0.0000 (1.0)           0;0  0.0753 (0.78)          1           1
test_update-import-url[2.58.2]     10.7205 (1.04)     10.7205 (1.04)     10.7205 (1.04)     0.0000 (1.0)      10.7205 (1.04)     0.0000 (1.0)           0;0  0.0933 (0.96)          1           1
test_update-import-url[3.0.0]      10.3441 (1.0)      10.3441 (1.0)      10.3441 (1.0)      0.0000 (1.0)      10.3441 (1.0)      0.0000 (1.0)           0;0  0.0967 (1.0)           1           1
test_update-import-url[main]       10.8634 (1.05)     10.8634 (1.05)     10.8634 (1.05)     0.0000 (1.0)      10.8634 (1.05)     0.0000 (1.0)           0;0  0.0921 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0]     11.5041 (1.31)     11.5041 (1.31)     11.5041 (1.31)     0.0000 (1.0)      11.5041 (1.31)     0.0000 (1.0)           0;0  0.0869 (0.76)          1           1
test_update-update[2.40.0]      8.7498 (1.0)       8.7498 (1.0)       8.7498 (1.0)      0.0000 (1.0)       8.7498 (1.0)      0.0000 (1.0)           0;0  0.1143 (1.0)           1           1
test_update-update[2.58.2]      9.3434 (1.07)      9.3434 (1.07)      9.3434 (1.07)     0.0000 (1.0)       9.3434 (1.07)     0.0000 (1.0)           0;0  0.1070 (0.94)          1           1
test_update-update[3.0.0]       9.2878 (1.06)      9.2878 (1.06)      9.2878 (1.06)     0.0000 (1.0)       9.2878 (1.06)     0.0000 (1.0)           0;0  0.1077 (0.94)          1           1
test_update-update[main]        9.8147 (1.12)      9.8147 (1.12)      9.8147 (1.12)     0.0000 (1.0)       9.8147 (1.12)     0.0000 (1.0)           0;0  0.1019 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                          Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0]       658.3180 (1.0)        658.3180 (1.0)        658.3180 (1.0)      0.0000 (1.0)        658.3180 (1.0)      0.0000 (1.0)           0;0  1.5190 (1.0)           1           1
test_update-update-noop[2.40.0]     1,229.9933 (1.87)     1,229.9933 (1.87)     1,229.9933 (1.87)     0.0000 (1.0)      1,229.9933 (1.87)     0.0000 (1.0)           0;0  0.8130 (0.54)          1           1
test_update-update-noop[2.58.2]     1,370.0306 (2.08)     1,370.0306 (2.08)     1,370.0306 (2.08)     0.0000 (1.0)      1,370.0306 (2.08)     0.0000 (1.0)           0;0  0.7299 (0.48)          1           1
test_update-update-noop[3.0.0]      1,427.0312 (2.17)     1,427.0312 (2.17)     1,427.0312 (2.17)     0.0000 (1.0)      1,427.0312 (2.17)     0.0000 (1.0)           0;0  0.7008 (0.46)          1           1
test_update-update-noop[main]       1,422.3797 (2.16)     1,422.3797 (2.16)     1,422.3797 (2.16)     0.0000 (1.0)      1,422.3797 (2.16)     0.0000 (1.0)           0;0  0.7030 (0.46)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

dependabot[bot] commented 10 months ago

Superseded by #473.