iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

build(deps): bump google-github-actions/auth from 2.1.4 to 2.1.5 #535

Closed dependabot[bot] closed 3 weeks ago

dependabot[bot] commented 3 weeks ago

Bumps google-github-actions/auth from 2.1.4 to 2.1.5.

Release notes

Sourced from google-github-actions/auth's releases.

v2.1.5

What's Changed

New Contributors

Full Changelog: https://github.com/google-github-actions/auth/compare/v2.1.4...v2.1.5

Commits


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
github-actions[bot] commented 3 weeks ago

Wed Aug 21 10:08:16 UTC 2024
dataset: small
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     3.7564 (1.91)     3.7564 (1.91)     3.7564 (1.91)     0.0000 (1.0)      3.7564 (1.91)     0.0000 (1.0)           0;0  0.2662 (0.52)          1           1
test_add_copy-add[3.10.0]     3.7624 (1.91)     3.7624 (1.91)     3.7624 (1.91)     0.0000 (1.0)      3.7624 (1.91)     0.0000 (1.0)           0;0  0.2658 (0.52)          1           1
test_add_copy-add[3.53.2]     3.2365 (1.65)     3.2365 (1.65)     3.2365 (1.65)     0.0000 (1.0)      3.2365 (1.65)     0.0000 (1.0)           0;0  0.3090 (0.61)          1           1
test_add_copy-add[main]       1.9657 (1.0)      1.9657 (1.0)      1.9657 (1.0)      0.0000 (1.0)      1.9657 (1.0)      0.0000 (1.0)           0;0  0.5087 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     1.4862 (2.28)     1.4862 (2.28)     1.4862 (2.28)     0.0000 (1.0)      1.4862 (2.28)     0.0000 (1.0)           0;0  0.6729 (0.44)          1           1
test_add_copy-add-noop[3.10.0]     1.4121 (2.16)     1.4121 (2.16)     1.4121 (2.16)     0.0000 (1.0)      1.4121 (2.16)     0.0000 (1.0)           0;0  0.7082 (0.46)          1           1
test_add_copy-add-noop[3.53.2]     1.3267 (2.03)     1.3267 (2.03)     1.3267 (2.03)     0.0000 (1.0)      1.3267 (2.03)     0.0000 (1.0)           0;0  0.7537 (0.49)          1           1
test_add_copy-add-noop[main]       0.6528 (1.0)      0.6528 (1.0)      0.6528 (1.0)      0.0000 (1.0)      0.6528 (1.0)      0.0000 (1.0)           0;0  1.5318 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     3.3348 (1.51)     3.3348 (1.51)     3.3348 (1.51)     0.0000 (1.0)      3.3348 (1.51)     0.0000 (1.0)           0;0  0.2999 (0.66)          1           1
test_add_hardlink-add[3.10.0]     3.0017 (1.36)     3.0017 (1.36)     3.0017 (1.36)     0.0000 (1.0)      3.0017 (1.36)     0.0000 (1.0)           0;0  0.3331 (0.73)          1           1
test_add_hardlink-add[3.53.2]     2.7113 (1.23)     2.7113 (1.23)     2.7113 (1.23)     0.0000 (1.0)      2.7113 (1.23)     0.0000 (1.0)           0;0  0.3688 (0.81)          1           1
test_add_hardlink-add[main]       2.2062 (1.0)      2.2062 (1.0)      2.2062 (1.0)      0.0000 (1.0)      2.2062 (1.0)      0.0000 (1.0)           0;0  0.4533 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     1.6857 (2.57)     1.6857 (2.57)     1.6857 (2.57)     0.0000 (1.0)      1.6857 (2.57)     0.0000 (1.0)           0;0  0.5932 (0.39)          1           1
test_add_hardlink-add-noop[3.10.0]     1.6081 (2.45)     1.6081 (2.45)     1.6081 (2.45)     0.0000 (1.0)      1.6081 (2.45)     0.0000 (1.0)           0;0  0.6219 (0.41)          1           1
test_add_hardlink-add-noop[3.53.2]     1.4980 (2.28)     1.4980 (2.28)     1.4980 (2.28)     0.0000 (1.0)      1.4980 (2.28)     0.0000 (1.0)           0;0  0.6675 (0.44)          1           1
test_add_hardlink-add-noop[main]       0.6561 (1.0)      0.6561 (1.0)      0.6561 (1.0)      0.0000 (1.0)      0.6561 (1.0)      0.0000 (1.0)           0;0  1.5242 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     3.1826 (1.38)     3.1826 (1.38)     3.1826 (1.38)     0.0000 (1.0)      3.1826 (1.38)     0.0000 (1.0)           0;0  0.3142 (0.73)          1           1
test_add_symlink-add[3.10.0]     3.1542 (1.36)     3.1542 (1.36)     3.1542 (1.36)     0.0000 (1.0)      3.1542 (1.36)     0.0000 (1.0)           0;0  0.3170 (0.73)          1           1
test_add_symlink-add[3.53.2]     2.8722 (1.24)     2.8722 (1.24)     2.8722 (1.24)     0.0000 (1.0)      2.8722 (1.24)     0.0000 (1.0)           0;0  0.3482 (0.80)          1           1
test_add_symlink-add[main]       2.3115 (1.0)      2.3115 (1.0)      2.3115 (1.0)      0.0000 (1.0)      2.3115 (1.0)      0.0000 (1.0)           0;0  0.4326 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     2.0241 (2.83)     2.0241 (2.83)     2.0241 (2.83)     0.0000 (1.0)      2.0241 (2.83)     0.0000 (1.0)           0;0  0.4941 (0.35)          1           1
test_add_symlink-add-noop[3.10.0]     2.1647 (3.03)     2.1647 (3.03)     2.1647 (3.03)     0.0000 (1.0)      2.1647 (3.03)     0.0000 (1.0)           0;0  0.4620 (0.33)          1           1
test_add_symlink-add-noop[3.53.2]     1.8155 (2.54)     1.8155 (2.54)     1.8155 (2.54)     0.0000 (1.0)      1.8155 (2.54)     0.0000 (1.0)           0;0  0.5508 (0.39)          1           1
test_add_symlink-add-noop[main]       0.7150 (1.0)      0.7150 (1.0)      0.7150 (1.0)      0.0000 (1.0)      0.7150 (1.0)      0.0000 (1.0)           0;0  1.3986 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     2.5254 (1.45)     2.5254 (1.45)     2.5254 (1.45)     0.0000 (1.0)      2.5254 (1.45)     0.0000 (1.0)           0;0  0.3960 (0.69)          1           1
test_checkout_copy-checkout[3.10.0]     4.1341 (2.37)     4.1341 (2.37)     4.1341 (2.37)     0.0000 (1.0)      4.1341 (2.37)     0.0000 (1.0)           0;0  0.2419 (0.42)          1           1
test_checkout_copy-checkout[3.53.2]     1.7430 (1.0)      1.7430 (1.0)      1.7430 (1.0)      0.0000 (1.0)      1.7430 (1.0)      0.0000 (1.0)           0;0  0.5737 (1.0)           1           1
test_checkout_copy-checkout[main]       1.8736 (1.07)     1.8736 (1.07)     1.8736 (1.07)     0.0000 (1.0)      1.8736 (1.07)     0.0000 (1.0)           0;0  0.5337 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     622.8673 (1.21)     622.8673 (1.21)     622.8673 (1.21)     0.0000 (1.0)      622.8673 (1.21)     0.0000 (1.0)           0;0  1.6055 (0.82)          1           1
test_checkout_copy-checkout-noop[3.10.0]     623.8714 (1.22)     623.8714 (1.22)     623.8714 (1.22)     0.0000 (1.0)      623.8714 (1.22)     0.0000 (1.0)           0;0  1.6029 (0.82)          1           1
test_checkout_copy-checkout-noop[3.53.2]     591.6647 (1.15)     591.6647 (1.15)     591.6647 (1.15)     0.0000 (1.0)      591.6647 (1.15)     0.0000 (1.0)           0;0  1.6901 (0.87)          1           1
test_checkout_copy-checkout-noop[main]       513.3605 (1.0)      513.3605 (1.0)      513.3605 (1.0)      0.0000 (1.0)      513.3605 (1.0)      0.0000 (1.0)           0;0  1.9479 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     751.3844 (1.29)     751.3844 (1.29)     751.3844 (1.29)     0.0000 (1.0)      751.3844 (1.29)     0.0000 (1.0)           0;0  1.3309 (0.77)          1           1
test_checkout_copy-checkout-update[3.10.0]     673.5532 (1.16)     673.5532 (1.16)     673.5532 (1.16)     0.0000 (1.0)      673.5532 (1.16)     0.0000 (1.0)           0;0  1.4847 (0.86)          1           1
test_checkout_copy-checkout-update[3.53.2]     658.7660 (1.13)     658.7660 (1.13)     658.7660 (1.13)     0.0000 (1.0)      658.7660 (1.13)     0.0000 (1.0)           0;0  1.5180 (0.88)          1           1
test_checkout_copy-checkout-update[main]       581.3265 (1.0)      581.3265 (1.0)      581.3265 (1.0)      0.0000 (1.0)      581.3265 (1.0)      0.0000 (1.0)           0;0  1.7202 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     1.3850 (1.16)     1.3850 (1.16)     1.3850 (1.16)     0.0000 (1.0)      1.3850 (1.16)     0.0000 (1.0)           0;0  0.7220 (0.86)          1           1
test_checkout_hardlink-checkout[3.10.0]     2.0441 (1.71)     2.0441 (1.71)     2.0441 (1.71)     0.0000 (1.0)      2.0441 (1.71)     0.0000 (1.0)           0;0  0.4892 (0.58)          1           1
test_checkout_hardlink-checkout[3.53.2]     1.1936 (1.0)      1.1936 (1.0)      1.1936 (1.0)      0.0000 (1.0)      1.1936 (1.0)      0.0000 (1.0)           0;0  0.8378 (1.0)           1           1
test_checkout_hardlink-checkout[main]       1.2760 (1.07)     1.2760 (1.07)     1.2760 (1.07)     0.0000 (1.0)      1.2760 (1.07)     0.0000 (1.0)           0;0  0.7837 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     586.4313 (1.21)     586.4313 (1.21)     586.4313 (1.21)     0.0000 (1.0)      586.4313 (1.21)     0.0000 (1.0)           0;0  1.7052 (0.83)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     731.5414 (1.51)     731.5414 (1.51)     731.5414 (1.51)     0.0000 (1.0)      731.5414 (1.51)     0.0000 (1.0)           0;0  1.3670 (0.66)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     565.5929 (1.17)     565.5929 (1.17)     565.5929 (1.17)     0.0000 (1.0)      565.5929 (1.17)     0.0000 (1.0)           0;0  1.7681 (0.86)          1           1
test_checkout_hardlink-checkout-noop[main]       483.8691 (1.0)      483.8691 (1.0)      483.8691 (1.0)      0.0000 (1.0)      483.8691 (1.0)      0.0000 (1.0)           0;0  2.0667 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     714.7535 (1.33)     714.7535 (1.33)     714.7535 (1.33)     0.0000 (1.0)      714.7535 (1.33)     0.0000 (1.0)           0;0  1.3991 (0.75)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     636.7739 (1.19)     636.7739 (1.19)     636.7739 (1.19)     0.0000 (1.0)      636.7739 (1.19)     0.0000 (1.0)           0;0  1.5704 (0.84)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     615.6672 (1.15)     615.6672 (1.15)     615.6672 (1.15)     0.0000 (1.0)      615.6672 (1.15)     0.0000 (1.0)           0;0  1.6243 (0.87)          1           1
test_checkout_hardlink-checkout-update[main]       535.5483 (1.0)      535.5483 (1.0)      535.5483 (1.0)      0.0000 (1.0)      535.5483 (1.0)      0.0000 (1.0)           0;0  1.8672 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     1.5876 (1.15)     1.5876 (1.15)     1.5876 (1.15)     0.0000 (1.0)      1.5876 (1.15)     0.0000 (1.0)           0;0  0.6299 (0.87)          1           1
test_checkout_symlink-checkout[3.10.0]     1.5875 (1.15)     1.5875 (1.15)     1.5875 (1.15)     0.0000 (1.0)      1.5875 (1.15)     0.0000 (1.0)           0;0  0.6299 (0.87)          1           1
test_checkout_symlink-checkout[3.53.2]     1.3754 (1.0)      1.3754 (1.0)      1.3754 (1.0)      0.0000 (1.0)      1.3754 (1.0)      0.0000 (1.0)           0;0  0.7271 (1.0)           1           1
test_checkout_symlink-checkout[main]       1.3914 (1.01)     1.3914 (1.01)     1.3914 (1.01)     0.0000 (1.0)      1.3914 (1.01)     0.0000 (1.0)           0;0  0.7187 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     628.3356 (1.14)     628.3356 (1.14)     628.3356 (1.14)     0.0000 (1.0)      628.3356 (1.14)     0.0000 (1.0)           0;0  1.5915 (0.87)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     685.2218 (1.25)     685.2218 (1.25)     685.2218 (1.25)     0.0000 (1.0)      685.2218 (1.25)     0.0000 (1.0)           0;0  1.4594 (0.80)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     690.5955 (1.26)     690.5955 (1.26)     690.5955 (1.26)     0.0000 (1.0)      690.5955 (1.26)     0.0000 (1.0)           0;0  1.4480 (0.80)          1           1
test_checkout_symlink-checkout-noop[main]       549.7452 (1.0)      549.7452 (1.0)      549.7452 (1.0)      0.0000 (1.0)      549.7452 (1.0)      0.0000 (1.0)           0;0  1.8190 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     814.7380 (1.31)     814.7380 (1.31)     814.7380 (1.31)     0.0000 (1.0)      814.7380 (1.31)     0.0000 (1.0)           0;0  1.2274 (0.76)          1           1
test_checkout_symlink-checkout-update[3.10.0]     749.2301 (1.21)     749.2301 (1.21)     749.2301 (1.21)     0.0000 (1.0)      749.2301 (1.21)     0.0000 (1.0)           0;0  1.3347 (0.83)          1           1
test_checkout_symlink-checkout-update[3.53.2]     750.5960 (1.21)     750.5960 (1.21)     750.5960 (1.21)     0.0000 (1.0)      750.5960 (1.21)     0.0000 (1.0)           0;0  1.3323 (0.83)          1           1
test_checkout_symlink-checkout-update[main]       620.7522 (1.0)      620.7522 (1.0)      620.7522 (1.0)      0.0000 (1.0)      620.7522 (1.0)      0.0000 (1.0)           0;0  1.6109 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     683.9742 (1.34)     683.9742 (1.34)     683.9742 (1.34)     0.0000 (1.0)      683.9742 (1.34)     0.0000 (1.0)           0;0  1.4620 (0.75)          1           1
test_data_status-data-changed[3.10.0]     615.2846 (1.20)     615.2846 (1.20)     615.2846 (1.20)     0.0000 (1.0)      615.2846 (1.20)     0.0000 (1.0)           0;0  1.6253 (0.83)          1           1
test_data_status-data-changed[3.53.2]     620.7701 (1.21)     620.7701 (1.21)     620.7701 (1.21)     0.0000 (1.0)      620.7701 (1.21)     0.0000 (1.0)           0;0  1.6109 (0.83)          1           1
test_data_status-data-changed[main]       512.2190 (1.0)      512.2190 (1.0)      512.2190 (1.0)      0.0000 (1.0)      512.2190 (1.0)      0.0000 (1.0)           0;0  1.9523 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     680.5028 (1.33)     680.5028 (1.33)     680.5028 (1.33)     0.0000 (1.0)      680.5028 (1.33)     0.0000 (1.0)           0;0  1.4695 (0.75)          1           1
test_data_status-data-changed-noop[3.10.0]     614.7696 (1.20)     614.7696 (1.20)     614.7696 (1.20)     0.0000 (1.0)      614.7696 (1.20)     0.0000 (1.0)           0;0  1.6266 (0.83)          1           1
test_data_status-data-changed-noop[3.53.2]     612.4198 (1.19)     612.4198 (1.19)     612.4198 (1.19)     0.0000 (1.0)      612.4198 (1.19)     0.0000 (1.0)           0;0  1.6329 (0.84)          1           1
test_data_status-data-changed-noop[main]       512.5178 (1.0)      512.5178 (1.0)      512.5178 (1.0)      0.0000 (1.0)      512.5178 (1.0)      0.0000 (1.0)           0;0  1.9512 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     1.6232 (1.95)     1.6232 (1.95)     1.6232 (1.95)     0.0000 (1.0)      1.6232 (1.95)     0.0000 (1.0)           0;0  0.6161 (0.51)          1           1
test_data_status-data-new[3.10.0]     1.5738 (1.89)     1.5738 (1.89)     1.5738 (1.89)     0.0000 (1.0)      1.5738 (1.89)     0.0000 (1.0)           0;0  0.6354 (0.53)          1           1
test_data_status-data-new[3.53.2]     1.4253 (1.71)     1.4253 (1.71)     1.4253 (1.71)     0.0000 (1.0)      1.4253 (1.71)     0.0000 (1.0)           0;0  0.7016 (0.59)          1           1
test_data_status-data-new[main]       0.8342 (1.0)      0.8342 (1.0)      0.8342 (1.0)      0.0000 (1.0)      0.8342 (1.0)      0.0000 (1.0)           0;0  1.1987 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     692.1645 (1.36)     692.1645 (1.36)     692.1645 (1.36)     0.0000 (1.0)      692.1645 (1.36)     0.0000 (1.0)           0;0  1.4447 (0.74)          1           1
test_data_status-data-noop[3.10.0]     640.1359 (1.25)     640.1359 (1.25)     640.1359 (1.25)     0.0000 (1.0)      640.1359 (1.25)     0.0000 (1.0)           0;0  1.5622 (0.80)          1           1
test_data_status-data-noop[3.53.2]     626.4111 (1.23)     626.4111 (1.23)     626.4111 (1.23)     0.0000 (1.0)      626.4111 (1.23)     0.0000 (1.0)           0;0  1.5964 (0.82)          1           1
test_data_status-data-noop[main]       510.7317 (1.0)      510.7317 (1.0)      510.7317 (1.0)      0.0000 (1.0)      510.7317 (1.0)      0.0000 (1.0)           0;0  1.9580 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     1.0824 (1.10)     1.0824 (1.10)     1.0824 (1.10)     0.0000 (1.0)      1.0824 (1.10)     0.0000 (1.0)           0;0  0.9239 (0.91)          1           1
test_data_status_all_flags-data-changed[3.10.0]     1.0628 (1.08)     1.0628 (1.08)     1.0628 (1.08)     0.0000 (1.0)      1.0628 (1.08)     0.0000 (1.0)           0;0  0.9409 (0.92)          1           1
test_data_status_all_flags-data-changed[3.53.2]     1.0479 (1.07)     1.0479 (1.07)     1.0479 (1.07)     0.0000 (1.0)      1.0479 (1.07)     0.0000 (1.0)           0;0  0.9543 (0.93)          1           1
test_data_status_all_flags-data-changed[main]       0.9796 (1.0)      0.9796 (1.0)      0.9796 (1.0)      0.0000 (1.0)      0.9796 (1.0)      0.0000 (1.0)           0;0  1.0208 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     1.0880 (1.12)     1.0880 (1.12)     1.0880 (1.12)     0.0000 (1.0)      1.0880 (1.12)     0.0000 (1.0)           0;0  0.9191 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     1.0682 (1.09)     1.0682 (1.09)     1.0682 (1.09)     0.0000 (1.0)      1.0682 (1.09)     0.0000 (1.0)           0;0  0.9362 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     1.0481 (1.07)     1.0481 (1.07)     1.0481 (1.07)     0.0000 (1.0)      1.0481 (1.07)     0.0000 (1.0)           0;0  0.9541 (0.93)          1           1
test_data_status_all_flags-data-changed-noop[main]       0.9756 (1.0)      0.9756 (1.0)      0.9756 (1.0)      0.0000 (1.0)      0.9756 (1.0)      0.0000 (1.0)           0;0  1.0250 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     1.9708 (1.44)     1.9708 (1.44)     1.9708 (1.44)     0.0000 (1.0)      1.9708 (1.44)     0.0000 (1.0)           0;0  0.5074 (0.69)          1           1
test_data_status_all_flags-data-new[3.10.0]     2.1717 (1.59)     2.1717 (1.59)     2.1717 (1.59)     0.0000 (1.0)      2.1717 (1.59)     0.0000 (1.0)           0;0  0.4605 (0.63)          1           1
test_data_status_all_flags-data-new[3.53.2]     1.8923 (1.38)     1.8923 (1.38)     1.8923 (1.38)     0.0000 (1.0)      1.8923 (1.38)     0.0000 (1.0)           0;0  0.5285 (0.72)          1           1
test_data_status_all_flags-data-new[main]       1.3685 (1.0)      1.3685 (1.0)      1.3685 (1.0)      0.0000 (1.0)      1.3685 (1.0)      0.0000 (1.0)           0;0  0.7307 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     1.0713 (1.12)     1.0713 (1.12)     1.0713 (1.12)     0.0000 (1.0)      1.0713 (1.12)     0.0000 (1.0)           0;0  0.9334 (0.89)          1           1
test_data_status_all_flags-data-noop[3.10.0]     1.0495 (1.10)     1.0495 (1.10)     1.0495 (1.10)     0.0000 (1.0)      1.0495 (1.10)     0.0000 (1.0)           0;0  0.9529 (0.91)          1           1
test_data_status_all_flags-data-noop[3.53.2]     1.0583 (1.11)     1.0583 (1.11)     1.0583 (1.11)     0.0000 (1.0)      1.0583 (1.11)     0.0000 (1.0)           0;0  0.9449 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       0.9576 (1.0)      0.9576 (1.0)      0.9576 (1.0)      0.0000 (1.0)      0.9576 (1.0)      0.0000 (1.0)           0;0  1.0442 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     1.4211 (1.45)     1.4211 (1.45)     1.4211 (1.45)     0.0000 (1.0)      1.4211 (1.45)     0.0000 (1.0)           0;0  0.7037 (0.69)          1           1
test_diff-diff[3.10.0]     1.5501 (1.58)     1.5501 (1.58)     1.5501 (1.58)     0.0000 (1.0)      1.5501 (1.58)     0.0000 (1.0)           0;0  0.6451 (0.63)          1           1
test_diff-diff[3.53.2]     1.4155 (1.44)     1.4155 (1.44)     1.4155 (1.44)     0.0000 (1.0)      1.4155 (1.44)     0.0000 (1.0)           0;0  0.7065 (0.69)          1           1
test_diff-diff[main]       0.9811 (1.0)      0.9811 (1.0)      0.9811 (1.0)      0.0000 (1.0)      0.9811 (1.0)      0.0000 (1.0)           0;0  1.0192 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     671.2086 (1.22)     671.2086 (1.22)     671.2086 (1.22)     0.0000 (1.0)      671.2086 (1.22)     0.0000 (1.0)           0;0  1.4898 (0.82)          1           1
test_diff-diff-changed[3.10.0]     689.6432 (1.25)     689.6432 (1.25)     689.6432 (1.25)     0.0000 (1.0)      689.6432 (1.25)     0.0000 (1.0)           0;0  1.4500 (0.80)          1           1
test_diff-diff-changed[3.53.2]     625.2260 (1.14)     625.2260 (1.14)     625.2260 (1.14)     0.0000 (1.0)      625.2260 (1.14)     0.0000 (1.0)           0;0  1.5994 (0.88)          1           1
test_diff-diff-changed[main]       550.4361 (1.0)      550.4361 (1.0)      550.4361 (1.0)      0.0000 (1.0)      550.4361 (1.0)      0.0000 (1.0)           0;0  1.8167 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     646.7252 (1.16)     646.7252 (1.16)     646.7252 (1.16)     0.0000 (1.0)      646.7252 (1.16)     0.0000 (1.0)           0;0  1.5463 (0.86)          1           1
test_diff-diff-changed-noop[3.10.0]     649.1282 (1.17)     649.1282 (1.17)     649.1282 (1.17)     0.0000 (1.0)      649.1282 (1.17)     0.0000 (1.0)           0;0  1.5405 (0.86)          1           1
test_diff-diff-changed-noop[3.53.2]     627.7711 (1.13)     627.7711 (1.13)     627.7711 (1.13)     0.0000 (1.0)      627.7711 (1.13)     0.0000 (1.0)           0;0  1.5929 (0.89)          1           1
test_diff-diff-changed-noop[main]       556.9795 (1.0)      556.9795 (1.0)      556.9795 (1.0)      0.0000 (1.0)      556.9795 (1.0)      0.0000 (1.0)           0;0  1.7954 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     619.8130 (1.12)     619.8130 (1.12)     619.8130 (1.12)     0.0000 (1.0)      619.8130 (1.12)     0.0000 (1.0)           0;0  1.6134 (0.89)          1           1
test_diff-diff-noop[3.10.0]     628.2814 (1.14)     628.2814 (1.14)     628.2814 (1.14)     0.0000 (1.0)      628.2814 (1.14)     0.0000 (1.0)           0;0  1.5916 (0.88)          1           1
test_diff-diff-noop[3.53.2]     631.1478 (1.14)     631.1478 (1.14)     631.1478 (1.14)     0.0000 (1.0)      631.1478 (1.14)     0.0000 (1.0)           0;0  1.5844 (0.87)          1           1
test_diff-diff-noop[main]       551.4382 (1.0)      551.4382 (1.0)      551.4382 (1.0)      0.0000 (1.0)      551.4382 (1.0)      0.0000 (1.0)           0;0  1.8134 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0171 (1.0)       1.0171 (1.0)       1.0171 (1.0)      0.0000 (1.0)       1.0171 (1.0)      0.0000 (1.0)           0;0  0.9832 (1.0)           1           1
test_exp_show-exp[3.10.0]     16.4544 (16.18)    16.4544 (16.18)    16.4544 (16.18)    0.0000 (1.0)      16.4544 (16.18)    0.0000 (1.0)           0;0  0.0608 (0.06)          1           1
test_exp_show-exp[3.53.2]     10.2321 (10.06)    10.2321 (10.06)    10.2321 (10.06)    0.0000 (1.0)      10.2321 (10.06)    0.0000 (1.0)           0;0  0.0977 (0.10)          1           1
test_exp_show-exp[main]       12.1632 (11.96)    12.1632 (11.96)    12.1632 (11.96)    0.0000 (1.0)      12.1632 (11.96)    0.0000 (1.0)           0;0  0.0822 (0.08)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     4.0289 (2.74)     4.0289 (2.74)     4.0289 (2.74)     0.0000 (1.0)      4.0289 (2.74)     0.0000 (1.0)           0;0  0.2482 (0.37)          1           1
test_fetch-fetch[3.10.0]     4.4950 (3.05)     4.4950 (3.05)     4.4950 (3.05)     0.0000 (1.0)      4.4950 (3.05)     0.0000 (1.0)           0;0  0.2225 (0.33)          1           1
test_fetch-fetch[3.53.2]     1.9690 (1.34)     1.9690 (1.34)     1.9690 (1.34)     0.0000 (1.0)      1.9690 (1.34)     0.0000 (1.0)           0;0  0.5079 (0.75)          1           1
test_fetch-fetch[main]       1.4721 (1.0)      1.4721 (1.0)      1.4721 (1.0)      0.0000 (1.0)      1.4721 (1.0)      0.0000 (1.0)           0;0  0.6793 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     642.6954 (1.26)     642.6954 (1.26)     642.6954 (1.26)     0.0000 (1.0)      642.6954 (1.26)     0.0000 (1.0)           0;0  1.5559 (0.79)          1           1
test_gc-gc[3.10.0]     751.4792 (1.47)     751.4792 (1.47)     751.4792 (1.47)     0.0000 (1.0)      751.4792 (1.47)     0.0000 (1.0)           0;0  1.3307 (0.68)          1           1
test_gc-gc[3.53.2]     690.2010 (1.35)     690.2010 (1.35)     690.2010 (1.35)     0.0000 (1.0)      690.2010 (1.35)     0.0000 (1.0)           0;0  1.4489 (0.74)          1           1
test_gc-gc[main]       510.4645 (1.0)      510.4645 (1.0)      510.4645 (1.0)      0.0000 (1.0)      510.4645 (1.0)      0.0000 (1.0)           0;0  1.9590 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     5.7261 (1.17)     5.7261 (1.17)     5.7261 (1.17)     0.0000 (1.0)      5.7261 (1.17)     0.0000 (1.0)           0;0  0.1746 (0.85)          1           1
test_get-get[3.10.0]     6.8150 (1.39)     6.8150 (1.39)     6.8150 (1.39)     0.0000 (1.0)      6.8150 (1.39)     0.0000 (1.0)           0;0  0.1467 (0.72)          1           1
test_get-get[3.53.2]     5.1102 (1.05)     5.1102 (1.05)     5.1102 (1.05)     0.0000 (1.0)      5.1102 (1.05)     0.0000 (1.0)           0;0  0.1957 (0.96)          1           1
test_get-get[main]       4.8883 (1.0)      4.8883 (1.0)      4.8883 (1.0)      0.0000 (1.0)      4.8883 (1.0)      0.0000 (1.0)           0;0  0.2046 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     3.1348 (3.29)     3.1348 (3.29)     3.1348 (3.29)     0.0000 (1.0)      3.1348 (3.29)     0.0000 (1.0)           0;0  0.3190 (0.30)          1           1
test_get_url-get-url[3.10.0]     3.4299 (3.60)     3.4299 (3.60)     3.4299 (3.60)     0.0000 (1.0)      3.4299 (3.60)     0.0000 (1.0)           0;0  0.2916 (0.28)          1           1
test_get_url-get-url[3.53.2]     1.0738 (1.13)     1.0738 (1.13)     1.0738 (1.13)     0.0000 (1.0)      1.0738 (1.13)     0.0000 (1.0)           0;0  0.9312 (0.89)          1           1
test_get_url-get-url[main]       0.9529 (1.0)      0.9529 (1.0)      0.9529 (1.0)      0.0000 (1.0)      0.9529 (1.0)      0.0000 (1.0)           0;0  1.0494 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.0131 (1.01)     130.0369 (1.0)      126.1899 (1.01)     1.3347 (1.0)      125.8329 (1.01)     1.5625 (1.0)          25;5  7.9246 (0.99)        100           1
test_help---help[3.10.0]     122.5542 (1.0)      144.9053 (1.11)     125.0565 (1.0)      3.0798 (2.31)     124.3206 (1.0)      1.8130 (1.16)          7;7  7.9964 (1.0)         100           1
test_help---help[3.53.2]     123.7948 (1.01)     141.6880 (1.09)     126.1985 (1.01)     2.0165 (1.51)     125.7993 (1.01)     1.7244 (1.10)          8;3  7.9240 (0.99)        100           1
test_help---help[main]       123.4645 (1.01)     144.8960 (1.11)     126.2053 (1.01)     2.4285 (1.82)     125.6733 (1.01)     1.9656 (1.26)          9;5  7.9236 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]      8.9652 (1.14)      8.9652 (1.14)      8.9652 (1.14)     0.0000 (1.0)       8.9652 (1.14)     0.0000 (1.0)           0;0  0.1115 (0.88)          1           1
test_import-import[3.10.0]     10.1053 (1.28)     10.1053 (1.28)     10.1053 (1.28)     0.0000 (1.0)      10.1053 (1.28)     0.0000 (1.0)           0;0  0.0990 (0.78)          1           1
test_import-import[main]        7.8831 (1.0)       7.8831 (1.0)       7.8831 (1.0)      0.0000 (1.0)       7.8831 (1.0)      0.0000 (1.0)           0;0  0.1269 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     7.4574 (2.63)     7.4574 (2.63)     7.4574 (2.63)     0.0000 (1.0)      7.4574 (2.63)     0.0000 (1.0)           0;0  0.1341 (0.38)          1           1
test_import_url-import-url[3.10.0]     7.3799 (2.60)     7.3799 (2.60)     7.3799 (2.60)     0.0000 (1.0)      7.3799 (2.60)     0.0000 (1.0)           0;0  0.1355 (0.38)          1           1
test_import_url-import-url[3.53.2]     4.9249 (1.74)     4.9249 (1.74)     4.9249 (1.74)     0.0000 (1.0)      4.9249 (1.74)     0.0000 (1.0)           0;0  0.2030 (0.58)          1           1
test_import_url-import-url[main]       2.8331 (1.0)      2.8331 (1.0)      2.8331 (1.0)      0.0000 (1.0)      2.8331 (1.0)      0.0000 (1.0)           0;0  0.3530 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     398.5758 (1.0)      440.0904 (1.0)      412.0151 (1.0)      10.6168 (1.0)      407.4431 (1.0)      10.8939 (1.0)          24;7  2.4271 (1.0)         100           1
test_init-init[3.10.0]     412.1902 (1.03)     485.5560 (1.10)     427.6756 (1.04)     13.2147 (1.24)     422.2394 (1.04)     14.0114 (1.29)         17;4  2.3382 (0.96)        100           1
test_init-init[3.53.2]     401.6252 (1.01)     450.3692 (1.02)     415.2683 (1.01)     11.7417 (1.11)     410.0381 (1.01)     15.2359 (1.40)         26;1  2.4081 (0.99)        100           1
test_init-init[main]       402.3591 (1.01)     707.5486 (1.61)     418.0587 (1.01)     32.0234 (3.02)     409.3983 (1.00)     14.1137 (1.30)          3;5  2.3920 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     601.8822 (1.41)     601.8822 (1.41)     601.8822 (1.41)     0.0000 (1.0)      601.8822 (1.41)     0.0000 (1.0)           0;0  1.6615 (0.71)          1           1
test_list-list[3.10.0]     715.7362 (1.67)     715.7362 (1.67)     715.7362 (1.67)     0.0000 (1.0)      715.7362 (1.67)     0.0000 (1.0)           0;0  1.3972 (0.60)          1           1
test_list-list[3.53.2]     605.3324 (1.41)     605.3324 (1.41)     605.3324 (1.41)     0.0000 (1.0)      605.3324 (1.41)     0.0000 (1.0)           0;0  1.6520 (0.71)          1           1
test_list-list[main]       428.1684 (1.0)      428.1684 (1.0)      428.1684 (1.0)      0.0000 (1.0)      428.1684 (1.0)      0.0000 (1.0)           0;0  2.3355 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     441.2564 (1.03)     441.2564 (1.03)     441.2564 (1.03)     0.0000 (1.0)      441.2564 (1.03)     0.0000 (1.0)           0;0  2.2663 (0.97)          1           1
test_list-list-dvc-only[3.10.0]     597.9812 (1.40)     597.9812 (1.40)     597.9812 (1.40)     0.0000 (1.0)      597.9812 (1.40)     0.0000 (1.0)           0;0  1.6723 (0.71)          1           1
test_list-list-dvc-only[3.53.2]     427.8210 (1.00)     427.8210 (1.00)     427.8210 (1.00)     0.0000 (1.0)      427.8210 (1.00)     0.0000 (1.0)           0;0  2.3374 (1.00)          1           1
test_list-list-dvc-only[main]       426.7784 (1.0)      426.7784 (1.0)      426.7784 (1.0)      0.0000 (1.0)      426.7784 (1.0)      0.0000 (1.0)           0;0  2.3431 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     532.6279 (1.06)     532.6279 (1.06)     532.6279 (1.06)     0.0000 (1.0)      532.6279 (1.06)     0.0000 (1.0)           0;0  1.8775 (0.94)          1           1
test_list-list-recursive[3.10.0]     520.7135 (1.04)     520.7135 (1.04)     520.7135 (1.04)     0.0000 (1.0)      520.7135 (1.04)     0.0000 (1.0)           0;0  1.9204 (0.96)          1           1
test_list-list-recursive[3.53.2]     504.7802 (1.01)     504.7802 (1.01)     504.7802 (1.01)     0.0000 (1.0)      504.7802 (1.01)     0.0000 (1.0)           0;0  1.9811 (0.99)          1           1
test_list-list-recursive[main]       500.2128 (1.0)      500.2128 (1.0)      500.2128 (1.0)      0.0000 (1.0)      500.2128 (1.0)      0.0000 (1.0)           0;0  1.9991 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     535.4614 (1.26)     535.4614 (1.26)     535.4614 (1.26)     0.0000 (1.0)      535.4614 (1.26)     0.0000 (1.0)           0;0  1.8675 (0.79)          1           1
test_list-list-shallow[3.10.0]     460.6403 (1.08)     460.6403 (1.08)     460.6403 (1.08)     0.0000 (1.0)      460.6403 (1.08)     0.0000 (1.0)           0;0  2.1709 (0.92)          1           1
test_list-list-shallow[3.53.2]     430.9000 (1.01)     430.9000 (1.01)     430.9000 (1.01)     0.0000 (1.0)      430.9000 (1.01)     0.0000 (1.0)           0;0  2.3207 (0.99)          1           1
test_list-list-shallow[main]       425.6518 (1.0)      425.6518 (1.0)      425.6518 (1.0)      0.0000 (1.0)      425.6518 (1.0)      0.0000 (1.0)           0;0  2.3493 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     2.2522 (1.46)     2.2522 (1.46)     2.2522 (1.46)     0.0000 (1.0)      2.2522 (1.46)     0.0000 (1.0)           0;0  0.4440 (0.68)          1           1
test_partial_add-add[3.10.0]     2.2826 (1.48)     2.2826 (1.48)     2.2826 (1.48)     0.0000 (1.0)      2.2826 (1.48)     0.0000 (1.0)           0;0  0.4381 (0.67)          1           1
test_partial_add-add[3.53.2]     1.9893 (1.29)     1.9893 (1.29)     1.9893 (1.29)     0.0000 (1.0)      1.9893 (1.29)     0.0000 (1.0)           0;0  0.5027 (0.77)          1           1
test_partial_add-add[main]       1.5378 (1.0)      1.5378 (1.0)      1.5378 (1.0)      0.0000 (1.0)      1.5378 (1.0)      0.0000 (1.0)           0;0  0.6503 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     3.1467 (2.81)     3.1467 (2.81)     3.1467 (2.81)     0.0000 (1.0)      3.1467 (2.81)     0.0000 (1.0)           0;0  0.3178 (0.36)          1           1
test_partial_add-add-partial[3.10.0]     2.9810 (2.66)     2.9810 (2.66)     2.9810 (2.66)     0.0000 (1.0)      2.9810 (2.66)     0.0000 (1.0)           0;0  0.3355 (0.38)          1           1
test_partial_add-add-partial[3.53.2]     2.7505 (2.46)     2.7505 (2.46)     2.7505 (2.46)     0.0000 (1.0)      2.7505 (2.46)     0.0000 (1.0)           0;0  0.3636 (0.41)          1           1
test_partial_add-add-partial[main]       1.1203 (1.0)      1.1203 (1.0)      1.1203 (1.0)      0.0000 (1.0)      1.1203 (1.0)      0.0000 (1.0)           0;0  0.8926 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     597.4062 (1.0)      597.4062 (1.0)      597.4062 (1.0)      0.0000 (1.0)      597.4062 (1.0)      0.0000 (1.0)           0;0  1.6739 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     628.0763 (1.05)     628.0763 (1.05)     628.0763 (1.05)     0.0000 (1.0)      628.0763 (1.05)     0.0000 (1.0)           0;0  1.5922 (0.95)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     642.8931 (1.08)     642.8931 (1.08)     642.8931 (1.08)     0.0000 (1.0)      642.8931 (1.08)     0.0000 (1.0)           0;0  1.5555 (0.93)          1           1
test_partial_add-gc-cloud-noop[main]       651.8285 (1.09)     651.8285 (1.09)     651.8285 (1.09)     0.0000 (1.0)      651.8285 (1.09)     0.0000 (1.0)           0;0  1.5341 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     637.1772 (1.18)     637.1772 (1.18)     637.1772 (1.18)     0.0000 (1.0)      637.1772 (1.18)     0.0000 (1.0)           0;0  1.5694 (0.85)          1           1
test_partial_add-gc-noop[3.10.0]     563.6577 (1.04)     563.6577 (1.04)     563.6577 (1.04)     0.0000 (1.0)      563.6577 (1.04)     0.0000 (1.0)           0;0  1.7741 (0.96)          1           1
test_partial_add-gc-noop[3.53.2]     539.7870 (1.0)      539.7870 (1.0)      539.7870 (1.0)      0.0000 (1.0)      539.7870 (1.0)      0.0000 (1.0)           0;0  1.8526 (1.0)           1           1
test_partial_add-gc-noop[main]       553.4389 (1.03)     553.4389 (1.03)     553.4389 (1.03)     0.0000 (1.0)      553.4389 (1.03)     0.0000 (1.0)           0;0  1.8069 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     2.0284 (1.92)     2.0284 (1.92)     2.0284 (1.92)     0.0000 (1.0)      2.0284 (1.92)     0.0000 (1.0)           0;0  0.4930 (0.52)          1           1
test_partial_add-push[3.10.0]     1.2002 (1.14)     1.2002 (1.14)     1.2002 (1.14)     0.0000 (1.0)      1.2002 (1.14)     0.0000 (1.0)           0;0  0.8332 (0.88)          1           1
test_partial_add-push[3.53.2]     1.1155 (1.06)     1.1155 (1.06)     1.1155 (1.06)     0.0000 (1.0)      1.1155 (1.06)     0.0000 (1.0)           0;0  0.8965 (0.95)          1           1
test_partial_add-push[main]       1.0555 (1.0)      1.0555 (1.0)      1.0555 (1.0)      0.0000 (1.0)      1.0555 (1.0)      0.0000 (1.0)           0;0  0.9474 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     2.0243 (1.74)     2.0243 (1.74)     2.0243 (1.74)     0.0000 (1.0)      2.0243 (1.74)     0.0000 (1.0)           0;0  0.4940 (0.58)          1           1
test_partial_add-push-partial[3.10.0]     1.2475 (1.07)     1.2475 (1.07)     1.2475 (1.07)     0.0000 (1.0)      1.2475 (1.07)     0.0000 (1.0)           0;0  0.8016 (0.94)          1           1
test_partial_add-push-partial[3.53.2]     1.2046 (1.03)     1.2046 (1.03)     1.2046 (1.03)     0.0000 (1.0)      1.2046 (1.03)     0.0000 (1.0)           0;0  0.8301 (0.97)          1           1
test_partial_add-push-partial[main]       1.1666 (1.0)      1.1666 (1.0)      1.1666 (1.0)      0.0000 (1.0)      1.1666 (1.0)      0.0000 (1.0)           0;0  0.8572 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     3.7298 (1.91)     3.7298 (1.91)     3.7298 (1.91)     0.0000 (1.0)      3.7298 (1.91)     0.0000 (1.0)           0;0  0.2681 (0.52)          1           1
test_partial_remove-add[3.10.0]     3.7010 (1.90)     3.7010 (1.90)     3.7010 (1.90)     0.0000 (1.0)      3.7010 (1.90)     0.0000 (1.0)           0;0  0.2702 (0.53)          1           1
test_partial_remove-add[3.53.2]     3.2601 (1.67)     3.2601 (1.67)     3.2601 (1.67)     0.0000 (1.0)      3.2601 (1.67)     0.0000 (1.0)           0;0  0.3067 (0.60)          1           1
test_partial_remove-add[main]       1.9505 (1.0)      1.9505 (1.0)      1.9505 (1.0)      0.0000 (1.0)      1.9505 (1.0)      0.0000 (1.0)           0;0  0.5127 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     1.4947 (2.52)     1.4947 (2.52)     1.4947 (2.52)     0.0000 (1.0)      1.4947 (2.52)     0.0000 (1.0)           0;0  0.6691 (0.40)          1           1
test_partial_remove-add-update[3.10.0]     1.4503 (2.44)     1.4503 (2.44)     1.4503 (2.44)     0.0000 (1.0)      1.4503 (2.44)     0.0000 (1.0)           0;0  0.6895 (0.41)          1           1
test_partial_remove-add-update[3.53.2]     1.3023 (2.20)     1.3023 (2.20)     1.3023 (2.20)     0.0000 (1.0)      1.3023 (2.20)     0.0000 (1.0)           0;0  0.7679 (0.46)          1           1
test_partial_remove-add-update[main]       0.5933 (1.0)      0.5933 (1.0)      0.5933 (1.0)      0.0000 (1.0)      0.5933 (1.0)      0.0000 (1.0)           0;0  1.6856 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     497.4812 (1.0)      497.4812 (1.0)      497.4812 (1.0)      0.0000 (1.0)      497.4812 (1.0)      0.0000 (1.0)           0;0  2.0101 (1.0)           1           1
test_partial_remove-gc[3.10.0]     529.2353 (1.06)     529.2353 (1.06)     529.2353 (1.06)     0.0000 (1.0)      529.2353 (1.06)     0.0000 (1.0)           0;0  1.8895 (0.94)          1           1
test_partial_remove-gc[3.53.2]     511.1702 (1.03)     511.1702 (1.03)     511.1702 (1.03)     0.0000 (1.0)      511.1702 (1.03)     0.0000 (1.0)           0;0  1.9563 (0.97)          1           1
test_partial_remove-gc[main]       514.9155 (1.04)     514.9155 (1.04)     514.9155 (1.04)     0.0000 (1.0)      514.9155 (1.04)     0.0000 (1.0)           0;0  1.9421 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     552.8745 (1.0)      552.8745 (1.0)      552.8745 (1.0)      0.0000 (1.0)      552.8745 (1.0)      0.0000 (1.0)           0;0  1.8087 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     575.6271 (1.04)     575.6271 (1.04)     575.6271 (1.04)     0.0000 (1.0)      575.6271 (1.04)     0.0000 (1.0)           0;0  1.7372 (0.96)          1           1
test_partial_remove-gc-cloud[3.53.2]     584.7679 (1.06)     584.7679 (1.06)     584.7679 (1.06)     0.0000 (1.0)      584.7679 (1.06)     0.0000 (1.0)           0;0  1.7101 (0.95)          1           1
test_partial_remove-gc-cloud[main]       580.3953 (1.05)     580.3953 (1.05)     580.3953 (1.05)     0.0000 (1.0)      580.3953 (1.05)     0.0000 (1.0)           0;0  1.7230 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     3.3937 (2.48)     3.3937 (2.48)     3.3937 (2.48)     0.0000 (1.0)      3.3937 (2.48)     0.0000 (1.0)           0;0  0.2947 (0.40)          1           1
test_partial_remove-push[3.10.0]     1.8485 (1.35)     1.8485 (1.35)     1.8485 (1.35)     0.0000 (1.0)      1.8485 (1.35)     0.0000 (1.0)           0;0  0.5410 (0.74)          1           1
test_partial_remove-push[3.53.2]     1.6155 (1.18)     1.6155 (1.18)     1.6155 (1.18)     0.0000 (1.0)      1.6155 (1.18)     0.0000 (1.0)           0;0  0.6190 (0.85)          1           1
test_partial_remove-push[main]       1.3661 (1.0)      1.3661 (1.0)      1.3661 (1.0)      0.0000 (1.0)      1.3661 (1.0)      0.0000 (1.0)           0;0  0.7320 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     504.8197 (1.03)     504.8197 (1.03)     504.8197 (1.03)     0.0000 (1.0)      504.8197 (1.03)     0.0000 (1.0)           0;0  1.9809 (0.97)          1           1
test_partial_remove-push-update[3.10.0]     488.7911 (1.0)      488.7911 (1.0)      488.7911 (1.0)      0.0000 (1.0)      488.7911 (1.0)      0.0000 (1.0)           0;0  2.0459 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     768.5831 (1.57)     768.5831 (1.57)     768.5831 (1.57)     0.0000 (1.0)      768.5831 (1.57)     0.0000 (1.0)           0;0  1.3011 (0.64)          1           1
test_partial_remove-push-update[main]       760.7435 (1.56)     760.7435 (1.56)     760.7435 (1.56)     0.0000 (1.0)      760.7435 (1.56)     0.0000 (1.0)           0;0  1.3145 (0.64)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     458.3321 (1.0)      469.1019 (1.0)      463.1954 (1.0)       4.0838 (1.36)     462.5479 (1.0)       5.6306 (1.86)          2;0  2.1589 (1.0)           5           3
test_plots-plots-diff[3.10.0]     815.6256 (1.78)     827.3557 (1.76)     819.8716 (1.77)      4.4029 (1.47)     818.7881 (1.77)      3.0295 (1.0)           1;1  1.2197 (0.56)          5           3
test_plots-plots-diff[3.53.2]     777.3904 (1.70)     830.1491 (1.77)     795.1692 (1.72)     20.3209 (6.79)     789.9639 (1.71)     17.0192 (5.62)          1;1  1.2576 (0.58)          5           3
test_plots-plots-diff[main]       777.4771 (1.70)     785.4029 (1.67)     780.7309 (1.69)      2.9920 (1.0)      780.0190 (1.69)      3.7039 (1.22)          2;0  1.2809 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       480.5919 (1.0)        490.3850 (1.0)        484.8790 (1.0)       3.7526 (1.0)        485.3887 (1.0)       5.0197 (1.0)           2;0  2.0624 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,042.7070 (2.17)     1,059.4789 (2.16)     1,047.9316 (2.16)      6.8622 (1.83)     1,046.8859 (2.16)      7.9734 (1.59)          1;0  0.9543 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       845.1087 (1.76)       860.0428 (1.75)       852.7422 (1.76)      5.8942 (1.57)       854.0280 (1.76)      9.0676 (1.81)          2;0  1.1727 (0.57)          5           3
test_plots-plots-diff-json[main]         847.7340 (1.76)       916.3444 (1.87)       865.4890 (1.78)     28.6075 (7.62)       853.5842 (1.76)     19.6845 (3.92)          1;1  1.1554 (0.56)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     420.4671 (1.0)      427.2818 (1.0)      424.2315 (1.0)       2.8777 (2.15)     423.7118 (1.0)       4.8174 (2.31)          2;0  2.3572 (1.0)           5           3
test_plots-plots-show[3.10.0]     671.7186 (1.60)     674.9819 (1.58)     673.2959 (1.59)      1.3357 (1.0)      673.7537 (1.59)      2.0866 (1.0)           2;0  1.4852 (0.63)          5           3
test_plots-plots-show[3.53.2]     646.4932 (1.54)     658.2792 (1.54)     653.0886 (1.54)      4.8379 (3.62)     651.9447 (1.54)      7.5238 (3.61)          2;0  1.5312 (0.65)          5           3
test_plots-plots-show[main]       662.5633 (1.58)     701.9123 (1.64)     672.6016 (1.59)     16.5851 (12.42)    665.0337 (1.57)     13.8917 (6.66)          1;1  1.4868 (0.63)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     433.6190 (1.0)      444.3101 (1.0)      437.7702 (1.0)      4.2311 (1.08)     437.6165 (1.0)      5.8698 (1.06)          1;0  2.2843 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     794.0670 (1.83)     805.0432 (1.81)     799.4888 (1.83)     4.1742 (1.07)     799.0765 (1.83)     5.9684 (1.07)          2;0  1.2508 (0.55)          5           3
test_plots-plots-show-json[3.53.2]     689.8408 (1.59)     699.8068 (1.58)     693.8378 (1.58)     3.9151 (1.0)      692.9967 (1.58)     5.5586 (1.0)           2;0  1.4413 (0.63)          5           3
test_plots-plots-show-json[main]       690.8282 (1.59)     705.1386 (1.59)     695.0956 (1.59)     5.9644 (1.52)     692.0908 (1.58)     6.9908 (1.26)          1;0  1.4387 (0.63)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     3.5126 (2.48)     3.5126 (2.48)     3.5126 (2.48)     0.0000 (1.0)      3.5126 (2.48)     0.0000 (1.0)           0;0  0.2847 (0.40)          1           1
test_push-push[3.10.0]     2.0967 (1.48)     2.0967 (1.48)     2.0967 (1.48)     0.0000 (1.0)      2.0967 (1.48)     0.0000 (1.0)           0;0  0.4769 (0.67)          1           1
test_push-push[3.53.2]     1.5958 (1.13)     1.5958 (1.13)     1.5958 (1.13)     0.0000 (1.0)      1.5958 (1.13)     0.0000 (1.0)           0;0  0.6266 (0.89)          1           1
test_push-push[main]       1.4151 (1.0)      1.4151 (1.0)      1.4151 (1.0)      0.0000 (1.0)      1.4151 (1.0)      0.0000 (1.0)           0;0  0.7067 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     3.8824 (2.64)     3.8824 (2.64)     3.8824 (2.64)     0.0000 (1.0)      3.8824 (2.64)     0.0000 (1.0)           0;0  0.2576 (0.38)          1           1
test_sharing-fetch[3.10.0]     4.2352 (2.88)     4.2352 (2.88)     4.2352 (2.88)     0.0000 (1.0)      4.2352 (2.88)     0.0000 (1.0)           0;0  0.2361 (0.35)          1           1
test_sharing-fetch[3.53.2]     1.7986 (1.22)     1.7986 (1.22)     1.7986 (1.22)     0.0000 (1.0)      1.7986 (1.22)     0.0000 (1.0)           0;0  0.5560 (0.82)          1           1
test_sharing-fetch[main]       1.4713 (1.0)      1.4713 (1.0)      1.4713 (1.0)      0.0000 (1.0)      1.4713 (1.0)      0.0000 (1.0)           0;0  0.6797 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     471.1693 (1.0)      471.1693 (1.0)      471.1693 (1.0)      0.0000 (1.0)      471.1693 (1.0)      0.0000 (1.0)           0;0  2.1224 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     539.8742 (1.15)     539.8742 (1.15)     539.8742 (1.15)     0.0000 (1.0)      539.8742 (1.15)     0.0000 (1.0)           0;0  1.8523 (0.87)          1           1
test_sharing-fetch-noop[3.53.2]     961.1345 (2.04)     961.1345 (2.04)     961.1345 (2.04)     0.0000 (1.0)      961.1345 (2.04)     0.0000 (1.0)           0;0  1.0404 (0.49)          1           1
test_sharing-fetch-noop[main]       822.3111 (1.75)     822.3111 (1.75)     822.3111 (1.75)     0.0000 (1.0)      822.3111 (1.75)     0.0000 (1.0)           0;0  1.2161 (0.57)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     3.5823 (2.51)     3.5823 (2.51)     3.5823 (2.51)     0.0000 (1.0)      3.5823 (2.51)     0.0000 (1.0)           0;0  0.2791 (0.40)          1           1
test_sharing-push[3.10.0]     2.1306 (1.49)     2.1306 (1.49)     2.1306 (1.49)     0.0000 (1.0)      2.1306 (1.49)     0.0000 (1.0)           0;0  0.4694 (0.67)          1           1
test_sharing-push[3.53.2]     1.6397 (1.15)     1.6397 (1.15)     1.6397 (1.15)     0.0000 (1.0)      1.6397 (1.15)     0.0000 (1.0)           0;0  0.6099 (0.87)          1           1
test_sharing-push[main]       1.4285 (1.0)      1.4285 (1.0)      1.4285 (1.0)      0.0000 (1.0)      1.4285 (1.0)      0.0000 (1.0)           0;0  0.7000 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     487.3894 (1.02)     487.3894 (1.02)     487.3894 (1.02)     0.0000 (1.0)      487.3894 (1.02)     0.0000 (1.0)           0;0  2.0517 (0.98)          1           1
test_sharing-push-noop[3.10.0]     477.5200 (1.0)      477.5200 (1.0)      477.5200 (1.0)      0.0000 (1.0)      477.5200 (1.0)      0.0000 (1.0)           0;0  2.0942 (1.0)           1           1
test_sharing-push-noop[3.53.2]     837.3952 (1.75)     837.3952 (1.75)     837.3952 (1.75)     0.0000 (1.0)      837.3952 (1.75)     0.0000 (1.0)           0;0  1.1942 (0.57)          1           1
test_sharing-push-noop[main]       828.9705 (1.74)     828.9705 (1.74)     828.9705 (1.74)     0.0000 (1.0)      828.9705 (1.74)     0.0000 (1.0)           0;0  1.2063 (0.58)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     1.6064 (2.09)     1.6064 (2.09)     1.6064 (2.09)     0.0000 (1.0)      1.6064 (2.09)     0.0000 (1.0)           0;0  0.6225 (0.48)          1           1
test_status-status[3.10.0]     1.4837 (1.93)     1.4837 (1.93)     1.4837 (1.93)     0.0000 (1.0)      1.4837 (1.93)     0.0000 (1.0)           0;0  0.6740 (0.52)          1           1
test_status-status[3.53.2]     1.3274 (1.73)     1.3274 (1.73)     1.3274 (1.73)     0.0000 (1.0)      1.3274 (1.73)     0.0000 (1.0)           0;0  0.7533 (0.58)          1           1
test_status-status[main]       0.7688 (1.0)      0.7688 (1.0)      0.7688 (1.0)      0.0000 (1.0)      0.7688 (1.0)      0.0000 (1.0)           0;0  1.3006 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     587.5864 (1.16)     587.5864 (1.16)     587.5864 (1.16)     0.0000 (1.0)      587.5864 (1.16)     0.0000 (1.0)           0;0  1.7019 (0.86)          1           1
test_status-status-changed[3.10.0]     581.6162 (1.14)     581.6162 (1.14)     581.6162 (1.14)     0.0000 (1.0)      581.6162 (1.14)     0.0000 (1.0)           0;0  1.7193 (0.87)          1           1
test_status-status-changed[3.53.2]     585.6549 (1.15)     585.6549 (1.15)     585.6549 (1.15)     0.0000 (1.0)      585.6549 (1.15)     0.0000 (1.0)           0;0  1.7075 (0.87)          1           1
test_status-status-changed[main]       508.1774 (1.0)      508.1774 (1.0)      508.1774 (1.0)      0.0000 (1.0)      508.1774 (1.0)      0.0000 (1.0)           0;0  1.9678 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     583.5120 (1.22)     583.5120 (1.22)     583.5120 (1.22)     0.0000 (1.0)      583.5120 (1.22)     0.0000 (1.0)           0;0  1.7138 (0.82)          1           1
test_status-status-changed-noop[3.10.0]     585.9763 (1.22)     585.9763 (1.22)     585.9763 (1.22)     0.0000 (1.0)      585.9763 (1.22)     0.0000 (1.0)           0;0  1.7066 (0.82)          1           1
test_status-status-changed-noop[3.53.2]     560.6690 (1.17)     560.6690 (1.17)     560.6690 (1.17)     0.0000 (1.0)      560.6690 (1.17)     0.0000 (1.0)           0;0  1.7836 (0.85)          1           1
test_status-status-changed-noop[main]       479.1320 (1.0)      479.1320 (1.0)      479.1320 (1.0)      0.0000 (1.0)      479.1320 (1.0)      0.0000 (1.0)           0;0  2.0871 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     578.7627 (1.15)     578.7627 (1.15)     578.7627 (1.15)     0.0000 (1.0)      578.7627 (1.15)     0.0000 (1.0)           0;0  1.7278 (0.87)          1           1
test_status-status-noop[3.10.0]     584.0589 (1.16)     584.0589 (1.16)     584.0589 (1.16)     0.0000 (1.0)      584.0589 (1.16)     0.0000 (1.0)           0;0  1.7122 (0.86)          1           1
test_status-status-noop[3.53.2]     551.7850 (1.09)     551.7850 (1.09)     551.7850 (1.09)     0.0000 (1.0)      551.7850 (1.09)     0.0000 (1.0)           0;0  1.8123 (0.92)          1           1
test_status-status-noop[main]       505.1914 (1.0)      505.1914 (1.0)      505.1914 (1.0)      0.0000 (1.0)      505.1914 (1.0)      0.0000 (1.0)           0;0  1.9794 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     7.8997 (2.79)     7.8997 (2.79)     7.8997 (2.79)     0.0000 (1.0)      7.8997 (2.79)     0.0000 (1.0)           0;0  0.1266 (0.36)          1           1
test_update-import-url[3.10.0]     7.4410 (2.63)     7.4410 (2.63)     7.4410 (2.63)     0.0000 (1.0)      7.4410 (2.63)     0.0000 (1.0)           0;0  0.1344 (0.38)          1           1
test_update-import-url[3.53.2]     5.1383 (1.82)     5.1383 (1.82)     5.1383 (1.82)     0.0000 (1.0)      5.1383 (1.82)     0.0000 (1.0)           0;0  0.1946 (0.55)          1           1
test_update-import-url[main]       2.8279 (1.0)      2.8279 (1.0)      2.8279 (1.0)      0.0000 (1.0)      2.8279 (1.0)      0.0000 (1.0)           0;0  0.3536 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     6.6716 (3.83)     6.6716 (3.83)     6.6716 (3.83)     0.0000 (1.0)      6.6716 (3.83)     0.0000 (1.0)           0;0  0.1499 (0.26)          1           1
test_update-update[3.10.0]     6.5684 (3.77)     6.5684 (3.77)     6.5684 (3.77)     0.0000 (1.0)      6.5684 (3.77)     0.0000 (1.0)           0;0  0.1522 (0.27)          1           1
test_update-update[3.53.2]     4.0514 (2.32)     4.0514 (2.32)     4.0514 (2.32)     0.0000 (1.0)      4.0514 (2.32)     0.0000 (1.0)           0;0  0.2468 (0.43)          1           1
test_update-update[main]       1.7428 (1.0)      1.7428 (1.0)      1.7428 (1.0)      0.0000 (1.0)      1.7428 (1.0)      0.0000 (1.0)           0;0  0.5738 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     971.7137 (1.57)     971.7137 (1.57)     971.7137 (1.57)     0.0000 (1.0)      971.7137 (1.57)     0.0000 (1.0)           0;0  1.0291 (0.64)          1           1
test_update-update-noop[3.10.0]     968.6205 (1.56)     968.6205 (1.56)     968.6205 (1.56)     0.0000 (1.0)      968.6205 (1.56)     0.0000 (1.0)           0;0  1.0324 (0.64)          1           1
test_update-update-noop[3.53.2]     915.6529 (1.48)     915.6529 (1.48)     915.6529 (1.48)     0.0000 (1.0)      915.6529 (1.48)     0.0000 (1.0)           0;0  1.0921 (0.68)          1           1
test_update-update-noop[main]       619.9412 (1.0)      619.9412 (1.0)      619.9412 (1.0)      0.0000 (1.0)      619.9412 (1.0)      0.0000 (1.0)           0;0  1.6131 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean