iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

Configure Renovate #361

Closed renovate[bot] closed 2 years ago

renovate[bot] commented 2 years ago

Mend Renovate

Welcome to Renovate! This is an onboarding PR to help you understand and configure settings before regular Pull Requests begin.

šŸš¦ To activate Renovate, merge this Pull Request. To disable Renovate, simply close this Pull Request unmerged.


Detected Package Files

Configuration Summary

Based on the default config's presets, Renovate will:

šŸ”” Would you like to change the way Renovate is upgrading your dependencies? Simply edit the renovate.json in this branch with your custom config and the list of Pull Requests in the "What to Expect" section below will be updated the next time Renovate runs.


What to Expect

With your current configuration, Renovate will create 8 Pull Requests:

chore(deps): update dependency dvc to v2.11.0 - Schedule: ["at any time"] - Branch name: `renovate/dvc-2.x` - Merge into: `main` - Upgrade [dvc](https://togithub.com/iterative/dvc) to `==2.11.0`
chore(deps): update dependency pre-commit to v2.19.0 - Schedule: ["at any time"] - Branch name: `renovate/pre-commit-2.x` - Merge into: `main` - Upgrade [pre-commit](https://togithub.com/pre-commit/pre-commit) to `==2.19.0`
chore(deps): update dependency virtualenv to v20.14.1 - Schedule: ["at any time"] - Branch name: `renovate/virtualenv-20.x` - Merge into: `main` - Upgrade [virtualenv](https://togithub.com/pypa/virtualenv) to `==20.14.1`
chore(deps): update actions/checkout action to v3 - Schedule: ["at any time"] - Branch name: `renovate/actions-checkout-3.x` - Merge into: `main` - Upgrade [actions/checkout](https://togithub.com/actions/checkout) to `v3`
chore(deps): update actions/download-artifact action to v3 - Schedule: ["at any time"] - Branch name: `renovate/actions-download-artifact-3.x` - Merge into: `main` - Upgrade [actions/download-artifact](https://togithub.com/actions/download-artifact) to `v3`
chore(deps): update actions/setup-python action to v4 - Schedule: ["at any time"] - Branch name: `renovate/actions-setup-python-4.x` - Merge into: `main` - Upgrade [actions/setup-python](https://togithub.com/actions/setup-python) to `v4`
chore(deps): update actions/upload-artifact action to v3 - Schedule: ["at any time"] - Branch name: `renovate/actions-upload-artifact-3.x` - Merge into: `main` - Upgrade [actions/upload-artifact](https://togithub.com/actions/upload-artifact) to `v3`
chore(deps): update peter-evans/create-or-update-comment action to v2 - Schedule: ["at any time"] - Branch name: `renovate/peter-evans-create-or-update-comment-2.x` - Merge into: `main` - Upgrade [peter-evans/create-or-update-comment](https://togithub.com/peter-evans/create-or-update-comment) to `v2`


šŸšø Branch creation will be limited to maximum 2 per hour, so it doesn't swamp any CI resources or spam the project. See docs for prhourlylimit for details.


ā“ Got questions? Check out Renovate's Docs, particularly the Getting Started section. If you need any further assistance then you can also request help here.


This PR has been generated by Mend Renovate. View repository job log here.

renovate[bot] commented 2 years ago

Renovate is disabled

Renovate is disabled because there is no Renovate configuration file. To enable Renovate, you can either (a) change this PR's title to get a new onboarding PR, and merge the new onboarding PR, or (b) create a Renovate config file, and commit that file to your base branch.

github-actions[bot] commented 2 years ago

dataset: mnist
project: example-get-started

----------------------------------------------------------------------------------- benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.10.2] (0001_test_ad) 299.4764 (1.12) 299.4764 (1.12) 299.4764 (1.12) 0.0000 (1.0) 299.4764 (1.12) 0.0000 (1.0) 0;0 0.0033 (0.89) 1 1
test_add-add[2.11.0] (0001_test_ad) 294.4521 (1.10) 294.4521 (1.10) 294.4521 (1.10) 0.0000 (1.0) 294.4521 (1.10) 0.0000 (1.0) 0;0 0.0034 (0.91) 1 1
test_add-add[2.6.3] (0001_test_ad) 344.1527 (1.29) 344.1527 (1.29) 344.1527 (1.29) 0.0000 (1.0) 344.1527 (1.29) 0.0000 (1.0) 0;0 0.0029 (0.78) 1 1
test_add-add[2.9.5] (0001_test_ad) 362.9463 (1.36) 362.9463 (1.36) 362.9463 (1.36) 0.0000 (1.0) 362.9463 (1.36) 0.0000 (1.0) 0;0 0.0028 (0.74) 1 1
test_add-add[main] (0001_test_ad) 267.1055 (1.0) 267.1055 (1.0) 267.1055 (1.0) 0.0000 (1.0) 267.1055 (1.0) 0.0000 (1.0) 0;0 0.0037 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_checkout-checkout': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout[2.10.2] (0001_test_ch) 113.7859 (1.42) 113.7859 (1.42) 113.7859 (1.42) 0.0000 (1.0) 113.7859 (1.42) 0.0000 (1.0) 0;0 0.0088 (0.71) 1 1
test_checkout-checkout[2.11.0] (0001_test_ch) 107.6897 (1.34) 107.6897 (1.34) 107.6897 (1.34) 0.0000 (1.0) 107.6897 (1.34) 0.0000 (1.0) 0;0 0.0093 (0.75) 1 1
test_checkout-checkout[2.6.3] (0001_test_ch) 80.4047 (1.0) 80.4047 (1.0) 80.4047 (1.0) 0.0000 (1.0) 80.4047 (1.0) 0.0000 (1.0) 0;0 0.0124 (1.0) 1 1
test_checkout-checkout[2.9.5] (0001_test_ch) 127.4287 (1.58) 127.4287 (1.58) 127.4287 (1.58) 0.0000 (1.0) 127.4287 (1.58) 0.0000 (1.0) 0;0 0.0078 (0.63) 1 1
test_checkout-checkout[main] (0001_test_ch) 115.3193 (1.43) 115.3193 (1.43) 115.3193 (1.43) 0.0000 (1.0) 115.3193 (1.43) 0.0000 (1.0) 0;0 0.0087 (0.70) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_checkout-checkout-noop': 5 tests ---------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout-noop[2.10.2] (0001_test_ch) 6.0782 (2.06) 6.0782 (2.06) 6.0782 (2.06) 0.0000 (1.0) 6.0782 (2.06) 0.0000 (1.0) 0;0 0.1645 (0.48) 1 1
test_checkout-checkout-noop[2.11.0] (0001_test_ch) 5.7210 (1.94) 5.7210 (1.94) 5.7210 (1.94) 0.0000 (1.0) 5.7210 (1.94) 0.0000 (1.0) 0;0 0.1748 (0.51) 1 1
test_checkout-checkout-noop[2.6.3] (0001_test_ch) 2.9446 (1.0) 2.9446 (1.0) 2.9446 (1.0) 0.0000 (1.0) 2.9446 (1.0) 0.0000 (1.0) 0;0 0.3396 (1.0) 1 1
test_checkout-checkout-noop[2.9.5] (0001_test_ch) 5.8208 (1.98) 5.8208 (1.98) 5.8208 (1.98) 0.0000 (1.0) 5.8208 (1.98) 0.0000 (1.0) 0;0 0.1718 (0.51) 1 1
test_checkout-checkout-noop[main] (0001_test_ch) 10.4773 (3.56) 10.4773 (3.56) 10.4773 (3.56) 0.0000 (1.0) 10.4773 (3.56) 0.0000 (1.0) 0;0 0.0954 (0.28) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_checkout-checkout-update': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout-update[2.10.2] (0001_test_ch) 42.5379 (3.66) 42.5379 (3.66) 42.5379 (3.66) 0.0000 (1.0) 42.5379 (3.66) 0.0000 (1.0) 0;0 0.0235 (0.27) 1 1
test_checkout-checkout-update[2.11.0] (0001_test_ch) 43.2121 (3.72) 43.2121 (3.72) 43.2121 (3.72) 0.0000 (1.0) 43.2121 (3.72) 0.0000 (1.0) 0;0 0.0231 (0.27) 1 1
test_checkout-checkout-update[2.6.3] (0001_test_ch) 111.3022 (9.58) 111.3022 (9.58) 111.3022 (9.58) 0.0000 (1.0) 111.3022 (9.58) 0.0000 (1.0) 0;0 0.0090 (0.10) 1 1
test_checkout-checkout-update[2.9.5] (0001_test_ch) 42.1870 (3.63) 42.1870 (3.63) 42.1870 (3.63) 0.0000 (1.0) 42.1870 (3.63) 0.0000 (1.0) 0;0 0.0237 (0.28) 1 1
test_checkout-checkout-update[main] (0001_test_ch) 11.6222 (1.0) 11.6222 (1.0) 11.6222 (1.0) 0.0000 (1.0) 11.6222 (1.0) 0.0000 (1.0) 0;0 0.0860 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.10.2] (0001_test_di) 44.6762 (1.63) 44.6762 (1.63) 44.6762 (1.63) 0.0000 (1.0) 44.6762 (1.63) 0.0000 (1.0) 0;0 0.0224 (0.61) 1 1
test_diff-diff[2.11.0] (0001_test_di) 40.7670 (1.49) 40.7670 (1.49) 40.7670 (1.49) 0.0000 (1.0) 40.7670 (1.49) 0.0000 (1.0) 0;0 0.0245 (0.67) 1 1
test_diff-diff[2.6.3] (0001_test_di) 81.7493 (2.98) 81.7493 (2.98) 81.7493 (2.98) 0.0000 (1.0) 81.7493 (2.98) 0.0000 (1.0) 0;0 0.0122 (0.34) 1 1
test_diff-diff[2.9.5] (0001_test_di) 43.9734 (1.61) 43.9734 (1.61) 43.9734 (1.61) 0.0000 (1.0) 43.9734 (1.61) 0.0000 (1.0) 0;0 0.0227 (0.62) 1 1
test_diff-diff[main] (0001_test_di) 27.3884 (1.0) 27.3884 (1.0) 27.3884 (1.0) 0.0000 (1.0) 27.3884 (1.0) 0.0000 (1.0) 0;0 0.0365 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.10.2] (0001_test_di) 27.4913 (5.50) 27.4913 (5.50) 27.4913 (5.50) 0.0000 (1.0) 27.4913 (5.50) 0.0000 (1.0) 0;0 0.0364 (0.18) 1 1
test_diff-diff-changed[2.11.0] (0001_test_di) 26.5140 (5.30) 26.5140 (5.30) 26.5140 (5.30) 0.0000 (1.0) 26.5140 (5.30) 0.0000 (1.0) 0;0 0.0377 (0.19) 1 1
test_diff-diff-changed[2.6.3] (0001_test_di) 61.9817 (12.39) 61.9817 (12.39) 61.9817 (12.39) 0.0000 (1.0) 61.9817 (12.39) 0.0000 (1.0) 0;0 0.0161 (0.08) 1 1
test_diff-diff-changed[2.9.5] (0001_test_di) 26.8171 (5.36) 26.8171 (5.36) 26.8171 (5.36) 0.0000 (1.0) 26.8171 (5.36) 0.0000 (1.0) 0;0 0.0373 (0.19) 1 1
test_diff-diff-changed[main] (0001_test_di) 5.0015 (1.0) 5.0015 (1.0) 5.0015 (1.0) 0.0000 (1.0) 5.0015 (1.0) 0.0000 (1.0) 0;0 0.1999 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests ---------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.10.2] (0001_test_di) 27.1237 (9.45) 27.1237 (9.45) 27.1237 (9.45) 0.0000 (1.0) 27.1237 (9.45) 0.0000 (1.0) 0;0 0.0369 (0.11) 1 1
test_diff-diff-changed-noop[2.11.0] (0001_test_di) 2.8699 (1.0) 2.8699 (1.0) 2.8699 (1.0) 0.0000 (1.0) 2.8699 (1.0) 0.0000 (1.0) 0;0 0.3484 (1.0) 1 1
test_diff-diff-changed-noop[2.6.3] (0001_test_di) 61.8035 (21.53) 61.8035 (21.53) 61.8035 (21.53) 0.0000 (1.0) 61.8035 (21.53) 0.0000 (1.0) 0;0 0.0162 (0.05) 1 1
test_diff-diff-changed-noop[2.9.5] (0001_test_di) 26.7619 (9.32) 26.7619 (9.32) 26.7619 (9.32) 0.0000 (1.0) 26.7619 (9.32) 0.0000 (1.0) 0;0 0.0374 (0.11) 1 1
test_diff-diff-changed-noop[main] (0001_test_di) 5.5925 (1.95) 5.5925 (1.95) 5.5925 (1.95) 0.0000 (1.0) 5.5925 (1.95) 0.0000 (1.0) 0;0 0.1788 (0.51) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ---------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.10.2] (0001_test_di) 3.2739 (1.04) 3.2739 (1.04) 3.2739 (1.04) 0.0000 (1.0) 3.2739 (1.04) 0.0000 (1.0) 0;0 0.3054 (0.97) 1 1
test_diff-diff-noop[2.11.0] (0001_test_di) 3.1835 (1.01) 3.1835 (1.01) 3.1835 (1.01) 0.0000 (1.0) 3.1835 (1.01) 0.0000 (1.0) 0;0 0.3141 (0.99) 1 1
test_diff-diff-noop[2.6.3] (0001_test_di) 40.2708 (12.74) 40.2708 (12.74) 40.2708 (12.74) 0.0000 (1.0) 40.2708 (12.74) 0.0000 (1.0) 0;0 0.0248 (0.08) 1 1
test_diff-diff-noop[2.9.5] (0001_test_di) 3.1611 (1.0) 3.1611 (1.0) 3.1611 (1.0) 0.0000 (1.0) 3.1611 (1.0) 0.0000 (1.0) 0;0 0.3163 (1.0) 1 1
test_diff-diff-noop[main] (0001_test_di) 5.5693 (1.76) 5.5693 (1.76) 5.5693 (1.76) 0.0000 (1.0) 5.5693 (1.76) 0.0000 (1.0) 0;0 0.1796 (0.57) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests -------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.10.2] (0001_test_ex) 1.1755 (1.00) 1.1755 (1.00) 1.1755 (1.00) 0.0000 (1.0) 1.1755 (1.00) 0.0000 (1.0) 0;0 0.8507 (1.00) 1 1
test_exp_show-exp[2.11.0] (0001_test_ex) 1.1702 (1.0) 1.1702 (1.0) 1.1702 (1.0) 0.0000 (1.0) 1.1702 (1.0) 0.0000 (1.0) 0;0 0.8545 (1.0) 1 1
test_exp_show-exp[main] (0001_test_ex) 1.2914 (1.10) 1.2914 (1.10) 1.2914 (1.10) 0.0000 (1.0) 1.2914 (1.10) 0.0000 (1.0) 0;0 0.7744 (0.91) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.10.2] (0001_test_gc) 2.9142 (1.17) 2.9142 (1.17) 2.9142 (1.17) 0.0000 (1.0) 2.9142 (1.17) 0.0000 (1.0) 0;0 0.3431 (0.85) 1 1
test_gc-gc[2.11.0] (0001_test_gc) 2.4864 (1.0) 2.4864 (1.0) 2.4864 (1.0) 0.0000 (1.0) 2.4864 (1.0) 0.0000 (1.0) 0;0 0.4022 (1.0) 1 1
test_gc-gc[2.6.3] (0001_test_gc) 3.5302 (1.42) 3.5302 (1.42) 3.5302 (1.42) 0.0000 (1.0) 3.5302 (1.42) 0.0000 (1.0) 0;0 0.2833 (0.70) 1 1
test_gc-gc[2.9.5] (0001_test_gc) 2.9412 (1.18) 2.9412 (1.18) 2.9412 (1.18) 0.0000 (1.0) 2.9412 (1.18) 0.0000 (1.0) 0;0 0.3400 (0.85) 1 1
test_gc-gc[main] (0001_test_gc) 2.6926 (1.08) 2.6926 (1.08) 2.6926 (1.08) 0.0000 (1.0) 2.6926 (1.08) 0.0000 (1.0) 0;0 0.3714 (0.92) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.10.2] (0001_test_ge) 184.0093 (2.06) 184.0093 (2.06) 184.0093 (2.06) 0.0000 (1.0) 184.0093 (2.06) 0.0000 (1.0) 0;0 0.0054 (0.49) 1 1
test_get-get[2.11.0] (0001_test_ge) 149.1068 (1.67) 149.1068 (1.67) 149.1068 (1.67) 0.0000 (1.0) 149.1068 (1.67) 0.0000 (1.0) 0;0 0.0067 (0.60) 1 1
test_get-get[2.6.3] (0001_test_ge) 105.2695 (1.18) 105.2695 (1.18) 105.2695 (1.18) 0.0000 (1.0) 105.2695 (1.18) 0.0000 (1.0) 0;0 0.0095 (0.85) 1 1
test_get-get[2.9.5] (0001_test_ge) 89.4494 (1.0) 89.4494 (1.0) 89.4494 (1.0) 0.0000 (1.0) 89.4494 (1.0) 0.0000 (1.0) 0;0 0.0112 (1.0) 1 1
test_get-get[main] (0001_test_ge) 149.4482 (1.67) 149.4482 (1.67) 149.4482 (1.67) 0.0000 (1.0) 149.4482 (1.67) 0.0000 (1.0) 0;0 0.0067 (0.60) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_help---help': 5 tests -------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.10.2] (0001_test_he) 180.2018 (1.10) 228.3474 (1.16) 195.0412 (1.10) 8.0808 (1.06) 193.5281 (1.10) 9.4954 (1.0) 22;3 5.1271 (0.91) 100 1
test_help---help[2.11.0] (0001_test_he) 168.2348 (1.03) 208.2907 (1.06) 182.0230 (1.03) 7.9284 (1.04) 181.5852 (1.03) 10.3168 (1.09) 31;2 5.4938 (0.97) 100 1
test_help---help[2.6.3] (0001_test_he) 235.8831 (1.44) 298.1694 (1.52) 247.3181 (1.40) 10.1259 (1.32) 243.4536 (1.39) 9.7339 (1.03) 14;4 4.0434 (0.71) 100 1
test_help---help[2.9.5] (0001_test_he) 184.3264 (1.13) 223.6939 (1.14) 196.9974 (1.11) 8.6449 (1.13) 194.4379 (1.11) 10.6182 (1.12) 29;2 5.0762 (0.90) 100 1
test_help---help[main] (0001_test_he) 163.7888 (1.0) 196.6014 (1.0) 176.7112 (1.0) 7.6440 (1.0) 175.4660 (1.0) 10.6112 (1.12) 32;0 5.6590 (1.0) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.10.2] (0001_test_im) 511.7174 (1.53) 511.7174 (1.53) 511.7174 (1.53) 0.0000 (1.0) 511.7174 (1.53) 0.0000 (1.0) 0;0 0.0020 (0.65) 1 1
test_import-import[2.11.0] (0001_test_im) 458.7847 (1.38) 458.7847 (1.38) 458.7847 (1.38) 0.0000 (1.0) 458.7847 (1.38) 0.0000 (1.0) 0;0 0.0022 (0.73) 1 1
test_import-import[2.6.3] (0001_test_im) 333.5543 (1.0) 333.5543 (1.0) 333.5543 (1.0) 0.0000 (1.0) 333.5543 (1.0) 0.0000 (1.0) 0;0 0.0030 (1.0) 1 1
test_import-import[2.9.5] (0001_test_im) 507.5274 (1.52) 507.5274 (1.52) 507.5274 (1.52) 0.0000 (1.0) 507.5274 (1.52) 0.0000 (1.0) 0;0 0.0020 (0.66) 1 1
test_import-import[main] (0001_test_im) 402.3149 (1.21) 402.3149 (1.21) 402.3149 (1.21) 0.0000 (1.0) 402.3149 (1.21) 0.0000 (1.0) 0;0 0.0025 (0.83) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests ------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.10.2] (0001_test_in) 337.2457 (1.06) 363.5844 (1.06) 343.8971 (1.06) 5.0108 (1.38) 342.8802 (1.05) 5.1256 (1.19) 25;6 2.9078 (0.95) 100 1
test_init-init[2.11.0] (0001_test_in) 339.8166 (1.07) 392.1225 (1.15) 349.6602 (1.07) 8.3675 (2.30) 348.1535 (1.07) 5.0030 (1.17) 12;10 2.8599 (0.93) 100 1
test_init-init[2.6.3] (0001_test_in) 317.6762 (1.0) 341.4417 (1.0) 325.7912 (1.0) 3.6385 (1.0) 325.4571 (1.0) 4.2935 (1.0) 27;2 3.0695 (1.0) 100 1
test_init-init[2.9.5] (0001_test_in) 342.6009 (1.08) 398.1469 (1.17) 351.3116 (1.08) 7.7717 (2.14) 349.3932 (1.07) 6.1883 (1.44) 17;9 2.8465 (0.93) 100 1
test_init-init[main] (0001_test_in) 337.8911 (1.06) 384.8122 (1.13) 348.1059 (1.07) 7.8850 (2.17) 346.4777 (1.06) 5.5715 (1.30) 9;6 2.8727 (0.94) 100 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.10.2] (0001_test_li) 2.6274 (3.56) 2.6274 (3.56) 2.6274 (3.56) 0.0000 (1.0) 2.6274 (3.56) 0.0000 (1.0) 0;0 0.3806 (0.28) 1 1
test_list-list[2.11.0] (0001_test_li) 2.7267 (3.70) 2.7267 (3.70) 2.7267 (3.70) 0.0000 (1.0) 2.7267 (3.70) 0.0000 (1.0) 0;0 0.3667 (0.27) 1 1
test_list-list[2.6.3] (0001_test_li) 0.7373 (1.0) 0.7373 (1.0) 0.7373 (1.0) 0.0000 (1.0) 0.7373 (1.0) 0.0000 (1.0) 0;0 1.3563 (1.0) 1 1
test_list-list[2.9.5] (0001_test_li) 3.0070 (4.08) 3.0070 (4.08) 3.0070 (4.08) 0.0000 (1.0) 3.0070 (4.08) 0.0000 (1.0) 0;0 0.3326 (0.25) 1 1
test_list-list[main] (0001_test_li) 2.8177 (3.82) 2.8177 (3.82) 2.8177 (3.82) 0.0000 (1.0) 2.8177 (3.82) 0.0000 (1.0) 0;0 0.3549 (0.26) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests -------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.10.2] (0001_test_li) 2.6456 (4.40) 2.6456 (4.40) 2.6456 (4.40) 0.0000 (1.0) 2.6456 (4.40) 0.0000 (1.0) 0;0 0.3780 (0.23) 1 1
test_list-list-dvc-only[2.11.0] (0001_test_li) 2.6587 (4.42) 2.6587 (4.42) 2.6587 (4.42) 0.0000 (1.0) 2.6587 (4.42) 0.0000 (1.0) 0;0 0.3761 (0.23) 1 1
test_list-list-dvc-only[2.6.3] (0001_test_li) 0.6014 (1.0) 0.6014 (1.0) 0.6014 (1.0) 0.0000 (1.0) 0.6014 (1.0) 0.0000 (1.0) 0;0 1.6629 (1.0) 1 1
test_list-list-dvc-only[2.9.5] (0001_test_li) 2.9563 (4.92) 2.9563 (4.92) 2.9563 (4.92) 0.0000 (1.0) 2.9563 (4.92) 0.0000 (1.0) 0;0 0.3383 (0.20) 1 1
test_list-list-dvc-only[main] (0001_test_li) 2.7793 (4.62) 2.7793 (4.62) 2.7793 (4.62) 0.0000 (1.0) 2.7793 (4.62) 0.0000 (1.0) 0;0 0.3598 (0.22) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------------- benchmark 'test_plots_show-plots': 5 tests ---------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots_show-plots[2.10.2] (0001_test_pl) 902.1233 (1.35) 902.1233 (1.35) 902.1233 (1.35) 0.0000 (1.0) 902.1233 (1.35) 0.0000 (1.0) 0;0 1.1085 (0.74) 1 1
test_plots_show-plots[2.11.0] (0001_test_pl) 1,534.7571 (2.30) 1,534.7571 (2.30) 1,534.7571 (2.30) 0.0000 (1.0) 1,534.7571 (2.30) 0.0000 (1.0) 0;0 0.6516 (0.43) 1 1
test_plots_show-plots[2.6.3] (0001_test_pl) 667.2467 (1.0) 667.2467 (1.0) 667.2467 (1.0) 0.0000 (1.0) 667.2467 (1.0) 0.0000 (1.0) 0;0 1.4987 (1.0) 1 1
test_plots_show-plots[2.9.5] (0001_test_pl) 1,401.0437 (2.10) 1,401.0437 (2.10) 1,401.0437 (2.10) 0.0000 (1.0) 1,401.0437 (2.10) 0.0000 (1.0) 0;0 0.7138 (0.48) 1 1
test_plots_show-plots[main] (0001_test_pl) 1,695.8114 (2.54) 1,695.8114 (2.54) 1,695.8114 (2.54) 0.0000 (1.0) 1,695.8114 (2.54) 0.0000 (1.0) 0;0 0.5897 (0.39) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_pull-pull': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.10.2] (0001_test_pu) 366.4198 (1.28) 366.4198 (1.28) 366.4198 (1.28) 0.0000 (1.0) 366.4198 (1.28) 0.0000 (1.0) 0;0 0.0027 (0.78) 1 1
test_pull-pull[2.11.0] (0001_test_pu) 367.5800 (1.29) 367.5800 (1.29) 367.5800 (1.29) 0.0000 (1.0) 367.5800 (1.29) 0.0000 (1.0) 0;0 0.0027 (0.78) 1 1
test_pull-pull[2.6.3] (0001_test_pu) 285.8938 (1.0) 285.8938 (1.0) 285.8938 (1.0) 0.0000 (1.0) 285.8938 (1.0) 0.0000 (1.0) 0;0 0.0035 (1.0) 1 1
test_pull-pull[2.9.5] (0001_test_pu) 406.7153 (1.42) 406.7153 (1.42) 406.7153 (1.42) 0.0000 (1.0) 406.7153 (1.42) 0.0000 (1.0) 0;0 0.0025 (0.70) 1 1
test_pull-pull[main] (0001_test_pu) 368.0017 (1.29) 368.0017 (1.29) 368.0017 (1.29) 0.0000 (1.0) 368.0017 (1.29) 0.0000 (1.0) 0;0 0.0027 (0.78) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.10.2] (0001_test_pu) 129.4090 (1.23) 129.4090 (1.23) 129.4090 (1.23) 0.0000 (1.0) 129.4090 (1.23) 0.0000 (1.0) 0;0 0.0077 (0.81) 1 1
test_push-push[2.11.0] (0001_test_pu) 131.4570 (1.25) 131.4570 (1.25) 131.4570 (1.25) 0.0000 (1.0) 131.4570 (1.25) 0.0000 (1.0) 0;0 0.0076 (0.80) 1 1
test_push-push[2.6.3] (0001_test_pu) 105.1808 (1.0) 105.1808 (1.0) 105.1808 (1.0) 0.0000 (1.0) 105.1808 (1.0) 0.0000 (1.0) 0;0 0.0095 (1.0) 1 1
test_push-push[2.9.5] (0001_test_pu) 144.3603 (1.37) 144.3603 (1.37) 144.3603 (1.37) 0.0000 (1.0) 144.3603 (1.37) 0.0000 (1.0) 0;0 0.0069 (0.73) 1 1
test_push-push[main] (0001_test_pu) 129.3847 (1.23) 129.3847 (1.23) 129.3847 (1.23) 0.0000 (1.0) 129.3847 (1.23) 0.0000 (1.0) 0;0 0.0077 (0.81) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.10.2] (0001_test_sh) 247.7114 (1.11) 247.7114 (1.11) 247.7114 (1.11) 0.0000 (1.0) 247.7114 (1.11) 0.0000 (1.0) 0;0 0.0040 (0.90) 1 1
test_sharing-add[2.11.0] (0001_test_sh) 242.9236 (1.09) 242.9236 (1.09) 242.9236 (1.09) 0.0000 (1.0) 242.9236 (1.09) 0.0000 (1.0) 0;0 0.0041 (0.92) 1 1
test_sharing-add[2.6.3] (0001_test_sh) 280.2589 (1.26) 280.2589 (1.26) 280.2589 (1.26) 0.0000 (1.0) 280.2589 (1.26) 0.0000 (1.0) 0;0 0.0036 (0.80) 1 1
test_sharing-add[2.9.5] (0001_test_sh) 300.1470 (1.35) 300.1470 (1.35) 300.1470 (1.35) 0.0000 (1.0) 300.1470 (1.35) 0.0000 (1.0) 0;0 0.0033 (0.74) 1 1
test_sharing-add[main] (0001_test_sh) 223.1335 (1.0) 223.1335 (1.0) 223.1335 (1.0) 0.0000 (1.0) 223.1335 (1.0) 0.0000 (1.0) 0;0 0.0045 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.10.2] (0001_test_sh) 124.7470 (6.43) 124.7470 (6.43) 124.7470 (6.43) 0.0000 (1.0) 124.7470 (6.43) 0.0000 (1.0) 0;0 0.0080 (0.16) 1 1
test_sharing-add-noop[2.11.0] (0001_test_sh) 120.3704 (6.20) 120.3704 (6.20) 120.3704 (6.20) 0.0000 (1.0) 120.3704 (6.20) 0.0000 (1.0) 0;0 0.0083 (0.16) 1 1
test_sharing-add-noop[2.6.3] (0001_test_sh) 19.4000 (1.0) 19.4000 (1.0) 19.4000 (1.0) 0.0000 (1.0) 19.4000 (1.0) 0.0000 (1.0) 0;0 0.0515 (1.0) 1 1
test_sharing-add-noop[2.9.5] (0001_test_sh) 132.9369 (6.85) 132.9369 (6.85) 132.9369 (6.85) 0.0000 (1.0) 132.9369 (6.85) 0.0000 (1.0) 0;0 0.0075 (0.15) 1 1
test_sharing-add-noop[main] (0001_test_sh) 132.1151 (6.81) 132.1151 (6.81) 132.1151 (6.81) 0.0000 (1.0) 132.1151 (6.81) 0.0000 (1.0) 0;0 0.0076 (0.15) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.10.2] (0001_test_sh) 5.8370 (1.99) 5.8370 (1.99) 5.8370 (1.99) 0.0000 (1.0) 5.8370 (1.99) 0.0000 (1.0) 0;0 0.1713 (0.50) 1 1
test_sharing-checkout-noop[2.11.0] (0001_test_sh) 5.8172 (1.99) 5.8172 (1.99) 5.8172 (1.99) 0.0000 (1.0) 5.8172 (1.99) 0.0000 (1.0) 0;0 0.1719 (0.50) 1 1
test_sharing-checkout-noop[2.6.3] (0001_test_sh) 2.9259 (1.0) 2.9259 (1.0) 2.9259 (1.0) 0.0000 (1.0) 2.9259 (1.0) 0.0000 (1.0) 0;0 0.3418 (1.0) 1 1
test_sharing-checkout-noop[2.9.5] (0001_test_sh) 5.8219 (1.99) 5.8219 (1.99) 5.8219 (1.99) 0.0000 (1.0) 5.8219 (1.99) 0.0000 (1.0) 0;0 0.1718 (0.50) 1 1
test_sharing-checkout-noop[main] (0001_test_sh) 7.8160 (2.67) 7.8160 (2.67) 7.8160 (2.67) 0.0000 (1.0) 7.8160 (2.67) 0.0000 (1.0) 0;0 0.1279 (0.37) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_sharing-pull': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.10.2] (0001_test_sh) 276.1295 (1.25) 276.1295 (1.25) 276.1295 (1.25) 0.0000 (1.0) 276.1295 (1.25) 0.0000 (1.0) 0;0 0.0036 (0.80) 1 1
test_sharing-pull[2.11.0] (0001_test_sh) 276.2724 (1.26) 276.2724 (1.26) 276.2724 (1.26) 0.0000 (1.0) 276.2724 (1.26) 0.0000 (1.0) 0;0 0.0036 (0.80) 1 1
test_sharing-pull[2.6.3] (0001_test_sh) 220.0408 (1.0) 220.0408 (1.0) 220.0408 (1.0) 0.0000 (1.0) 220.0408 (1.0) 0.0000 (1.0) 0;0 0.0045 (1.0) 1 1
test_sharing-pull[2.9.5] (0001_test_sh) 313.0704 (1.42) 313.0704 (1.42) 313.0704 (1.42) 0.0000 (1.0) 313.0704 (1.42) 0.0000 (1.0) 0;0 0.0032 (0.70) 1 1
test_sharing-pull[main] (0001_test_sh) 281.8364 (1.28) 281.8364 (1.28) 281.8364 (1.28) 0.0000 (1.0) 281.8364 (1.28) 0.0000 (1.0) 0;0 0.0035 (0.78) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.10.2] (0001_test_sh) 6.8671 (1.77) 6.8671 (1.77) 6.8671 (1.77) 0.0000 (1.0) 6.8671 (1.77) 0.0000 (1.0) 0;0 0.1456 (0.57) 1 1
test_sharing-pull-noop[2.11.0] (0001_test_sh) 6.7073 (1.73) 6.7073 (1.73) 6.7073 (1.73) 0.0000 (1.0) 6.7073 (1.73) 0.0000 (1.0) 0;0 0.1491 (0.58) 1 1
test_sharing-pull-noop[2.6.3] (0001_test_sh) 3.8829 (1.0) 3.8829 (1.0) 3.8829 (1.0) 0.0000 (1.0) 3.8829 (1.0) 0.0000 (1.0) 0;0 0.2575 (1.0) 1 1
test_sharing-pull-noop[2.9.5] (0001_test_sh) 6.6193 (1.70) 6.6193 (1.70) 6.6193 (1.70) 0.0000 (1.0) 6.6193 (1.70) 0.0000 (1.0) 0;0 0.1511 (0.59) 1 1
test_sharing-pull-noop[main] (0001_test_sh) 8.6752 (2.23) 8.6752 (2.23) 8.6752 (2.23) 0.0000 (1.0) 8.6752 (2.23) 0.0000 (1.0) 0;0 0.1153 (0.45) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.10.2] (0001_test_sh) 152.3045 (1.27) 152.3045 (1.27) 152.3045 (1.27) 0.0000 (1.0) 152.3045 (1.27) 0.0000 (1.0) 0;0 0.0066 (0.79) 1 1
test_sharing-push[2.11.0] (0001_test_sh) 151.9051 (1.27) 151.9051 (1.27) 151.9051 (1.27) 0.0000 (1.0) 151.9051 (1.27) 0.0000 (1.0) 0;0 0.0066 (0.79) 1 1
test_sharing-push[2.6.3] (0001_test_sh) 119.8841 (1.0) 119.8841 (1.0) 119.8841 (1.0) 0.0000 (1.0) 119.8841 (1.0) 0.0000 (1.0) 0;0 0.0083 (1.0) 1 1
test_sharing-push[2.9.5] (0001_test_sh) 166.4024 (1.39) 166.4024 (1.39) 166.4024 (1.39) 0.0000 (1.0) 166.4024 (1.39) 0.0000 (1.0) 0;0 0.0060 (0.72) 1 1
test_sharing-push[main] (0001_test_sh) 150.9782 (1.26) 150.9782 (1.26) 150.9782 (1.26) 0.0000 (1.0) 150.9782 (1.26) 0.0000 (1.0) 0;0 0.0066 (0.79) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.10.2] (0001_test_sh) 2.9491 (1.05) 2.9491 (1.05) 2.9491 (1.05) 0.0000 (1.0) 2.9491 (1.05) 0.0000 (1.0) 0;0 0.3391 (0.95) 1 1
test_sharing-push-noop[2.11.0] (0001_test_sh) 3.0385 (1.08) 3.0385 (1.08) 3.0385 (1.08) 0.0000 (1.0) 3.0385 (1.08) 0.0000 (1.0) 0;0 0.3291 (0.93) 1 1
test_sharing-push-noop[2.6.3] (0001_test_sh) 3.4150 (1.21) 3.4150 (1.21) 3.4150 (1.21) 0.0000 (1.0) 3.4150 (1.21) 0.0000 (1.0) 0;0 0.2928 (0.82) 1 1
test_sharing-push-noop[2.9.5] (0001_test_sh) 2.8142 (1.0) 2.8142 (1.0) 2.8142 (1.0) 0.0000 (1.0) 2.8142 (1.0) 0.0000 (1.0) 0;0 0.3553 (1.0) 1 1
test_sharing-push-noop[main] (0001_test_sh) 2.8312 (1.01) 2.8312 (1.01) 2.8312 (1.01) 0.0000 (1.0) 2.8312 (1.01) 0.0000 (1.0) 0;0 0.3532 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.10.2] (0001_test_st) 65.8639 (1.93) 65.8639 (1.93) 65.8639 (1.93) 0.0000 (1.0) 65.8639 (1.93) 0.0000 (1.0) 0;0 0.0152 (0.52) 1 1
test_status-status[2.11.0] (0001_test_st) 62.3520 (1.82) 62.3520 (1.82) 62.3520 (1.82) 0.0000 (1.0) 62.3520 (1.82) 0.0000 (1.0) 0;0 0.0160 (0.55) 1 1
test_status-status[2.6.3] (0001_test_st) 114.9789 (3.36) 114.9789 (3.36) 114.9789 (3.36) 0.0000 (1.0) 114.9789 (3.36) 0.0000 (1.0) 0;0 0.0087 (0.30) 1 1
test_status-status[2.9.5] (0001_test_st) 109.5943 (3.20) 109.5943 (3.20) 109.5943 (3.20) 0.0000 (1.0) 109.5943 (3.20) 0.0000 (1.0) 0;0 0.0091 (0.31) 1 1
test_status-status[main] (0001_test_st) 34.2100 (1.0) 34.2100 (1.0) 34.2100 (1.0) 0.0000 (1.0) 34.2100 (1.0) 0.0000 (1.0) 0;0 0.0292 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_status-status-changed': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.10.2] (0001_test_st) 45.7970 (7.38) 45.7970 (7.38) 45.7970 (7.38) 0.0000 (1.0) 45.7970 (7.38) 0.0000 (1.0) 0;0 0.0218 (0.14) 1 1
test_status-status-changed[2.11.0] (0001_test_st) 45.6971 (7.36) 45.6971 (7.36) 45.6971 (7.36) 0.0000 (1.0) 45.6971 (7.36) 0.0000 (1.0) 0;0 0.0219 (0.14) 1 1
test_status-status-changed[2.6.3] (0001_test_st) 89.7124 (14.45) 89.7124 (14.45) 89.7124 (14.45) 0.0000 (1.0) 89.7124 (14.45) 0.0000 (1.0) 0;0 0.0111 (0.07) 1 1
test_status-status-changed[2.9.5] (0001_test_st) 87.0136 (14.01) 87.0136 (14.01) 87.0136 (14.01) 0.0000 (1.0) 87.0136 (14.01) 0.0000 (1.0) 0;0 0.0115 (0.07) 1 1
test_status-status-changed[main] (0001_test_st) 6.2090 (1.0) 6.2090 (1.0) 6.2090 (1.0) 0.0000 (1.0) 6.2090 (1.0) 0.0000 (1.0) 0;0 0.1611 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ---------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.10.2] (0001_test_st) 46.2350 (7.43) 46.2350 (7.43) 46.2350 (7.43) 0.0000 (1.0) 46.2350 (7.43) 0.0000 (1.0) 0;0 0.0216 (0.13) 1 1
test_status-status-changed-noop[2.11.0] (0001_test_st) 10.4796 (1.68) 10.4796 (1.68) 10.4796 (1.68) 0.0000 (1.0) 10.4796 (1.68) 0.0000 (1.0) 0;0 0.0954 (0.59) 1 1
test_status-status-changed-noop[2.6.3] (0001_test_st) 90.4278 (14.54) 90.4278 (14.54) 90.4278 (14.54) 0.0000 (1.0) 90.4278 (14.54) 0.0000 (1.0) 0;0 0.0111 (0.07) 1 1
test_status-status-changed-noop[2.9.5] (0001_test_st) 86.6759 (13.94) 86.6759 (13.94) 86.6759 (13.94) 0.0000 (1.0) 86.6759 (13.94) 0.0000 (1.0) 0;0 0.0115 (0.07) 1 1
test_status-status-changed-noop[main] (0001_test_st) 6.2200 (1.0) 6.2200 (1.0) 6.2200 (1.0) 0.0000 (1.0) 6.2200 (1.0) 0.0000 (1.0) 0;0 0.1608 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests -------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.10.2] (0001_test_st) 3.1381 (1.02) 3.1381 (1.02) 3.1381 (1.02) 0.0000 (1.0) 3.1381 (1.02) 0.0000 (1.0) 0;0 0.3187 (0.98) 1 1
test_status-status-noop[2.11.0] (0001_test_st) 3.0652 (1.0) 3.0652 (1.0) 3.0652 (1.0) 0.0000 (1.0) 3.0652 (1.0) 0.0000 (1.0) 0;0 0.3262 (1.0) 1 1
test_status-status-noop[2.6.3] (0001_test_st) 4.3697 (1.43) 4.3697 (1.43) 4.3697 (1.43) 0.0000 (1.0) 4.3697 (1.43) 0.0000 (1.0) 0;0 0.2288 (0.70) 1 1
test_status-status-noop[2.9.5] (0001_test_st) 3.1505 (1.03) 3.1505 (1.03) 3.1505 (1.03) 0.0000 (1.0) 3.1505 (1.03) 0.0000 (1.0) 0;0 0.3174 (0.97) 1 1
test_status-status-noop[main] (0001_test_st) 6.1522 (2.01) 6.1522 (2.01) 6.1522 (2.01) 0.0000 (1.0) 6.1522 (2.01) 0.0000 (1.0) 0;0 0.1625 (0.50) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```