Closed gnufede closed 3 months ago
Benchmark execution time: 2024-06-25 18:58:39
Comparing candidate commit eeb10bef0d933bcd5c55b7a85a782a151b0ced0c in PR branch gnufede/fix-distlib-error
with baseline commit 9ef9b746f57e21567714533fdfaec1577c1c4453 in branch main
.
Found 1 performance improvements and 89 performance regressions! Performance is the same for 131 metrics, 9 unstable metrics.
max_rss_usage
[+2.432MB; +2.505MB] or [+11.752%; +12.105%]max_rss_usage
[+2.335MB; +2.406MB] or [+11.006%; +11.344%]max_rss_usage
[+2.272MB; +2.346MB] or [+10.362%; +10.699%]max_rss_usage
[+2.281MB; +2.349MB] or [+10.412%; +10.722%]max_rss_usage
[+1.664MB; +1.730MB] or [+7.603%; +7.906%]max_rss_usage
[+2.273MB; +2.344MB] or [+10.376%; +10.702%]max_rss_usage
[+1.638MB; +1.716MB] or [+7.489%; +7.846%]max_rss_usage
[+2.300MB; +2.375MB] or [+10.502%; +10.845%]max_rss_usage
[+2.333MB; +2.410MB] or [+10.665%; +11.017%]max_rss_usage
[+2.381MB; +2.448MB] or [+10.885%; +11.194%]max_rss_usage
[+2.360MB; +2.433MB] or [+10.791%; +11.125%]max_rss_usage
[+2.341MB; +2.402MB] or [+11.044%; +11.332%]max_rss_usage
[+2.275MB; +2.343MB] or [+10.376%; +10.689%]max_rss_usage
[+2.257MB; +2.326MB] or [+10.295%; +10.609%]max_rss_usage
[+2.825MB; +2.889MB] or [+13.618%; +13.931%]max_rss_usage
[+1.643MB; +1.714MB] or [+7.514%; +7.840%]max_rss_usage
[+3.617MB; +3.697MB] or [+17.562%; +17.954%]max_rss_usage
[+2.369MB; +2.468MB] or [+11.172%; +11.639%]max_rss_usage
[+2.155MB; +2.283MB] or [+10.173%; +10.779%]max_rss_usage
[+3.022MB; +3.089MB] or [+14.258%; +14.574%]max_rss_usage
[+2.659MB; +2.987MB] or [+12.566%; +14.113%]max_rss_usage
[+2.334MB; +2.403MB] or [+10.657%; +10.969%]max_rss_usage
[+3.032MB; +3.102MB] or [+14.306%; +14.635%]max_rss_usage
[+1.870MB; +2.182MB] or [+8.534%; +9.958%]max_rss_usage
[+2.254MB; +2.366MB] or [+10.649%; +11.180%]max_rss_usage
[+1.975MB; +2.283MB] or [+9.034%; +10.443%]max_rss_usage
[+1.849MB; +2.172MB] or [+8.439%; +9.915%]max_rss_usage
[+1.767MB; +2.033MB] or [+8.089%; +9.308%]max_rss_usage
[+1.989MB; +2.292MB] or [+9.085%; +10.469%]max_rss_usage
[+2.325MB; +2.400MB] or [+10.968%; +11.322%]max_rss_usage
[+1.698MB; +1.773MB] or [+7.778%; +8.120%]max_rss_usage
[+2.120MB; +2.351MB] or [+9.704%; +10.761%]max_rss_usage
[+1.789MB; +2.082MB] or [+8.187%; +9.529%]max_rss_usage
[+1.611MB; +1.665MB] or [+7.351%; +7.602%]max_rss_usage
[+3.066MB; +3.128MB] or [+14.476%; +14.771%]max_rss_usage
[+3.014MB; +3.079MB] or [+14.207%; +14.513%]max_rss_usage
[+2.347MB; +2.419MB] or [+10.722%; +11.052%]max_rss_usage
[+2.737MB; +3.031MB] or [+12.915%; +14.301%]max_rss_usage
[+2.365MB; +2.431MB] or [+10.809%; +11.110%]max_rss_usage
[+2.659MB; +2.970MB] or [+12.553%; +14.021%]max_rss_usage
[+1.788MB; +2.120MB] or [+8.157%; +9.671%]max_rss_usage
[+3.030MB; +3.095MB] or [+14.300%; +14.607%]max_rss_usage
[+2.281MB; +2.349MB] or [+10.405%; +10.717%]max_rss_usage
[+2.826MB; +3.107MB] or [+13.352%; +14.681%]max_rss_usage
[+2.832MB; +2.992MB] or [+13.311%; +14.063%]max_rss_usage
[+2.013MB; +2.355MB] or [+9.207%; +10.771%]max_rss_usage
[+1.733MB; +2.018MB] or [+7.922%; +9.226%]max_rss_usage
[+2.779MB; +3.113MB] or [+13.148%; +14.725%]max_rss_usage
[+1.958MB; +2.410MB] or [+9.204%; +11.329%]max_rss_usage
[+3.266MB; +3.427MB] or [+15.658%; +16.427%]max_rss_usage
[+2.530MB; +2.602MB] or [+11.347%; +11.673%]max_rss_usage
[+2.339MB; +2.401MB] or [+9.957%; +10.222%]max_rss_usage
[+2.335MB; +2.407MB] or [+10.398%; +10.716%]max_rss_usage
[+2.338MB; +2.408MB] or [+10.403%; +10.717%]max_rss_usage
[+2.081MB; +2.158MB] or [+9.277%; +9.622%]max_rss_usage
[+2.167MB; +2.500MB] or [+9.403%; +10.845%]max_rss_usage
[+2.453MB; +2.728MB] or [+11.571%; +12.864%]max_rss_usage
[+3.262MB; +3.498MB] or [+15.403%; +16.516%]max_rss_usage
[+1.791MB; +2.017MB] or [+8.140%; +9.171%]max_rss_usage
[+3.081MB; +3.397MB] or [+14.455%; +15.937%]max_rss_usage
[+1.749MB; +1.932MB] or [+7.937%; +8.767%]max_rss_usage
[+2.450MB; +2.744MB] or [+11.556%; +12.941%]max_rss_usage
[+2.987MB; +3.056MB] or [+14.073%; +14.397%]max_rss_usage
[+2.980MB; +3.050MB] or [+14.046%; +14.377%]max_rss_usage
[+2.392MB; +2.755MB] or [+8.607%; +9.911%]max_rss_usage
[+2.194MB; +2.688MB] or [+8.895%; +10.895%]max_rss_usage
[+2.401MB; +2.695MB] or [+11.277%; +12.655%]max_rss_usage
[+2.427MB; +2.738MB] or [+11.409%; +12.873%]max_rss_usage
[+2.171MB; +2.382MB] or [+9.749%; +10.696%]max_rss_usage
[+2.773MB; +3.058MB] or [+12.841%; +14.159%]max_rss_usage
[+2.359MB; +2.429MB] or [+10.626%; +10.943%]max_rss_usage
[+2.980MB; +3.148MB] or [+13.818%; +14.597%]max_rss_usage
[+2.936MB; +3.084MB] or [+13.633%; +14.319%]max_rss_usage
[+2.284MB; +2.358MB] or [+10.528%; +10.867%]max_rss_usage
[+2.988MB; +3.131MB] or [+13.746%; +14.405%]max_rss_usage
[+2.317MB; +2.389MB] or [+10.332%; +10.655%]max_rss_usage
[+2.349MB; +2.422MB] or [+10.485%; +10.811%]max_rss_usage
[+2.103MB; +2.352MB] or [+9.725%; +10.879%]max_rss_usage
[+1.621MB; +1.693MB] or [+7.292%; +7.619%]max_rss_usage
[+1.598MB; +1.675MB] or [+7.191%; +7.540%]max_rss_usage
[+2.371MB; +2.746MB] or [+10.771%; +12.474%]max_rss_usage
[+3.031MB; +3.100MB] or [+14.095%; +14.416%]max_rss_usage
[-6.922MB; -6.849MB] or [-10.600%; -10.487%]max_rss_usage
[+5.347MB; +5.418MB] or [+17.272%; +17.502%]max_rss_usage
[+2.346MB; +2.599MB] or [+10.702%; +11.857%]max_rss_usage
[+2.345MB; +2.457MB] or [+10.600%; +11.103%]max_rss_usage
[+2.364MB; +2.600MB] or [+10.787%; +11.866%]max_rss_usage
[+2.317MB; +2.425MB] or [+9.989%; +10.455%]max_rss_usage
[+1.647MB; +1.753MB] or [+7.505%; +7.986%]max_rss_usage
[+2.229MB; +2.340MB] or [+10.125%; +10.629%]Branch report: gnufede/fix-distlib-error
Commit report: eeb10be
Test service: dd-trace-py
:x: 15 Failed (0 Known Flaky), 147590 Passed, 28120 Skipped, 9h 12m 33.67s Total duration (1h 32m 3.18s time saved)
This report shows up to 5 failed tests.
test_full_command_in_resource_env
-test_aredis.py
- Details
<details>
<summary>Expand for error</summary>
```
STDERR: Expected [] got [b'/root/project/.riot/venv_py3716/lib/python3.7/site-packages/_distutils_hack/__init__.py:33: UserWarning: Setuptools is replacing distutils.\n warnings.warn("Setuptools is replacing distutils.")\n']
```
</details>
test_on_executor_custom_kwarg
- test_executor_decorator.py
- Details
test_on_executor_custom_kwarg
- test_executor_decorator.py
- Details
test_on_executor_exception_handler
- test_executor_decorator.py
- Details
test_on_executor_exception_handler
- test_executor_decorator.py
- Details
Closing in favor of https://github.com/DataDog/dd-trace-py/pull/9638
Framework tests are failing since the last release of
pip
. To fix it we have to register a finder for_ImportHookChainedLoader
.Example failure: https://github.com/DataDog/dd-trace-py/actions/runs/9665168085/job/26661659706#step:9:153 With this PR: https://github.com/DataDog/dd-trace-py/actions/runs/9664970633/job/26661010743
Checklist
changelog/no-changelog
is set@DataDog/apm-tees
.Reviewer Checklist