test

[gnufede]

Checklist

• [ ] Change(s) are motivated and described in the PR description
• [ ] Testing strategy is described if automated tests are not included in the PR
• [ ] Risks are described (performance impact, potential for breakage, maintainability)
• [ ] Change is maintainable (easy to change, telemetry, documentation)
• [ ] Library release note guidelines are followed or label changelog/no-changelog is set
• [ ] Documentation is included (in-code, generated user docs, public corp docs)
• [ ] Backport labels are set (if applicable)
• [ ] If this PR changes the public interface, I've notified @DataDog/apm-tees.

Reviewer Checklist

• [ ] Title is accurate
• [ ] All changes are related to the pull request's stated goal
• [ ] Description motivates each change
• [ ] Avoids breaking API changes
• [ ] Testing strategy adequately addresses listed risks
• [ ] Change is maintainable (easy to change, telemetry, documentation)
• [ ] Release note makes sense to a user of the library
• [ ] Author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
• [ ] Backport labels are set in a manner that is consistent with the release branch maintenance policy

[pr-commenter[bot]]

Benchmarks

Benchmark execution time: 2024-06-26 12:01:16

Comparing candidate commit 9f0b042b4b8b1a7a3ff4984cbf532b717320a467 in PR branch gnufede/fix-distlib-error-1 with baseline commit 9ef9b746f57e21567714533fdfaec1577c1c4453 in branch main.

Found 1 performance improvements and 89 performance regressions! Performance is the same for 131 metrics, 9 unstable metrics.

scenario:coreapiscenario-context_with_data_listeners

• 🟥 max_rss_usage [+2.428MB; +2.503MB] or [+11.729%; +12.094%]

scenario:coreapiscenario-context_with_data_listeners_and_all_listeners

• 🟥 max_rss_usage [+2.322MB; +2.395MB] or [+10.954%; +11.299%]

scenario:coreapiscenario-context_with_data_no_listeners

• 🟥 max_rss_usage [+2.298MB; +2.373MB] or [+10.494%; +10.836%]

scenario:coreapiscenario-context_with_data_only_all_listeners

• 🟥 max_rss_usage [+2.285MB; +2.363MB] or [+10.426%; +10.783%]

scenario:coreapiscenario-core_dispatch_listeners

• 🟥 max_rss_usage [+1.622MB; +1.702MB] or [+7.410%; +7.772%]

scenario:coreapiscenario-core_dispatch_listeners_and_all_listeners

• 🟥 max_rss_usage [+2.304MB; +2.376MB] or [+10.521%; +10.850%]

scenario:coreapiscenario-core_dispatch_no_listeners

• 🟥 max_rss_usage [+1.652MB; +1.726MB] or [+7.551%; +7.889%]

scenario:coreapiscenario-core_dispatch_only_all_listeners

• 🟥 max_rss_usage [+2.346MB; +2.409MB] or [+10.720%; +11.012%]

scenario:coreapiscenario-core_dispatch_with_results_listeners

• 🟥 max_rss_usage [+2.307MB; +2.372MB] or [+10.532%; +10.828%]

scenario:coreapiscenario-core_dispatch_with_results_listeners_and_all_listeners

• 🟥 max_rss_usage [+2.379MB; +2.444MB] or [+10.869%; +11.168%]

scenario:coreapiscenario-core_dispatch_with_results_no_listeners

• 🟥 max_rss_usage [+2.321MB; +2.394MB] or [+10.597%; +10.932%]

scenario:coreapiscenario-core_dispatch_with_results_only_all_listeners

• 🟥 max_rss_usage [+2.319MB; +2.385MB] or [+10.953%; +11.268%]

scenario:coreapiscenario-get_item_exists

• 🟥 max_rss_usage [+2.286MB; +2.353MB] or [+10.425%; +10.733%]

scenario:coreapiscenario-get_item_missing

• 🟥 max_rss_usage [+2.302MB; +2.374MB] or [+10.503%; +10.833%]

scenario:coreapiscenario-set_item

• 🟥 max_rss_usage [+2.838MB; +2.908MB] or [+13.691%; +14.026%]

scenario:httppropagationextract-all_styles_all_headers

• 🟥 max_rss_usage [+1.637MB; +1.712MB] or [+7.478%; +7.819%]

scenario:httppropagationextract-b3_headers

• 🟥 max_rss_usage [+3.623MB; +3.693MB] or [+17.605%; +17.945%]

scenario:httppropagationextract-b3_single_headers

• 🟥 max_rss_usage [+2.423MB; +2.513MB] or [+11.451%; +11.877%]

scenario:httppropagationextract-datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

• 🟥 max_rss_usage [+2.130MB; +2.284MB] or [+10.057%; +10.782%]

scenario:httppropagationextract-datadog_tracecontext_tracestate_propagated_on_trace_id_match

• 🟥 max_rss_usage [+3.022MB; +3.095MB] or [+14.253%; +14.594%]

scenario:httppropagationextract-empty_headers

• 🟥 max_rss_usage [+1.777MB; +2.113MB] or [+8.124%; +9.659%]

scenario:httppropagationextract-full_t_id_datadog_headers

• 🟥 max_rss_usage [+2.327MB; +2.404MB] or [+10.630%; +10.984%]

scenario:httppropagationextract-invalid_priority_header

• 🟥 max_rss_usage [+3.059MB; +3.120MB] or [+14.435%; +14.724%]

scenario:httppropagationextract-invalid_span_id_header

• 🟥 max_rss_usage [+1.804MB; +2.100MB] or [+8.244%; +9.598%]

scenario:httppropagationextract-invalid_trace_id_header

• 🟥 max_rss_usage [+2.254MB; +2.377MB] or [+10.655%; +11.235%]

scenario:httppropagationextract-large_header_no_matches

• 🟥 max_rss_usage [+1.732MB; +2.007MB] or [+7.922%; +9.178%]

scenario:httppropagationextract-large_valid_headers_all

• 🟥 max_rss_usage [+2.050MB; +2.332MB] or [+9.359%; +10.647%]

scenario:httppropagationextract-medium_header_no_matches

• 🟥 max_rss_usage [+2.060MB; +2.354MB] or [+9.434%; +10.780%]

scenario:httppropagationextract-medium_valid_headers_all

• 🟥 max_rss_usage [+2.120MB; +2.361MB] or [+9.680%; +10.779%]

scenario:httppropagationextract-tracecontext_headers

• 🟥 max_rss_usage [+2.319MB; +2.387MB] or [+10.934%; +11.259%]

scenario:httppropagationextract-valid_headers_all

• 🟥 max_rss_usage [+1.700MB; +1.781MB] or [+7.782%; +8.152%]

scenario:httppropagationextract-valid_headers_basic

• 🟥 max_rss_usage [+1.688MB; +1.838MB] or [+7.724%; +8.411%]

scenario:httppropagationextract-wsgi_empty_headers

• 🟥 max_rss_usage [+2.363MB; +2.436MB] or [+10.827%; +11.162%]

scenario:httppropagationextract-wsgi_invalid_priority_header

• 🟥 max_rss_usage [+1.668MB; +1.734MB] or [+7.624%; +7.923%]

scenario:httppropagationextract-wsgi_invalid_span_id_header

• 🟥 max_rss_usage [+3.055MB; +3.130MB] or [+14.431%; +14.787%]

scenario:httppropagationextract-wsgi_invalid_trace_id_header

• 🟥 max_rss_usage [+3.039MB; +3.109MB] or [+14.335%; +14.666%]

scenario:httppropagationextract-wsgi_large_header_no_matches

• 🟥 max_rss_usage [+2.346MB; +2.419MB] or [+10.719%; +11.052%]

scenario:httppropagationextract-wsgi_large_valid_headers_all

• 🟥 max_rss_usage [+2.584MB; +2.887MB] or [+12.190%; +13.620%]

scenario:httppropagationextract-wsgi_medium_header_no_matches

• 🟥 max_rss_usage [+2.362MB; +2.434MB] or [+10.800%; +11.129%]

scenario:httppropagationextract-wsgi_medium_valid_headers_all

• 🟥 max_rss_usage [+2.622MB; +2.935MB] or [+12.375%; +13.853%]

scenario:httppropagationextract-wsgi_valid_headers_all

• 🟥 max_rss_usage [+1.592MB; +1.792MB] or [+7.265%; +8.181%]

scenario:httppropagationextract-wsgi_valid_headers_basic

• 🟥 max_rss_usage [+3.060MB; +3.124MB] or [+14.455%; +14.756%]

scenario:httppropagationinject-ids_only

• 🟥 max_rss_usage [+2.304MB; +2.377MB] or [+10.522%; +10.855%]

scenario:httppropagationinject-with_all

• 🟥 max_rss_usage [+2.897MB; +3.124MB] or [+13.713%; +14.790%]

scenario:httppropagationinject-with_dd_origin

• 🟥 max_rss_usage [+2.708MB; +2.940MB] or [+12.714%; +13.805%]

scenario:httppropagationinject-with_priority_and_origin

• 🟥 max_rss_usage [+2.000MB; +2.424MB] or [+9.158%; +11.100%]

scenario:httppropagationinject-with_sampling_priority

• 🟥 max_rss_usage [+1.693MB; +1.928MB] or [+7.738%; +8.811%]

scenario:httppropagationinject-with_tags

• 🟥 max_rss_usage [+2.597MB; +3.051MB] or [+12.296%; +14.443%]

scenario:httppropagationinject-with_tags_invalid

• 🟥 max_rss_usage [+1.836MB; +2.180MB] or [+8.627%; +10.248%]

scenario:httppropagationinject-with_tags_max_size

• 🟥 max_rss_usage [+3.200MB; +3.401MB] or [+15.332%; +16.298%]

scenario:iastpropagation-no-propagation

• 🟥 max_rss_usage [+2.522MB; +2.586MB] or [+11.321%; +11.607%]

scenario:iastpropagation-propagation_enabled

• 🟥 max_rss_usage [+2.373MB; +2.450MB] or [+10.121%; +10.448%]

scenario:iastpropagation-propagation_enabled_100

• 🟥 max_rss_usage [+2.402MB; +2.472MB] or [+10.702%; +11.012%]

scenario:iastpropagation-propagation_enabled_1000

• 🟥 max_rss_usage [+2.350MB; +2.417MB] or [+10.456%; +10.753%]

scenario:otelspan-start-finish

• 🟥 max_rss_usage [+2.098MB; +2.172MB] or [+9.353%; +9.682%]

scenario:otelspan-start-finish-telemetry

• 🟥 max_rss_usage [+2.262MB; +2.553MB] or [+9.841%; +11.107%]

scenario:ratelimiter-defaults

• 🟥 max_rss_usage [+2.420MB; +2.691MB] or [+11.402%; +12.676%]

scenario:ratelimiter-high_rate_limit

• 🟥 max_rss_usage [+3.322MB; +3.519MB] or [+15.728%; +16.661%]

scenario:ratelimiter-long_window

• 🟥 max_rss_usage [+1.794MB; +2.023MB] or [+8.159%; +9.200%]

scenario:ratelimiter-low_rate_limit

• 🟥 max_rss_usage [+3.125MB; +3.404MB] or [+14.682%; +15.990%]

scenario:ratelimiter-no_rate_limit

• 🟥 max_rss_usage [+1.802MB; +2.012MB] or [+8.177%; +9.133%]

scenario:ratelimiter-short_window

• 🟥 max_rss_usage [+2.415MB; +2.715MB] or [+11.366%; +12.781%]

scenario:samplingrules-average_match

• 🟥 max_rss_usage [+3.007MB; +3.115MB] or [+14.182%; +14.690%]

scenario:samplingrules-high_match

• 🟥 max_rss_usage [+2.970MB; +3.082MB] or [+14.015%; +14.541%]

scenario:samplingrules-low_match

• 🟥 max_rss_usage [+2.585MB; +2.913MB] or [+9.333%; +10.518%]

scenario:samplingrules-very_low_match

• 🟥 max_rss_usage [+1.977MB; +2.453MB] or [+7.992%; +9.915%]

scenario:sethttpmeta-all-disabled

• 🟥 max_rss_usage [+2.431MB; +2.713MB] or [+11.426%; +12.749%]

scenario:sethttpmeta-all-enabled

• 🟥 max_rss_usage [+2.303MB; +2.659MB] or [+10.797%; +12.466%]

scenario:sethttpmeta-collectipvariant_exists

• 🟥 max_rss_usage [+2.245MB; +2.412MB] or [+10.093%; +10.845%]

scenario:sethttpmeta-no-collectipvariant

• 🟥 max_rss_usage [+2.966MB; +3.116MB] or [+13.779%; +14.473%]

scenario:sethttpmeta-no-useragentvariant

• 🟥 max_rss_usage [+2.326MB; +2.399MB] or [+10.476%; +10.806%]

scenario:sethttpmeta-obfuscation-disabled

• 🟥 max_rss_usage [+2.830MB; +3.099MB] or [+13.074%; +14.319%]

scenario:sethttpmeta-obfuscation-no-query

• 🟥 max_rss_usage [+2.883MB; +3.108MB] or [+13.365%; +14.408%]

scenario:sethttpmeta-obfuscation-regular-case-explicit-query

• 🟥 max_rss_usage [+2.279MB; +2.347MB] or [+10.497%; +10.812%]

scenario:sethttpmeta-obfuscation-regular-case-implicit-query

• 🟥 max_rss_usage [+2.921MB; +3.134MB] or [+13.419%; +14.402%]

scenario:sethttpmeta-obfuscation-send-querystring-disabled

• 🟥 max_rss_usage [+2.371MB; +2.439MB] or [+10.585%; +10.886%]

scenario:sethttpmeta-obfuscation-worst-case-implicit-query

• 🟥 max_rss_usage [+2.325MB; +2.394MB] or [+10.373%; +10.684%]

scenario:sethttpmeta-useragentvariant_exists_1

• 🟥 max_rss_usage [+2.095MB; +2.339MB] or [+9.685%; +10.813%]

scenario:sethttpmeta-useragentvariant_exists_2

• 🟥 max_rss_usage [+1.621MB; +1.693MB] or [+7.298%; +7.620%]

scenario:sethttpmeta-useragentvariant_exists_3

• 🟥 max_rss_usage [+1.608MB; +1.677MB] or [+7.234%; +7.546%]

scenario:sethttpmeta-useragentvariant_not_exists_1

• 🟥 max_rss_usage [+2.281MB; +2.570MB] or [+10.306%; +11.612%]

scenario:sethttpmeta-useragentvariant_not_exists_2

• 🟥 max_rss_usage [+3.013MB; +3.091MB] or [+14.011%; +14.373%]

scenario:span-add-metrics

• 🟩 max_rss_usage [-6.908MB; -6.834MB] or [-10.578%; -10.466%]

scenario:span-add-tags

• 🟥 max_rss_usage [+5.366MB; +5.434MB] or [+17.341%; +17.561%]

scenario:span-start-finish

• 🟥 max_rss_usage [+2.287MB; +2.438MB] or [+10.390%; +11.076%]

scenario:span-start-finish-telemetry

• 🟥 max_rss_usage [+2.345MB; +2.547MB] or [+10.635%; +11.548%]

scenario:span-start-finish-traceid128

• 🟥 max_rss_usage [+2.365MB; +2.539MB] or [+10.760%; +11.550%]

scenario:tracer-large

• 🟥 max_rss_usage [+2.355MB; +2.460MB] or [+10.163%; +10.614%]

scenario:tracer-medium

• 🟥 max_rss_usage [+1.671MB; +1.806MB] or [+7.625%; +8.241%]

scenario:tracer-small

• 🟥 max_rss_usage [+2.257MB; +2.413MB] or [+10.258%; +10.968%]

[datadog-dd-trace-py-rkomorn[bot]]

Datadog Report

Branch report: gnufede/fix-distlib-error-1 Commit report: 9f0b042 Test service: dd-trace-py

:x: 15 Failed (0 Known Flaky), 117228 Passed, 58553 Skipped, 4h 1m 32.34s Total duration (5h 35m 34.8s time saved)

:x: Failed Tests (15)

This report shows up to 5 failed tests.

• test_full_command_in_resource_env - test_aredis.py - Details

<details>
<summary>Expand for error</summary>

```
STDERR: Expected [] got [b'/root/project/.riot/venv_py3716/lib/python3.7/site-packages/_distutils_hack/__init__.py:33: UserWarning: Setuptools is replacing distutils.\n  warnings.warn("Setuptools is replacing distutils.")\n']
```
</details>

• test_on_executor_custom_kwarg - test_executor_decorator.py - Details

  Expand for error

  ``` assert 'tornado-web' == None + where None = .service ```

• test_on_executor_custom_kwarg - test_executor_decorator.py - Details

  Expand for error

  ``` assert 'tornado-web' == None + where None = .service ```

• test_on_executor_exception_handler - test_executor_decorator.py - Details

  Expand for error

  ``` assert 'tornado-web' == None + where None = .service ```

• test_on_executor_exception_handler - test_executor_decorator.py - Details

  Expand for error

  ``` assert 'tornado-web' == None + where None = .service ```