Open andrewlock opened 1 month ago
Branch report: andrew/ci/smoke-tests-for-glibc-alpine
Commit report: 6963e0b
Test service: dd-trace-dotnet
:white_check_mark: 0 Failed, 361563 Passed, 2058 Skipped, 14h 32m 38.54s Total Time
Execution-time results for samples comparing the following branches/commits:
Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.
Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).
Throughput results for AspNetCoreSimpleController comparing the following branches/commits:
Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.
Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!
gantt
title Throughput Linux x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5967) (11.078M) : 0, 11077691
master (11.247M) : 0, 11246521
benchmarks/2.9.0 (11.120M) : 0, 11120231
section Automatic
This PR (5967) (7.414M) : 0, 7413566
master (7.508M) : 0, 7508439
benchmarks/2.9.0 (7.874M) : 0, 7874046
section Trace stats
master (7.707M) : 0, 7707332
section Manual
master (11.233M) : 0, 11232811
section Manual + Automatic
This PR (5967) (6.894M) : 0, 6894130
master (6.892M) : 0, 6891553
section DD_TRACE_ENABLED=0
master (10.225M) : 0, 10225326
gantt
title Throughput Linux arm64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5967) (9.396M) : 0, 9395569
benchmarks/2.9.0 (9.342M) : 0, 9341974
section Automatic
This PR (5967) (6.675M) : 0, 6675143
section Manual + Automatic
This PR (5967) (6.134M) : 0, 6134399
gantt
title Throughput Windows x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5967) (10.145M) : 0, 10144886
master (10.060M) : 0, 10059520
benchmarks/2.9.0 (10.105M) : 0, 10105239
section Automatic
This PR (5967) (6.920M) : 0, 6919964
master (6.690M) : 0, 6690107
benchmarks/2.9.0 (7.518M) : 0, 7517801
section Trace stats
master (7.324M) : 0, 7324117
section Manual
master (10.131M) : 0, 10131126
section Manual + Automatic
This PR (5967) (6.259M) : 0, 6258969
master (6.279M) : 0, 6279338
section DD_TRACE_ENABLED=0
master (9.441M) : 0, 9441325
Benchmarks for #5967 compared to master:
The following thresholds were used for comparing the benchmark speeds:
Allocation changes below 0.5% are ignored.
Summary of changes
Runs additional installer tests for alpine where the glibc compatibility package is installed
Reason for change
It's possible to run glibc libraries on alpine if you use the compatibility layer. We don't need these and generally won't "notice" they're there, but we should check that it doesn't cause any issues for us
Implementation details
Add additional smokes tests that add the compatibility package to the alpine container
Test coverage
Just added a few smoke tests, to make sure we don't hit any obvious issues
Other details
Will also backport these to v2