[Serverless Mini Agent] Add Span Tags for Azure Spring Apps

Benchmarks

Comparison

Benchmark execution time: 2024-10-15 14:19:40

Comparing candidate commit 6eb5dd1 in PR branch duncan-harvey/serverless-spring-span-tags with baseline commit e83d9d4 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.637µs|2.703µs ± 0.020µs|2.705µs ± 0.007µs|2.711µs|2.737µs|2.746µs|2.752µs|1.77% |-1.067 |2.977 |0.74%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.700µs; 2.706µs] or [-0.102%; +0.102%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|36.405µs|36.964µs ± 0.862µs|36.611µs ± 0.058µs|36.659µs|38.810µs|38.850µs|39.812µs|8.74% |1.713 |1.094 |2.32%|0.061µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[36.844µs; 37.083µs] or [-0.323%; +0.323%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|----------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|-------------|----|-----------| |credit_card/is_card_number/ |execution_time|1.613µs |1.614µs ± 0.001µs |1.614µs ± 0.000µs |1.615µs |1.615µs |1.616µs |1.616µs |0.11% |0.737 |-0.272 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number/ |throughput |618853847.916op/s|619518836.197op/s ± 230225.719op/s|619556445.185op/s ± 168336.400op/s|619721372.431op/s|619777321.391op/s|619823277.083op/s|619837521.738op/s|0.05% |-0.736 |-0.275 |0.04%|16279.417op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|110.355µs |112.378µs ± 0.662µs |112.370µs ± 0.461µs |112.843µs |113.330µs |113.831µs |114.609µs |1.99% |-0.071 |0.500 |0.59%|0.047µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |8725350.400op/s |8898859.807op/s ± 52459.176op/s |8899194.829op/s ± 36362.915op/s |8931190.352op/s |8992399.933op/s |9017529.157op/s |9061681.051op/s |1.83% |0.115 |0.481 |0.59%|3709.424op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|106.519µs |107.781µs ± 0.917µs |107.525µs ± 0.624µs |108.380µs |109.437µs |110.327µs |110.823µs |3.07% |0.923 |0.456 |0.85%|0.065µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |9023431.815op/s |9278706.007op/s ± 78352.052op/s |9300124.622op/s ± 54326.711op/s |9340738.901op/s |9376384.625op/s |9383047.908op/s |9387962.391op/s |0.94% |-0.883 |0.339 |0.84%|5540.327op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|1.613µs |1.614µs ± 0.001µs |1.614µs ± 0.000µs |1.615µs |1.616µs |1.616µs |1.626µs |0.71% |6.377 |60.523 |0.07%|0.000µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |615171503.381op/s|619466036.242op/s ± 410643.064op/s|619536063.911op/s ± 159420.957op/s|619695897.943op/s|619774354.922op/s|619817985.029op/s|619867100.734op/s|0.05% |-6.334 |59.888 |0.07%|29036.850op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|101.694µs |103.402µs ± 0.404µs |103.416µs ± 0.221µs |103.630µs |104.040µs |104.438µs |104.729µs |1.27% |-0.337 |1.928 |0.39%|0.029µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |9548435.769op/s |9671182.768op/s ± 37818.972op/s |9669697.110op/s ± 20685.238op/s |9690866.360op/s |9744721.598op/s |9765561.560op/s |9833458.718op/s |1.69% |0.382 |1.989 |0.39%|2674.205op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|106.321µs |108.389µs ± 0.761µs |108.479µs ± 0.506µs |108.895µs |109.478µs |110.067µs |110.567µs |1.93% |-0.326 |0.243 |0.70%|0.054µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |9044291.685op/s |9226517.924op/s ± 64901.766op/s |9218399.747op/s ± 43208.840op/s |9268948.854op/s |9347737.104op/s |9391814.468op/s |9405451.441op/s |2.03% |0.371 |0.264 |0.70%|4589.248op/s |1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|23.264µs |24.857µs ± 0.634µs |24.887µs ± 0.466µs |25.328µs |25.894µs |26.202µs |26.457µs |6.30% |-0.056 |-0.429 |2.54%|0.045µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |37797778.286op/s |40256310.354op/s ± 1029032.979op/s|40180889.414op/s ± 739927.044op/s |40977615.011op/s |41970302.559op/s |42668699.325op/s |42984850.803op/s |6.98% |0.175 |-0.397 |2.55%|72763.620op/s|1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|1.613µs |1.614µs ± 0.001µs |1.614µs ± 0.000µs |1.614µs |1.615µs |1.616µs |1.617µs |0.18% |1.244 |1.950 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |618512099.069op/s|619543614.152op/s ± 232403.418op/s|619596932.995op/s ± 143126.062op/s|619724363.189op/s|619808884.892op/s|619844296.753op/s|619926825.422op/s|0.05% |-1.241 |1.938 |0.04%|16433.403op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|89.594µs |90.574µs ± 0.225µs |90.596µs ± 0.100µs |90.698µs |90.880µs |90.943µs |91.010µs |0.46% |-1.296 |2.710 |0.25%|0.016µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |10987802.450op/s |11040809.830op/s ± 27573.365op/s |11037992.972op/s ± 12223.463op/s |11049780.958op/s |11095610.191op/s |11115054.216op/s |11161429.158op/s |1.12% |1.319 |2.791 |0.25%|1949.731op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|83.585µs |84.450µs ± 0.628µs |84.275µs ± 0.253µs |84.592µs |85.770µs |86.584µs |87.873µs |4.27% |2.084 |5.539 |0.74%|0.044µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |11380122.417op/s |11841930.261op/s ± 86684.541op/s |11865895.471op/s ± 35637.233op/s |11900063.773op/s |11923009.450op/s |11939063.478op/s |11963841.216op/s |0.83% |-2.015 |5.101 |0.73%|6129.523op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|1.613µs |1.614µs ± 0.000µs |1.614µs ± 0.000µs |1.614µs |1.615µs |1.615µs |1.615µs |0.08% |0.151 |-0.361 |0.03%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |619026843.046op/s|619541768.001op/s ± 174506.688op/s|619506857.144op/s ± 140513.097op/s|619700143.543op/s|619801568.768op/s|619835785.548op/s|620024841.021op/s|0.08% |-0.149 |-0.363 |0.03%|12339.486op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|79.074µs |79.899µs ± 0.553µs |79.741µs ± 0.298µs |80.119µs |80.915µs |81.835µs |81.984µs |2.81% |1.246 |1.701 |0.69%|0.039µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |12197485.288op/s |12516325.419op/s ± 85966.466op/s |12540558.046op/s ± 46706.496op/s |12573503.135op/s |12620739.013op/s |12634792.959op/s |12646337.090op/s |0.84% |-1.203 |1.548 |0.69%|6078.747op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|106.808µs |108.532µs ± 0.695µs |108.600µs ± 0.452µs |108.957µs |109.629µs |110.394µs |110.661µs |1.90% |-0.067 |0.315 |0.64%|0.049µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |9036582.170op/s |9214210.455op/s ± 59048.147op/s |9208076.597op/s ± 38175.819op/s |9253815.068op/s |9317975.999op/s |9357465.258op/s |9362582.040op/s |1.68% |0.111 |0.296 |0.64%|4175.335op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|23.568µs |24.933µs ± 0.511µs |24.948µs ± 0.328µs |25.269µs |25.736µs |25.956µs |26.240µs |5.18% |-0.153 |-0.212 |2.05%|0.036µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |38109291.350op/s |40123831.547op/s ± 826576.580op/s |40083754.213op/s ± 527472.696op/s |40615727.243op/s |41582814.888op/s |42023107.083op/s |42430571.651op/s |5.85% |0.261 |-0.174 |2.05%|58447.791op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[1.614µs; 1.614µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number/ |throughput |[619486929.127op/s; 619550743.268op/s] or [-0.005%; +0.005%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[112.286µs; 112.470µs] or [-0.082%; +0.082%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[8891589.470op/s; 8906130.145op/s] or [-0.082%; +0.082%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[107.654µs; 107.908µs] or [-0.118%; +0.118%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[9267847.166op/s; 9289564.848op/s] or [-0.117%; +0.117%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[1.614µs; 1.614µs] or [-0.009%; +0.009%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[619409125.063op/s; 619522947.421op/s] or [-0.009%; +0.009%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[103.346µs; 103.458µs] or [-0.054%; +0.054%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[9665941.423op/s; 9676424.114op/s] or [-0.054%; +0.054%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[108.283µs; 108.494µs] or [-0.097%; +0.097%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[9217523.164op/s; 9235512.685op/s] or [-0.097%; +0.097%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[24.769µs; 24.945µs] or [-0.353%; +0.353%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[40113696.280op/s; 40398924.428op/s] or [-0.354%; +0.354%] |None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[1.614µs; 1.614µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[619511405.274op/s; 619575823.031op/s] or [-0.005%; +0.005%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[90.542µs; 90.605µs] or [-0.034%; +0.034%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[11036988.427op/s; 11044631.233op/s] or [-0.035%; +0.035%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[84.363µs; 84.537µs] or [-0.103%; +0.103%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[11829916.617op/s; 11853943.904op/s] or [-0.101%; +0.101%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[1.614µs; 1.614µs] or [-0.004%; +0.004%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[619517583.052op/s; 619565952.949op/s] or [-0.004%; +0.004%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[79.823µs; 79.976µs] or [-0.096%; +0.096%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[12504411.293op/s; 12528239.544op/s] or [-0.095%; +0.095%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[108.436µs; 108.629µs] or [-0.089%; +0.089%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[9206026.950op/s; 9222393.960op/s] or [-0.089%; +0.089%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[24.862µs; 25.004µs] or [-0.284%; +0.284%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[40009275.983op/s; 40238387.112op/s] or [-0.286%; +0.286%] |None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|9.253ms|9.288ms ± 0.027ms|9.284ms ± 0.010ms|9.295ms|9.313ms|9.355ms|9.520ms|2.54% |5.565 |43.164 |0.29%|0.002ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[9.284ms; 9.291ms] or [-0.040%; +0.040%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|1.137µs|1.193µs ± 0.023µs|1.194µs ± 0.016µs|1.213µs|1.217µs|1.219µs|1.220µs|2.18% |-0.953 |0.136 |1.89%|0.002µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[1.190µs; 1.196µs] or [-0.263%; +0.263%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|---------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|187.558µs |190.720µs ± 1.176µs |190.731µs ± 0.819µs |191.534µs |192.504µs |193.355µs |194.793µs |2.13% |-0.004 |0.308 |0.61%|0.083µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |5133642.216op/s |5243490.941op/s ± 32329.452op/s |5242975.350op/s ± 22478.946op/s |5265811.592op/s |5298007.250op/s |5320889.974op/s |5331676.585op/s |1.69% |0.046 |0.285 |0.62%|2286.037op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|18.141µs |18.177µs ± 0.024µs |18.185µs ± 0.023µs |18.198µs |18.209µs |18.232µs |18.257µs |0.39% |0.221 |-0.963 |0.13%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |54774096.309op/s|55014138.643op/s ± 72198.168op/s |54989261.950op/s ± 69940.647op/s |55087242.670op/s|55100939.084op/s|55111585.293op/s|55125066.162op/s|0.25% |-0.217 |-0.975 |0.13%|5105.181op/s |1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|11.242µs |11.281µs ± 0.031µs |11.273µs ± 0.014µs |11.298µs |11.319µs |11.391µs |11.519µs |2.18% |3.198 |18.799 |0.27%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |86810147.564op/s|88646305.208op/s ± 238633.771op/s|88706609.131op/s ± 108822.098op/s|88795129.865op/s|88885151.393op/s|88925820.964op/s|88954369.188op/s|0.28% |-3.113 |17.931 |0.27%|16873.956op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[190.557µs; 190.883µs] or [-0.085%; +0.085%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[5239010.390op/s; 5247971.493op/s] or [-0.085%; +0.085%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[18.174µs; 18.180µs] or [-0.018%; +0.018%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[55004132.671op/s; 55024144.614op/s] or [-0.018%; +0.018%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[11.277µs; 11.285µs] or [-0.038%; +0.038%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[88613232.862op/s; 88679377.554op/s] or [-0.037%; +0.037%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|256.762ns|272.072ns ± 16.815ns|262.808ns ± 5.058ns|282.481ns|303.354ns|322.489ns|323.856ns|23.23% |1.301 |0.954 |6.16%|1.189ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[269.741ns; 274.402ns] or [-0.857%; +0.857%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.398µs|3.193µs ± 1.409µs|3.042µs ± 0.023µs|3.062µs|3.163µs|13.896µs|14.926µs|390.73% |7.610 |57.954 |44.00%|0.100µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[2.998µs; 3.389µs] or [-6.113%; +6.113%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|141.172µs|141.964µs ± 0.522µs|141.890µs ± 0.148µs|142.037µs|142.664µs|143.339µs|146.973µs|3.58% |5.199 |43.022 |0.37%|0.037µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[141.891µs; 142.036µs] or [-0.051%; +0.051%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|622.675µs |624.577µs ± 0.386µs |624.606µs ± 0.259µs |624.833µs |625.132µs |625.361µs |625.557µs |0.15% |-0.896 |3.398 |0.06%|0.027µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1598574.802op/s |1601085.090op/s ± 990.030op/s |1601008.819op/s ± 664.791op/s |1601753.783op/s |1602446.845op/s |1603895.477op/s |1605974.040op/s |0.31% |0.904 |3.434 |0.06%|70.006op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|460.770µs |461.667µs ± 0.426µs |461.622µs ± 0.276µs |461.944µs |462.473µs |462.833µs |463.117µs |0.32% |0.536 |0.242 |0.09%|0.030µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2159283.527op/s |2166067.092op/s ± 1997.937op/s |2166274.324op/s ± 1294.075op/s |2167490.242op/s |2169082.603op/s |2169590.743op/s |2170279.192op/s |0.18% |-0.530 |0.233 |0.09%|141.275op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|178.218µs |178.376µs ± 0.117µs |178.362µs ± 0.054µs |178.420µs |178.547µs |178.945µs |179.070µs |0.40% |2.449 |10.395 |0.07%|0.008µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5584396.923op/s |5606142.596op/s ± 3683.951op/s |5606574.242op/s ± 1701.001op/s |5608185.873op/s |5610467.474op/s |5611024.640op/s |5611098.589op/s |0.08% |-2.436 |10.311 |0.07%|260.495op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|46.666µs |46.811µs ± 0.060µs |46.810µs ± 0.041µs |46.853µs |46.911µs |46.953µs |47.021µs |0.45% |0.169 |0.222 |0.13%|0.004µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |21267013.234op/s|21362525.437op/s ± 27501.849op/s |21362783.471op/s ± 18565.397op/s|21381306.718op/s|21403585.837op/s|21423629.832op/s|21428887.326op/s|0.31% |-0.160 |0.213 |0.13%|1944.674op/s|1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|49.088µs |49.800µs ± 0.334µs |49.719µs ± 0.220µs |50.060µs |50.405µs |50.570µs |50.681µs |1.93% |0.478 |-0.542 |0.67%|0.024µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |19731427.736op/s|20081034.474op/s ± 134334.217op/s|20113026.224op/s ± 89349.989op/s|20189535.136op/s|20263361.927op/s|20313496.119op/s|20371587.226op/s|1.29% |-0.453 |-0.565 |0.67%|9498.864op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[624.523µs; 624.630µs] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1600947.882op/s; 1601222.299op/s] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[461.608µs; 461.726µs] or [-0.013%; +0.013%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2165790.197op/s; 2166343.987op/s] or [-0.013%; +0.013%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[178.360µs; 178.392µs] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5605632.036op/s; 5606653.157op/s] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[46.803µs; 46.819µs] or [-0.018%; +0.018%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[21358713.945op/s; 21366336.929op/s] or [-0.018%; +0.018%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[49.754µs; 49.847µs] or [-0.093%; +0.093%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[20062417.044op/s; 20099651.904op/s] or [-0.093%; +0.093%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|---------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|18.573µs|25.041µs ± 11.072µs|19.641µs ± 0.224µs|21.738µs|46.054µs|49.781µs|101.960µs|419.11% |2.867 |12.560 |44.10%|0.783µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[23.507µs; 26.576µs] or [-6.128%; +6.128%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-----------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|6eb5dd1 |1729001348 |duncan-harvey/serverless-spring-span-tags| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|66.897µs|67.010µs ± 0.153µs|66.988µs ± 0.031µs|67.019µs|67.127µs|67.451µs|68.839µs|2.76% |9.174 |103.159 |0.23%|0.011µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[66.989µs; 67.031µs] or [-0.032%; +0.032%]|None |None |None |

Baseline

Omitted due to size.

DataDog / libdatadog