Fix telemetry metric name

Benchmarks

Comparison

Benchmark execution time: 2024-10-07 12:44:20

Comparing candidate commit aa73aff in PR branch vianney/sidecar/fix-telemetry-name with baseline commit 67d4f7a in branch main.

Found 1 performance improvements and 1 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:concentrator/add_spans_to_concentrator

🟥 execution_time [+392.153µs; +401.526µs] or [+2.827%; +2.895%]

scenario:tags/replace_trace_tags

🟩 execution_time [-141.824ns; -134.005ns] or [-2.666%; -2.519%]

Candidate

Candidate benchmark details

### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|112.687µs|113.024µs ± 0.154µs|113.012µs ± 0.043µs|113.054µs|113.142µs|113.220µs|114.857µs|1.63% |8.614 |98.458 |0.14%|0.011µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[113.003µs; 113.046µs] or [-0.019%; +0.019%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|431.878ns|443.292ns ± 12.342ns|438.208ns ± 3.581ns|451.695ns|471.082ns|473.733ns|474.322ns|8.24% |1.350 |0.444 |2.78%|0.873ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[441.582ns; 445.003ns] or [-0.386%; +0.386%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|---------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|28.767µs|39.022µs ± 18.120µs|30.157µs ± 0.702µs|49.900µs|64.349µs|73.772µs|198.381µs|557.82% |4.793 |34.695 |46.32%|1.281µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[36.511µs; 41.533µs] or [-6.436%; +6.436%]|None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|2.176µs|2.223µs ± 0.020µs|2.230µs ± 0.005µs|2.234µs|2.247µs|2.250µs|2.254µs|1.06% |-1.054 |-0.120 |0.91%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[2.221µs; 2.226µs] or [-0.127%; +0.127%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|188.691µs|190.222µs ± 0.654µs|190.142µs ± 0.240µs|190.390µs|190.996µs|192.363µs|196.076µs|3.12% |4.209 |33.236 |0.34%|0.046µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[190.131µs; 190.313µs] or [-0.048%; +0.048%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|14.169ms|14.268ms ± 0.024ms|14.268ms ± 0.015ms|14.282ms|14.309ms|14.332ms|14.357ms|0.62% |-0.240 |2.948 |0.17%|0.002ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[14.265ms; 14.272ms] or [-0.023%; +0.023%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|3.219µs|4.378µs ± 1.549µs|4.215µs ± 0.031µs|4.242µs|4.374µs|16.133µs|17.527µs|315.82% |7.723 |59.310 |35.29%|0.110µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[4.163µs; 4.593µs] or [-4.903%; +4.903%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|---------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|517.696µs |519.016µs ± 0.577µs |518.994µs ± 0.277µs |519.259µs |519.768µs |520.039µs |524.447µs |1.05% |4.154 |37.658 |0.11%|0.041µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1906769.688op/s |1926724.982op/s ± 2132.054op/s |1926804.085op/s ± 1027.079op/s |1927876.687op/s |1929320.548op/s |1930770.836op/s |1931637.187op/s |0.25% |-4.080 |36.777 |0.11%|150.759op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|471.050µs |475.125µs ± 3.103µs |474.144µs ± 2.197µs |478.512µs |479.682µs |480.027µs |483.457µs |1.96% |0.353 |-1.464 |0.65%|0.219µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2068434.269op/s |2104796.864op/s ± 13714.774op/s |2109062.873op/s ± 9817.932op/s |2117608.290op/s |2119329.893op/s |2122491.218op/s |2122918.744op/s |0.66% |-0.345 |-1.477 |0.65%|969.781op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|193.068µs |193.378µs ± 0.146µs |193.394µs ± 0.081µs |193.460µs |193.551µs |193.805µs |194.271µs |0.45% |1.215 |6.601 |0.08%|0.010µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5147454.901op/s |5171209.394op/s ± 3903.311op/s |5170784.157op/s ± 2159.406op/s |5173646.207op/s |5177314.494op/s |5178965.955op/s |5179530.131op/s |0.17% |-1.199 |6.502 |0.08%|276.006op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|100.424µs |101.258µs ± 0.306µs |101.274µs ± 0.228µs |101.501µs |101.732µs |101.785µs |101.977µs |0.69% |-0.300 |-0.403 |0.30%|0.022µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |9806173.967op/s |9875822.187op/s ± 29854.081op/s |9874180.218op/s ± 22265.823op/s |9896457.141op/s |9927259.433op/s |9946351.035op/s |9957801.052op/s |0.85% |0.314 |-0.391 |0.30%|2111.002op/s |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|60.324µs |61.109µs ± 0.554µs |61.017µs ± 0.431µs |61.468µs |62.179µs |62.415µs |62.584µs |2.57% |0.668 |-0.606 |0.90%|0.039µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |15978618.478op/s|16365418.548op/s ± 147375.566op/s|16388895.383op/s ± 116468.035op/s|16504265.840op/s|16531161.881op/s|16535226.278op/s|16577081.356op/s|1.15% |-0.643 |-0.654 |0.90%|10421.026op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[518.936µs; 519.096µs] or [-0.015%; +0.015%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1926429.500op/s; 1927020.464op/s] or [-0.015%; +0.015%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[474.695µs; 475.555µs] or [-0.091%; +0.091%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2102896.128op/s; 2106697.599op/s] or [-0.090%; +0.090%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[193.358µs; 193.399µs] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5170668.432op/s; 5171750.355op/s] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[101.216µs; 101.301µs] or [-0.042%; +0.042%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[9871684.699op/s; 9879959.676op/s] or [-0.042%; +0.042%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[61.033µs; 61.186µs] or [-0.126%; +0.126%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[16344993.712op/s; 16385843.384op/s] or [-0.125%; +0.125%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|5.149µs|5.182µs ± 0.023µs|5.176µs ± 0.008µs|5.184µs|5.238µs|5.248µs|5.253µs|1.47% |1.591 |1.732 |0.44%|0.002µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[5.179µs; 5.185µs] or [-0.061%; +0.061%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|271.796µs |273.361µs ± 0.958µs |273.021µs ± 0.227µs |273.481µs |275.384µs |276.927µs |278.433µs |1.98% |2.124 |5.965 |0.35%|0.068µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |3591534.256op/s |3658215.504op/s ± 12731.377op/s |3662721.657op/s ± 3044.758op/s |3664955.802op/s |3668628.973op/s |3677580.052op/s |3679230.531op/s |0.45% |-2.089 |5.749 |0.35%|900.244op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|34.026µs |34.276µs ± 0.072µs |34.273µs ± 0.036µs |34.309µs |34.388µs |34.451µs |34.652µs |1.10% |0.894 |4.536 |0.21%|0.005µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |28858562.034op/s|29174772.847op/s ± 61407.132op/s |29177137.231op/s ± 31072.274op/s|29208507.239op/s|29269629.066op/s|29290442.485op/s|29389200.302op/s|0.73% |-0.858 |4.405 |0.21%|4342.140op/s|1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|23.863µs |24.037µs ± 0.061µs |24.060µs ± 0.034µs |24.077µs |24.138µs |24.166µs |24.169µs |0.45% |-0.523 |0.388 |0.25%|0.004µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |41376123.908op/s|41602940.872op/s ± 105270.285op/s|41562279.922op/s ± 58033.620op/s|41674739.942op/s|41806770.185op/s|41901674.198op/s|41906001.347op/s|0.83% |0.539 |0.407 |0.25%|7443.733op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[273.228µs; 273.493µs] or [-0.049%; +0.049%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[3656451.058op/s; 3659979.951op/s] or [-0.048%; +0.048%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[34.266µs; 34.286µs] or [-0.029%; +0.029%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[29166262.410op/s; 29183283.285op/s] or [-0.029%; +0.029%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[24.028µs; 24.045µs] or [-0.035%; +0.035%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[41588351.423op/s; 41617530.321op/s] or [-0.035%; +0.035%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|----------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|-------------|----|-----------| |credit_card/is_card_number/ |execution_time|2.017µs |2.019µs ± 0.003µs |2.019µs ± 0.001µs |2.019µs |2.020µs |2.021µs |2.057µs |1.89% |12.125 |159.854 |0.14%|0.000µs |1 |200 | |credit_card/is_card_number/ |throughput |486209283.162op/s|495296121.531op/s ± 679298.970op/s|495380630.644op/s ± 153758.282op/s|495525999.874op/s|495585348.921op/s|495610298.900op/s|495673810.213op/s|0.06% |-12.063 |158.734 |0.14%|48033.691op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|160.618µs |164.495µs ± 0.802µs |164.571µs ± 0.487µs |165.059µs |165.500µs |165.986µs |167.580µs |1.83% |-0.734 |2.895 |0.49%|0.057µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |5967296.865op/s |6079356.071op/s ± 29762.185op/s |6076407.217op/s ± 17934.762op/s |6094255.555op/s |6132707.509op/s |6139576.408op/s |6225944.634op/s |2.46% |0.798 |3.045 |0.49%|2104.504op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|152.169µs |154.466µs ± 0.548µs |154.414µs ± 0.248µs |154.793µs |155.325µs |155.431µs |155.748µs |0.86% |-0.563 |1.367 |0.35%|0.039µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |6420644.684op/s |6473998.741op/s ± 23026.109op/s |6476088.985op/s ± 10411.302op/s |6484178.121op/s |6519194.049op/s |6532164.943op/s |6571642.070op/s |1.48% |0.596 |1.453 |0.35%|1628.192op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|2.017µs |2.019µs ± 0.001µs |2.019µs ± 0.001µs |2.019µs |2.020µs |2.021µs |2.021µs |0.14% |0.693 |-0.262 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |494689131.718op/s|495342301.421op/s ± 206959.527op/s|495389646.362op/s ± 147504.794op/s|495519581.263op/s|495589793.547op/s|495608235.748op/s|495696525.662op/s|0.06% |-0.692 |-0.265 |0.04%|14634.248op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|144.551µs |149.316µs ± 1.859µs |150.025µs ± 1.018µs |150.764µs |151.277µs |151.537µs |151.658µs |1.09% |-0.925 |-0.323 |1.24%|0.131µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |6593789.775op/s |6698254.322op/s ± 84388.232op/s |6665538.490op/s ± 45230.491op/s |6757370.958op/s |6880089.808op/s |6894054.208op/s |6917991.886op/s |3.79% |0.956 |-0.256 |1.26%|5967.149op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|143.776µs |149.581µs ± 3.142µs |149.801µs ± 2.776µs |152.575µs |153.344µs |153.410µs |153.461µs |2.44% |-0.399 |-1.173 |2.10%|0.222µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |6516323.731op/s |6688296.069op/s ± 141729.507op/s |6675539.503op/s ± 121642.256op/s |6801984.481op/s |6934994.326op/s |6952150.830op/s |6955270.242op/s |4.19% |0.441 |-1.129 |2.11%|10021.790op/s|1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|62.147µs |62.412µs ± 0.299µs |62.229µs ± 0.055µs |62.612µs |63.015µs |63.062µs |63.252µs |1.64% |1.044 |-0.324 |0.48%|0.021µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |15809878.308op/s |16023036.571op/s ± 76378.495op/s |16069638.586op/s ± 14314.828op/s |16078946.018op/s |16086281.667op/s |16089595.702op/s |16090983.247op/s |0.13% |-1.035 |-0.348 |0.48%|5400.775op/s |1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|2.017µs |2.019µs ± 0.001µs |2.019µs ± 0.000µs |2.019µs |2.019µs |2.020µs |2.020µs |0.08% |0.093 |-0.690 |0.03%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |494927641.059op/s|495378786.275op/s ± 151655.367op/s|495338751.363op/s ± 116758.909op/s|495524636.837op/s|495592391.450op/s|495652478.933op/s|495673115.887op/s|0.07% |-0.092 |-0.692 |0.03%|10723.654op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|137.805µs |141.294µs ± 0.772µs |141.261µs ± 0.518µs |141.816µs |142.568µs |142.873µs |143.226µs |1.39% |-0.370 |1.525 |0.54%|0.055µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |6981977.286op/s |7077627.417op/s ± 38752.129op/s |7079102.053op/s ± 26004.629op/s |7103157.858op/s |7130411.957op/s |7177837.426op/s |7256616.850op/s |2.51% |0.426 |1.706 |0.55%|2740.189op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|129.160µs |131.713µs ± 0.827µs |131.836µs ± 0.513µs |132.250µs |132.939µs |133.280µs |133.404µs |1.19% |-0.560 |0.187 |0.63%|0.058µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |7496052.647op/s |7592585.087op/s ± 47846.583op/s |7585188.690op/s ± 29496.264op/s |7619637.447op/s |7679914.049op/s |7727452.126op/s |7742358.443op/s |2.07% |0.596 |0.241 |0.63%|3383.264op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|2.017µs |2.019µs ± 0.001µs |2.019µs ± 0.000µs |2.019µs |2.020µs |2.021µs |2.021µs |0.12% |0.309 |0.114 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |494733742.070op/s|495363925.502op/s ± 175396.843op/s|495311983.068op/s ± 119647.150op/s|495536322.044op/s|495620459.415op/s|495643122.870op/s|495717655.874op/s|0.08% |-0.307 |0.108 |0.04%|12402.430op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|121.360µs |126.532µs ± 1.675µs |127.060µs ± 0.772µs |127.656µs |128.488µs |128.852µs |129.120µs |1.62% |-1.165 |0.749 |1.32%|0.118µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |7744711.838op/s |7904510.340op/s ± 106318.780op/s |7870310.661op/s ± 48126.271op/s |7944927.915op/s |8145273.561op/s |8201956.608op/s |8239933.685op/s |4.70% |1.221 |0.892 |1.34%|7517.873op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|143.364µs |151.443µs ± 2.244µs |152.507µs ± 0.211µs |152.639µs |153.298µs |153.378µs |153.435µs |0.61% |-1.832 |2.654 |1.48%|0.159µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |6517422.871op/s |6604635.077op/s ± 100641.557op/s |6557071.577op/s ± 9053.672op/s |6643648.614op/s |6859465.331op/s |6957912.994op/s |6975228.569op/s |6.38% |1.892 |2.937 |1.52%|7116.433op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|62.144µs |62.394µs ± 0.280µs |62.255µs ± 0.040µs |62.430µs |63.019µs |63.122µs |63.259µs |1.61% |1.537 |0.887 |0.45%|0.020µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |15808148.384op/s |16027444.346op/s ± 71485.099op/s |16063001.286op/s ± 10370.387op/s |16070089.550op/s |16079374.906op/s |16086503.601op/s |16091614.660op/s |0.18% |-1.530 |0.863 |0.44%|5054.760op/s |1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[2.019µs; 2.019µs] or [-0.019%; +0.019%] |None |None |None | |credit_card/is_card_number/ |throughput |[495201977.226op/s; 495390265.835op/s] or [-0.019%; +0.019%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[164.384µs; 164.606µs] or [-0.068%; +0.068%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[6075231.319op/s; 6083480.824op/s] or [-0.068%; +0.068%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[154.390µs; 154.542µs] or [-0.049%; +0.049%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[6470807.543op/s; 6477189.938op/s] or [-0.049%; +0.049%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[2.019µs; 2.019µs] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[495313618.821op/s; 495370984.021op/s] or [-0.006%; +0.006%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[149.058µs; 149.574µs] or [-0.173%; +0.173%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[6686558.924op/s; 6709949.719op/s] or [-0.175%; +0.175%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[149.146µs; 150.017µs] or [-0.291%; +0.291%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[6668653.723op/s; 6707938.416op/s] or [-0.294%; +0.294%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[62.370µs; 62.453µs] or [-0.066%; +0.066%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[16012451.246op/s; 16033621.896op/s] or [-0.066%; +0.066%] |None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[2.019µs; 2.019µs] or [-0.004%; +0.004%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[495357768.300op/s; 495399804.251op/s] or [-0.004%; +0.004%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[141.188µs; 141.401µs] or [-0.076%; +0.076%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[7072256.745op/s; 7082998.090op/s] or [-0.076%; +0.076%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[131.598µs; 131.827µs] or [-0.087%; +0.087%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[7585954.011op/s; 7599216.163op/s] or [-0.087%; +0.087%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[2.019µs; 2.019µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[495339617.186op/s; 495388233.817op/s] or [-0.005%; +0.005%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[126.300µs; 126.765µs] or [-0.183%; +0.183%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[7889775.580op/s; 7919245.100op/s] or [-0.186%; +0.186%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[151.132µs; 151.754µs] or [-0.205%; +0.205%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[6590687.125op/s; 6618583.029op/s] or [-0.211%; +0.211%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[62.355µs; 62.433µs] or [-0.062%; +0.062%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[16017537.199op/s; 16037351.493op/s] or [-0.062%; +0.062%] |None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |---------------------------------------------|--------------|---------------|----------------------------------| |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|aa73aff |1728304245 |vianney/sidecar/fix-telemetry-name| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|66.754µs|66.948µs ± 0.262µs|66.900µs ± 0.068µs|66.998µs|67.104µs|67.412µs|70.329µs|5.12% |10.857 |136.495 |0.39%|0.019µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[66.911µs; 66.984µs] or [-0.054%; +0.054%]|None |None |None |

Baseline

Omitted due to size.

DataDog / libdatadog