Comparing candidate commit 1b2ae80b in PR branch ban/tmp-test-benchmark-ekump with baseline commit 9c3b1ab6 in branch ekump/APMSP-1526-add-more-data-to-msgpack-deserialization-benchmark.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.
Benchmarks
Comparison
Benchmark execution time: 2024-11-13 08:05:20
Comparing candidate commit 1b2ae80b in PR branch
ban/tmp-test-benchmark-ekumpwith baseline commit 9c3b1ab6 in branchekump/APMSP-1526-add-more-data-to-msgpack-deserialization-benchmark.Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.351µs|3.326µs ± 1.429µs|3.175µs ± 0.029µs|3.204µs|3.262µs|14.150µs|15.233µs|379.79% |7.526 |57.067 |42.86%|0.101µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[3.128µs; 3.524µs] or [-5.954%; +5.954%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|140.734µs|141.654µs ± 0.352µs|141.592µs ± 0.159µs|141.804µs|142.210µs|142.657µs|143.934µs|1.65% |1.801 |8.636 |0.25%|0.025µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[141.605µs; 141.703µs] or [-0.034%; +0.034%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|36.659µs|37.188µs ± 0.944µs|36.764µs ± 0.056µs|36.844µs|39.209µs|39.257µs|40.029µs|8.88% |1.715 |1.012 |2.53%|0.067µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[37.057µs; 37.319µs] or [-0.352%; +0.352%]|None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|----------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|-------------|----|-----------| |credit_card/is_card_number/ |execution_time|4.588µs |4.612µs ± 0.009µs |4.612µs ± 0.006µs |4.618µs |4.629µs |4.632µs |4.632µs |0.43% |-0.021 |-0.269 |0.20%|0.001µs |1 |200 | |credit_card/is_card_number/ |throughput |215889013.131op/s|216804996.979op/s ± 444720.929op/s|216822755.564op/s ± 290681.526op/s|217110348.401op/s|217407774.304op/s|217842115.754op/s|217949246.376op/s|0.52% |0.031 |-0.264 |0.20%|31446.518op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|93.177µs |93.515µs ± 0.333µs |93.476µs ± 0.111µs |93.578µs |93.757µs |94.191µs |97.577µs |4.39% |9.260 |108.874 |0.36%|0.024µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |10248264.691op/s |10693628.554op/s ± 36918.066op/s |10697879.681op/s ± 12717.385op/s |10710896.463op/s |10717463.464op/s |10719185.528op/s |10732248.260op/s |0.32% |-8.995 |104.417 |0.34%|2610.501op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|85.223µs |85.440µs ± 0.398µs |85.325µs ± 0.029µs |85.362µs |86.131µs |86.714µs |89.422µs |4.80% |5.980 |50.293 |0.46%|0.028µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |11182964.579op/s |11704432.350op/s ± 53051.572op/s |11719960.265op/s ± 3969.448op/s |11723487.421op/s |11728251.835op/s |11730782.653op/s |11733981.611op/s |0.12% |-5.759 |46.887 |0.45%|3751.313op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|4.599µs |4.612µs ± 0.008µs |4.612µs ± 0.006µs |4.618µs |4.625µs |4.630µs |4.630µs |0.40% |0.210 |-0.885 |0.17%|0.001µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |215967861.115op/s|216830950.963op/s ± 380158.515op/s|216832901.064op/s ± 298778.771op/s|217133999.883op/s|217392641.084op/s|217413423.321op/s|217424057.205op/s|0.27% |-0.204 |-0.890 |0.17%|26881.266op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|81.528µs |82.101µs ± 0.378µs |82.012µs ± 0.135µs |82.160µs |82.883µs |83.678µs |83.888µs |2.29% |2.243 |6.438 |0.46%|0.027µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |11920681.738op/s |12180403.363op/s ± 55506.989op/s |12193332.694op/s ± 20091.912op/s |12211540.521op/s |12238148.094op/s |12259401.175op/s |12265772.753op/s |0.59% |-2.197 |6.194 |0.45%|3924.937op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|58.864µs |58.893µs ± 0.020µs |58.892µs ± 0.016µs |58.906µs |58.929µs |58.945µs |58.946µs |0.09% |0.599 |-0.579 |0.03%|0.001µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |16964555.953op/s |16979900.039op/s ± 5762.074op/s |16980372.388op/s ± 4477.127op/s |16984932.242op/s |16986838.003op/s |16987606.318op/s |16988286.576op/s |0.05% |-0.598 |-0.581 |0.03%|407.440op/s |1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|6.818µs |6.831µs ± 0.022µs |6.823µs ± 0.003µs |6.826µs |6.896µs |6.911µs |6.933µs |1.62% |2.805 |7.286 |0.33%|0.002µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |144230275.967op/s|146396065.035op/s ± 473463.188op/s|146560972.361op/s ± 56403.323op/s |146617460.229op/s|146639838.130op/s|146648518.482op/s|146667002.402op/s|0.07% |-2.791 |7.195 |0.32%|33478.903op/s|1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|4.590µs |4.613µs ± 0.009µs |4.613µs ± 0.006µs |4.619µs |4.629µs |4.631µs |4.631µs |0.40% |0.212 |-0.578 |0.18%|0.001µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |215925544.729op/s|216771848.037op/s ± 401337.805op/s|216781627.757op/s ± 266933.998op/s|217060142.045op/s|217378968.235op/s|217402899.765op/s|217841434.546op/s|0.49% |-0.204 |-0.580 |0.18%|28378.868op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|73.335µs |73.645µs ± 0.145µs |73.639µs ± 0.111µs |73.756µs |73.864µs |73.945µs |74.219µs |0.79% |0.120 |0.235 |0.20%|0.010µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |13473624.142op/s |13578676.163op/s ± 26810.848op/s |13579800.048op/s ± 20451.652op/s |13597263.211op/s |13623801.537op/s |13633256.872op/s |13636007.241op/s |0.41% |-0.107 |0.208 |0.20%|1895.813op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|65.268µs |65.412µs ± 0.116µs |65.393µs ± 0.083µs |65.478µs |65.656µs |65.681µs |65.715µs |0.49% |0.690 |-0.439 |0.18%|0.008µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |15217157.793op/s |15287792.054op/s ± 26967.677op/s |15292121.507op/s ± 19462.226op/s |15311326.171op/s |15319261.904op/s |15320681.664op/s |15321511.402op/s |0.19% |-0.684 |-0.451 |0.18%|1906.903op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|4.599µs |4.612µs ± 0.009µs |4.609µs ± 0.007µs |4.618µs |4.628µs |4.631µs |4.631µs |0.48% |0.491 |-0.740 |0.19%|0.001µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |215917566.497op/s|216840966.226op/s ± 412072.397op/s|216944984.459op/s ± 325883.065op/s|217138132.982op/s|217394264.614op/s|217404840.705op/s|217419755.012op/s|0.22% |-0.486 |-0.746 |0.19%|29137.919op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|62.181µs |62.537µs ± 0.128µs |62.517µs ± 0.062µs |62.614µs |62.760µs |62.870µs |62.912µs |0.63% |0.224 |0.536 |0.20%|0.009µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |15895213.981op/s |15990616.376op/s ± 32641.712op/s |15995723.543op/s ± 15856.193op/s |16005485.080op/s |16043745.764op/s |16067581.592op/s |16082168.624op/s |0.54% |-0.209 |0.533 |0.20%|2308.118op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|58.858µs |58.893µs ± 0.021µs |58.889µs ± 0.015µs |58.905µs |58.933µs |58.940µs |58.949µs |0.10% |0.612 |-0.476 |0.03%|0.001µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |16963706.151op/s |16980076.010op/s ± 5914.478op/s |16981109.367op/s ± 4277.255op/s |16985163.035op/s |16987278.737op/s |16988597.661op/s |16989936.860op/s |0.05% |-0.611 |-0.478 |0.03%|418.217op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|6.819µs |6.834µs ± 0.024µs |6.823µs ± 0.003µs |6.829µs |6.900µs |6.905µs |6.936µs |1.66% |2.108 |3.649 |0.35%|0.002µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |144170744.011op/s|146332143.357op/s ± 505607.980op/s|146557684.940op/s ± 60502.258op/s |146609726.701op/s|146633862.156op/s|146652236.516op/s|146656763.566op/s|0.07% |-2.096 |3.580 |0.34%|35751.883op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[4.611µs; 4.614µs] or [-0.028%; +0.028%] |None |None |None | |credit_card/is_card_number/ |throughput |[216743362.936op/s; 216866631.023op/s] or [-0.028%; +0.028%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[93.469µs; 93.561µs] or [-0.049%; +0.049%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[10688512.065op/s; 10698745.043op/s] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[85.384µs; 85.495µs] or [-0.065%; +0.065%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[11697079.912op/s; 11711784.787op/s] or [-0.063%; +0.063%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[4.611µs; 4.613µs] or [-0.024%; +0.024%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[216778264.649op/s; 216883637.277op/s] or [-0.024%; +0.024%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[82.048µs; 82.153µs] or [-0.064%; +0.064%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[12172710.628op/s; 12188096.098op/s] or [-0.063%; +0.063%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[58.890µs; 58.896µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[16979101.471op/s; 16980698.607op/s] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[6.828µs; 6.834µs] or [-0.045%; +0.045%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[146330447.591op/s; 146461682.479op/s] or [-0.045%; +0.045%]|None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[4.612µs; 4.614µs] or [-0.026%; +0.026%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[216716226.478op/s; 216827469.597op/s] or [-0.026%; +0.026%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[73.625µs; 73.665µs] or [-0.027%; +0.027%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[13574960.437op/s; 13582391.889op/s] or [-0.027%; +0.027%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[65.396µs; 65.428µs] or [-0.024%; +0.024%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[15284054.593op/s; 15291529.515op/s] or [-0.024%; +0.024%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[4.610µs; 4.613µs] or [-0.026%; +0.026%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[216783856.955op/s; 216898075.497op/s] or [-0.026%; +0.026%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[62.519µs; 62.555µs] or [-0.028%; +0.028%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[15986092.549op/s; 15995140.203op/s] or [-0.028%; +0.028%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[58.890µs; 58.895µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[16979256.320op/s; 16980895.700op/s] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[6.831µs; 6.837µs] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[146262070.954op/s; 146402215.760op/s] or [-0.048%; +0.048%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|293.674ns|309.143ns ± 17.867ns|301.552ns ± 6.225ns|317.469ns|346.661ns|361.486ns|362.215ns|20.12% |1.433 |1.145 |5.77%|1.263ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[306.666ns; 311.619ns] or [-0.801%; +0.801%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.704µs|2.739µs ± 0.015µs|2.739µs ± 0.008µs|2.750µs|2.764µs|2.770µs|2.773µs|1.23% |-0.179 |-0.154 |0.54%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.737µs; 2.741µs] or [-0.075%; +0.075%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|--------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|505.737µs |506.731µs ± 1.040µs |506.688µs ± 0.275µs |506.907µs |507.305µs |507.695µs |520.270µs |2.68% |11.087 |141.929 |0.20%|0.074µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1922077.617op/s |1973442.285op/s ± 3962.285op/s |1973600.653op/s ± 1070.473op/s |1974765.689op/s |1976174.600op/s |1976754.781op/s |1977313.008op/s |0.19% |-10.957 |139.697 |0.20%|280.176op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|477.701µs |478.297µs ± 0.234µs |478.315µs ± 0.161µs |478.445µs |478.659µs |478.895µs |479.087µs |0.16% |0.238 |0.274 |0.05%|0.017µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2087302.183op/s |2090749.502op/s ± 1022.227op/s |2090670.509op/s ± 701.990op/s |2091489.282op/s |2092375.735op/s |2092809.409op/s |2093361.038op/s |0.13% |-0.235 |0.269 |0.05%|72.282op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|179.748µs |180.244µs ± 0.188µs |180.240µs ± 0.110µs |180.345µs |180.586µs |180.703µs |180.809µs |0.32% |0.186 |0.343 |0.10%|0.013µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5530691.425op/s |5548050.397op/s ± 5786.808op/s |5548148.251op/s ± 3376.807op/s |5551550.616op/s |5557150.751op/s |5562056.387op/s |5563332.159op/s |0.27% |-0.179 |0.340 |0.10%|409.189op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|44.763µs |44.975µs ± 0.071µs |44.975µs ± 0.044µs |45.016µs |45.094µs |45.134µs |45.148µs |0.38% |-0.035 |-0.063 |0.16%|0.005µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |22149264.048op/s|22234537.315op/s ± 34894.040op/s|22234429.259op/s ± 21976.492op/s|22257350.786op/s|22292775.433op/s|22314650.563op/s|22339832.904op/s|0.47% |0.044 |-0.059 |0.16%|2467.381op/s|1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|48.959µs |49.110µs ± 0.109µs |49.103µs ± 0.040µs |49.144µs |49.191µs |49.268µs |50.424µs |2.69% |8.742 |102.610 |0.22%|0.008µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |19831675.866op/s|20362635.730op/s ± 44497.059op/s|20365529.214op/s ± 16765.089op/s|20381788.689op/s|20399034.454op/s|20413169.290op/s|20425291.284op/s|0.29% |-8.555 |99.634 |0.22%|3146.417op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[506.587µs; 506.875µs] or [-0.028%; +0.028%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1972893.150op/s; 1973991.419op/s] or [-0.028%; +0.028%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[478.265µs; 478.330µs] or [-0.007%; +0.007%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2090607.831op/s; 2090891.173op/s] or [-0.007%; +0.007%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[180.218µs; 180.270µs] or [-0.014%; +0.014%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5547248.401op/s; 5548852.393op/s] or [-0.014%; +0.014%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[44.965µs; 44.985µs] or [-0.022%; +0.022%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[22229701.337op/s; 22239373.294op/s] or [-0.022%; +0.022%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[49.095µs; 49.125µs] or [-0.031%; +0.031%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[20356468.866op/s; 20368802.595op/s] or [-0.030%; +0.030%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|9.016ms|9.054ms ± 0.015ms|9.055ms ± 0.010ms|9.064ms|9.075ms|9.086ms|9.097ms|0.46% |-0.154 |-0.066 |0.17%|0.001ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[9.052ms; 9.056ms] or [-0.023%; +0.023%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|271.646µs |272.661µs ± 0.507µs |272.607µs ± 0.328µs |272.960µs |273.489µs |274.242µs |274.543µs |0.71% |0.751 |0.915 |0.19%|0.036µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |3642414.902op/s |3667568.154op/s ± 6808.584op/s |3668284.610op/s ± 4414.711op/s |3672606.363op/s |3676623.160op/s |3679569.199op/s |3681267.514op/s |0.35% |-0.738 |0.880 |0.19%|481.440op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|25.769µs |25.884µs ± 0.070µs |25.870µs ± 0.045µs |25.920µs |26.011µs |26.072µs |26.120µs |0.97% |0.755 |0.221 |0.27%|0.005µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |38284455.652op/s|38634829.424op/s ± 104806.775op/s|38654637.988op/s ± 67599.398op/s|38715285.709op/s|38779471.593op/s|38792603.659op/s|38806669.525op/s|0.39% |-0.741 |0.191 |0.27%|7410.958op/s |1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|15.479µs |15.539µs ± 0.040µs |15.530µs ± 0.013µs |15.544µs |15.616µs |15.644µs |15.858µs |2.11% |3.191 |19.170 |0.26%|0.003µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |63058925.413op/s|64355109.176op/s ± 165151.584op/s|64391483.046op/s ± 55007.042op/s|64441960.159op/s|64539064.691op/s|64591347.047op/s|64601639.374op/s|0.33% |-3.107 |18.269 |0.26%|11677.980op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[272.591µs; 272.731µs] or [-0.026%; +0.026%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[3666624.550op/s; 3668511.759op/s] or [-0.026%; +0.026%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[25.874µs; 25.893µs] or [-0.038%; +0.038%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[38620304.213op/s; 38649354.635op/s] or [-0.038%; +0.038%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[15.533µs; 15.544µs] or [-0.036%; +0.036%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[64332220.755op/s; 64377997.597op/s] or [-0.036%; +0.036%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|59.100ms|59.756ms ± 0.265ms|59.845ms ± 0.118ms|59.922ms|60.037ms|60.261ms|60.715ms|1.45% |-0.448 |0.171 |0.44%|0.019ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[59.719ms; 59.793ms] or [-0.061%; +0.061%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|---------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|19.583µs|26.253µs ± 11.305µs|20.569µs ± 0.251µs|34.677µs|45.120µs|50.444µs|103.454µs|402.96% |3.100 |14.874 |42.95%|0.799µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[24.687µs; 27.820µs] or [-5.968%; +5.968%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|----------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|1b2ae80b |1731483489 |ban/tmp-test-benchmark-ekump| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|70.291µs|70.463µs ± 0.181µs|70.439µs ± 0.036µs|70.479µs|70.570µs|70.746µs|72.798µs|3.35% |10.854 |135.891 |0.26%|0.013µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[70.438µs; 70.488µs] or [-0.036%; +0.036%]|None |None |None |Baseline
Omitted due to size.