Closed bantonsson closed 2 weeks ago
Benchmark execution time: 2024-11-12 17:51:55
Comparing candidate commit d8acbcde in PR branch ban/tmp-test-benchmark-comments with baseline commit 873ea858 in branch main.
ban/tmp-test-benchmark-comments
main
Found 2 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.
execution_time
throughput
Omitted due to size.
Benchmarks
Comparison
Benchmark execution time: 2024-11-12 17:51:55
Comparing candidate commit d8acbcde in PR branch
ban/tmp-test-benchmark-commentswith baseline commit 873ea858 in branchmain.Found 2 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.
scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて
execution_time[-32.293µs; -32.126µs] or [-6.449%; -6.416%]throughput[+136943.865op/s; +137635.655op/s] or [+6.857%; +6.892%]Candidate
Candidate benchmark details
### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|294.236ns|305.549ns ± 13.869ns|299.957ns ± 4.582ns|307.622ns|340.747ns|343.061ns|348.280ns|16.11% |1.672 |1.641 |4.53%|0.981ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[303.627ns; 307.471ns] or [-0.629%; +0.629%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|17.743µs|27.424µs ± 11.349µs|18.755µs ± 0.633µs|35.917µs|43.153µs|46.580µs|96.477µs|414.42% |1.818 |7.448 |41.28%|0.803µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[25.851µs; 28.997µs] or [-5.735%; +5.735%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|1.121µs|1.183µs ± 0.025µs|1.184µs ± 0.018µs|1.205µs|1.208µs|1.212µs|1.212µs|2.41% |-1.009 |0.238 |2.11%|0.002µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[1.180µs; 1.187µs] or [-0.293%; +0.293%]|None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|----------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|-------------|----|-----------| |credit_card/is_card_number/ |execution_time|4.597µs |4.615µs ± 0.009µs |4.616µs ± 0.007µs |4.621µs |4.630µs |4.633µs |4.641µs |0.54% |0.167 |-0.730 |0.20%|0.001µs |1 |200 | |credit_card/is_card_number/ |throughput |215477699.549op/s|216686903.858op/s ± 430162.294op/s|216639123.908op/s ± 349377.965op/s|217026727.823op/s|217365401.100op/s|217406749.192op/s|217509952.485op/s|0.40% |-0.160 |-0.737 |0.20%|30417.067op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|93.297µs |93.586µs ± 0.389µs |93.498µs ± 0.103µs |93.608µs |94.257µs |94.655µs |97.485µs |4.26% |5.825 |50.204 |0.41%|0.028µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |10258020.862op/s |10685498.556op/s ± 43393.171op/s |10695377.992op/s ± 11817.321op/s |10706104.889op/s |10716867.224op/s |10717864.805op/s |10718470.068op/s |0.22% |-5.605 |46.978 |0.41%|3068.361op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|85.200µs |85.373µs ± 0.303µs |85.323µs ± 0.026µs |85.351µs |85.461µs |86.136µs |89.060µs |4.38% |9.585 |109.177 |0.35%|0.021µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |11228415.275op/s |11713451.020op/s ± 40197.668op/s |11720112.782op/s ± 3512.713op/s |11723305.840op/s |11726932.241op/s |11729056.884op/s |11737134.733op/s |0.15% |-9.383 |105.385 |0.34%|2842.404op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|4.600µs |4.613µs ± 0.008µs |4.612µs ± 0.006µs |4.617µs |4.628µs |4.631µs |4.634µs |0.47% |0.416 |-0.451 |0.18%|0.001µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |215791264.483op/s|216793439.528op/s ± 383693.192op/s|216804280.967op/s ± 282924.220op/s|217095434.740op/s|217373016.728op/s|217395797.859op/s|217407254.606op/s|0.28% |-0.409 |-0.460 |0.18%|27131.206op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|81.545µs |82.049µs ± 0.244µs |82.001µs ± 0.111µs |82.122µs |82.457µs |82.856µs |83.765µs |2.15% |2.492 |12.684 |0.30%|0.017µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |11938162.666op/s |12187979.777op/s ± 36037.126op/s |12195017.731op/s ± 16504.282op/s |12208880.740op/s |12226941.026op/s |12248082.012op/s |12263097.315op/s |0.56% |-2.417 |12.066 |0.29%|2548.210op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|58.863µs |58.895µs ± 0.021µs |58.896µs ± 0.017µs |58.908µs |58.936µs |58.947µs |58.957µs |0.10% |0.642 |-0.348 |0.04%|0.002µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |16961578.632op/s |16979508.729op/s ± 6143.255op/s |16979149.609op/s ± 4931.212op/s |16985006.061op/s |16986793.872op/s |16988156.774op/s |16988651.581op/s |0.06% |-0.640 |-0.351 |0.04%|434.394op/s |1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|6.819µs |6.840µs ± 0.037µs |6.824µs ± 0.003µs |6.835µs |6.902µs |6.986µs |7.061µs |3.48% |2.945 |9.999 |0.54%|0.003µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |141621970.663op/s|146212454.828op/s ± 785170.570op/s|146550666.435op/s ± 58467.825op/s |146600159.799op/s|146638232.022op/s|146650800.602op/s|146655158.951op/s|0.07% |-2.892 |9.567 |0.54%|55519.943op/s|1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|4.600µs |4.613µs ± 0.008µs |4.613µs ± 0.006µs |4.618µs |4.628µs |4.630µs |4.631µs |0.38% |0.244 |-0.764 |0.18%|0.001µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |215954894.998op/s|216799405.351op/s ± 384610.658op/s|216778181.502op/s ± 287705.599op/s|217137923.473op/s|217368159.939op/s|217384667.597op/s|217395248.115op/s|0.28% |-0.237 |-0.771 |0.18%|27196.080op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|73.364µs |73.699µs ± 0.152µs |73.706µs ± 0.090µs |73.788µs |73.898µs |73.982µs |74.835µs |1.53% |1.929 |14.276 |0.21%|0.011µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |13362690.641op/s |13568799.640op/s ± 27824.073op/s |13567409.725op/s ± 16605.031op/s |13586480.099op/s |13611040.256op/s |13624078.706op/s |13630592.502op/s |0.47% |-1.853 |13.608 |0.20%|1967.459op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|65.269µs |65.471µs ± 0.136µs |65.466µs ± 0.112µs |65.562µs |65.691µs |65.722µs |65.769µs |0.46% |0.206 |-1.121 |0.21%|0.010µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |15204718.113op/s |15274072.833op/s ± 31711.282op/s |15275080.997op/s ± 26088.778op/s |15305569.314op/s |15317454.469op/s |15319452.641op/s |15321315.013op/s |0.30% |-0.201 |-1.125 |0.21%|2242.326op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|4.600µs |4.613µs ± 0.009µs |4.614µs ± 0.006µs |4.619µs |4.628µs |4.630µs |4.637µs |0.50% |0.197 |-0.686 |0.19%|0.001µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |215665581.604op/s|216774190.454op/s ± 403596.188op/s|216751467.649op/s ± 303188.807op/s|217095743.836op/s|217383558.251op/s|217400388.619op/s|217414532.862op/s|0.31% |-0.190 |-0.693 |0.19%|28538.560op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|62.192µs |62.515µs ± 0.103µs |62.505µs ± 0.035µs |62.559µs |62.701µs |62.851µs |62.929µs |0.68% |0.616 |2.459 |0.16%|0.007µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |15890982.726op/s |15996224.024op/s ± 26203.429op/s |15998839.342op/s ± 8896.516op/s |16006172.617op/s |16042619.403op/s |16047771.935op/s |16079254.546op/s |0.50% |-0.596 |2.425 |0.16%|1852.862op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|58.861µs |58.894µs ± 0.025µs |58.893µs ± 0.016µs |58.907µs |58.930µs |58.962µs |59.098µs |0.35% |2.903 |19.296 |0.04%|0.002µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |16921056.503op/s |16979587.990op/s ± 7324.067op/s |16979888.172op/s ± 4604.137op/s |16984974.243op/s |16987872.273op/s |16988585.386op/s |16989206.757op/s |0.05% |-2.886 |19.122 |0.04%|517.890op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|6.819µs |6.829µs ± 0.021µs |6.823µs ± 0.002µs |6.825µs |6.885µs |6.919µs |6.985µs |2.37% |4.023 |18.731 |0.31%|0.002µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |143160006.115op/s|146435636.235op/s ± 452472.437op/s|146559292.243op/s ± 51742.029op/s |146614325.018op/s|146634847.507op/s|146640201.062op/s|146650733.299op/s|0.06% |-3.981 |18.235 |0.31%|31994.633op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[4.614µs; 4.616µs] or [-0.028%; +0.028%] |None |None |None | |credit_card/is_card_number/ |throughput |[216627287.501op/s; 216746520.215op/s] or [-0.028%; +0.028%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[93.532µs; 93.640µs] or [-0.058%; +0.058%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[10679484.680op/s; 10691512.433op/s] or [-0.056%; +0.056%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[85.331µs; 85.415µs] or [-0.049%; +0.049%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[11707880.010op/s; 11719022.030op/s] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[4.612µs; 4.614µs] or [-0.025%; +0.025%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[216740263.342op/s; 216846615.714op/s] or [-0.025%; +0.025%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[82.015µs; 82.083µs] or [-0.041%; +0.041%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[12182985.378op/s; 12192974.176op/s] or [-0.041%; +0.041%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[58.892µs; 58.897µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[16978657.333op/s; 16980360.125op/s] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[6.834µs; 6.845µs] or [-0.076%; +0.076%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[146103637.738op/s; 146321271.917op/s] or [-0.074%; +0.074%]|None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[4.611µs; 4.614µs] or [-0.025%; +0.025%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[216746102.013op/s; 216852708.689op/s] or [-0.025%; +0.025%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[73.678µs; 73.720µs] or [-0.029%; +0.029%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[13564943.492op/s; 13572655.789op/s] or [-0.028%; +0.028%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[65.452µs; 65.490µs] or [-0.029%; +0.029%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[15269677.955op/s; 15278467.712op/s] or [-0.029%; +0.029%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[4.612µs; 4.614µs] or [-0.026%; +0.026%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[216718255.904op/s; 216830125.004op/s] or [-0.026%; +0.026%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[62.501µs; 62.529µs] or [-0.023%; +0.023%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[15992592.480op/s; 15999855.567op/s] or [-0.023%; +0.023%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[58.891µs; 58.898µs] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[16978572.944op/s; 16980603.035op/s] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[6.826µs; 6.832µs] or [-0.043%; +0.043%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[146372927.907op/s; 146498344.563op/s] or [-0.043%; +0.043%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|37.617µs|37.991µs ± 0.552µs|37.777µs ± 0.104µs|37.881µs|39.087µs|39.155µs|41.064µs|8.70% |2.061 |4.464 |1.45%|0.039µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[37.914µs; 38.067µs] or [-0.201%; +0.201%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|9.011ms|9.056ms ± 0.023ms|9.056ms ± 0.012ms|9.067ms|9.081ms|9.112ms|9.251ms|2.15% |3.230 |26.108 |0.25%|0.002ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[9.053ms; 9.059ms] or [-0.035%; +0.035%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|69.415µs|69.525µs ± 0.107µs|69.509µs ± 0.027µs|69.539µs|69.606µs|69.981µs|70.672µs|1.67% |7.122 |66.981 |0.15%|0.008µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[69.510µs; 69.540µs] or [-0.021%; +0.021%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|139.680µs|140.735µs ± 0.353µs|140.734µs ± 0.162µs|140.882µs|141.305µs|141.980µs|142.218µs|1.05% |0.712 |3.043 |0.25%|0.025µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[140.686µs; 140.784µs] or [-0.035%; +0.035%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|--------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|506.353µs |507.231µs ± 0.416µs |507.164µs ± 0.261µs |507.436µs |507.999µs |508.502µs |508.612µs |0.29% |0.895 |1.064 |0.08%|0.029µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1966134.604op/s |1971488.626op/s ± 1615.921op/s |1971748.555op/s ± 1014.250op/s |1972702.726op/s |1973783.259op/s |1974206.642op/s |1974905.228op/s |0.16% |-0.889 |1.050 |0.08%|114.263op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|467.695µs |468.526µs ± 0.293µs |468.529µs ± 0.193µs |468.697µs |468.979µs |469.268µs |469.432µs |0.19% |0.084 |0.237 |0.06%|0.021µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2130235.179op/s |2134354.108op/s ± 1336.082op/s |2134340.323op/s ± 878.832op/s |2135308.306op/s |2136454.915op/s |2137253.829op/s |2138145.105op/s |0.18% |-0.080 |0.234 |0.06%|94.475op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|179.795µs |180.340µs ± 0.207µs |180.324µs ± 0.135µs |180.477µs |180.701µs |180.784µs |180.935µs |0.34% |0.072 |-0.054 |0.11%|0.015µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5526835.482op/s |5545096.688op/s ± 6376.689op/s |5545579.524op/s ± 4157.456op/s |5548991.317op/s |5554942.668op/s |5561485.176op/s |5561878.613op/s |0.29% |-0.066 |-0.054 |0.11%|450.900op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|44.988µs |45.145µs ± 0.065µs |45.139µs ± 0.040µs |45.186µs |45.259µs |45.310µs |45.345µs |0.46% |0.311 |0.176 |0.14%|0.005µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |22053072.204op/s|22150931.085op/s ± 31917.506op/s|22153962.187op/s ± 19659.714op/s|22171591.846op/s|22199606.963op/s|22220174.610op/s|22228160.241op/s|0.33% |-0.302 |0.168 |0.14%|2256.909op/s|1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|48.949µs |49.134µs ± 0.083µs |49.113µs ± 0.059µs |49.197µs |49.277µs |49.306µs |49.444µs |0.67% |0.424 |0.011 |0.17%|0.006µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |20224828.714op/s|20352470.076op/s ± 34266.418op/s|20361102.964op/s ± 24447.758op/s|20376640.629op/s|20403386.500op/s|20416639.774op/s|20429524.749op/s|0.34% |-0.415 |-0.007 |0.17%|2423.002op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[507.174µs; 507.289µs] or [-0.011%; +0.011%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1971264.674op/s; 1971712.577op/s] or [-0.011%; +0.011%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[468.485µs; 468.567µs] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2134168.940op/s; 2134539.276op/s] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[180.311µs; 180.368µs] or [-0.016%; +0.016%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5544212.940op/s; 5545980.436op/s] or [-0.016%; +0.016%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[45.136µs; 45.154µs] or [-0.020%; +0.020%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[22146507.626op/s; 22155354.545op/s] or [-0.020%; +0.020%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[49.123µs; 49.146µs] or [-0.023%; +0.023%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[20347721.080op/s; 20357219.072op/s] or [-0.023%; +0.023%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.636µs|2.697µs ± 0.017µs|2.698µs ± 0.007µs|2.703µs|2.729µs|2.736µs|2.739µs|1.52% |-0.609 |2.510 |0.62%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.695µs; 2.699µs] or [-0.087%; +0.087%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.395µs|3.272µs ± 1.404µs|3.124µs ± 0.027µs|3.144µs|3.184µs|14.017µs|15.047µs|381.71% |7.593 |57.781 |42.80%|0.099µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[3.078µs; 3.467µs] or [-5.947%; +5.947%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|-------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|271.511µs |272.873µs ± 0.685µs |272.754µs ± 0.412µs |273.233µs |274.213µs |274.670µs |274.794µs |0.75% |0.601 |-0.029 |0.25%|0.048µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |3639087.438op/s |3664730.533op/s ± 9190.027op/s |3666306.921op/s ± 5543.930op/s |3670856.899op/s |3676857.854op/s |3681671.201op/s |3683093.838op/s |0.46% |-0.589 |-0.046 |0.25%|649.833op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|25.805µs |25.879µs ± 0.077µs |25.850µs ± 0.026µs |25.912µs |25.984µs |26.056µs |26.448µs |2.32% |3.636 |21.350 |0.30%|0.005µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |37809507.925op/s|38642095.485op/s ± 113935.354op/s|38684887.371op/s ± 38339.092op/s|38713604.802op/s|38732897.074op/s|38743003.597op/s|38751842.976op/s|0.17% |-3.548 |20.472 |0.29%|8056.446op/s|1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|15.445µs |15.486µs ± 0.030µs |15.477µs ± 0.020µs |15.505µs |15.538µs |15.571µs |15.601µs |0.80% |0.991 |0.889 |0.19%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |64099585.115op/s|64572819.504op/s ± 123271.442op/s|64610909.276op/s ± 81699.144op/s|64671505.829op/s|64716972.592op/s|64734382.744op/s|64744440.206op/s|0.21% |-0.980 |0.850 |0.19%|8716.607op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[272.778µs; 272.968µs] or [-0.035%; +0.035%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[3663456.884op/s; 3666004.183op/s] or [-0.035%; +0.035%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[25.868µs; 25.889µs] or [-0.041%; +0.041%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[38626305.140op/s; 38657885.829op/s] or [-0.041%; +0.041%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[15.482µs; 15.491µs] or [-0.027%; +0.027%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[64555735.268op/s; 64589903.741op/s] or [-0.026%; +0.026%]|None |None |None |Baseline
Omitted due to size.