search

DataDog / libdatadog

Datadog shared rust-based library. For now only used in other products (e.g. Ruby or PHP libraries).
Apache License 2.0
48 stars 9 forks source link

[WIP] Disable workflows and test benchmarks comments #731

Closed bantonsson closed 2 weeks ago

pr-commenter[bot] commented 2 weeks ago

Benchmarks

Comparison

Benchmark execution time: 2024-11-12 18:15:06

Comparing candidate commit d8acbcde in PR branch ban/tmp-test-benchmark-comments-2 with baseline commit 873ea858 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details ### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|---------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|18.363µs|28.182µs ± 12.274µs|19.738µs ± 0.974µs|36.280µs|43.622µs|46.741µs|110.554µs|460.10% |2.679 |14.081 |43.44%|0.868µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[26.481µs; 29.883µs] or [-6.036%; +6.036%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.634µs|3.288µs ± 1.427µs|3.137µs ± 0.024µs|3.160µs|3.188µs|14.180µs|15.180µs|383.85% |7.590 |57.663 |43.30%|0.101µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[3.090µs; 3.486µs] or [-6.016%; +6.016%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|1.124µs|1.185µs ± 0.023µs|1.186µs ± 0.016µs|1.203µs|1.210µs|1.211µs|1.211µs|2.17% |-1.066 |0.429 |1.97%|0.002µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[1.182µs; 1.188µs] or [-0.274%; +0.274%]|None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|----------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|-------------|----|-----------| |credit_card/is_card_number/ |execution_time|4.600µs |4.611µs ± 0.009µs |4.611µs ± 0.007µs |4.618µs |4.628µs |4.633µs |4.636µs |0.54% |0.525 |-0.581 |0.19%|0.001µs |1 |200 | |credit_card/is_card_number/ |throughput |215709220.391op/s|216857800.356op/s ± 415869.310op/s|216880871.107op/s ± 349839.889op/s|217253101.486op/s|217387207.123op/s|217401347.291op/s|217412615.465op/s|0.25% |-0.518 |-0.592 |0.19%|29406.401op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|92.948µs |93.474µs ± 0.303µs |93.419µs ± 0.100µs |93.560µs |93.736µs |93.783µs |97.132µs |3.97% |8.885 |104.250 |0.32%|0.021µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |10295266.332op/s |10698233.148op/s ± 33749.109op/s |10704437.738op/s ± 11421.868op/s |10713585.824op/s |10718205.249op/s |10740459.877op/s |10758683.428op/s |0.51% |-8.621 |100.013 |0.31%|2386.422op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|85.200µs |85.357µs ± 0.299µs |85.321µs ± 0.025µs |85.346µs |85.394µs |86.132µs |89.026µs |4.34% |10.181 |115.638 |0.35%|0.021µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |11232642.592op/s |11715582.494op/s ± 39622.291op/s |11720467.253op/s ± 3483.139op/s |11723937.730op/s |11727359.154op/s |11734364.478op/s |11737024.992op/s |0.14% |-10.036 |112.728 |0.34%|2801.719op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|4.598µs |4.612µs ± 0.009µs |4.609µs ± 0.007µs |4.619µs |4.628µs |4.630µs |4.631µs |0.46% |0.359 |-0.927 |0.19%|0.001µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |215957442.040op/s|216833200.971op/s ± 412339.827op/s|216946156.711op/s ± 336363.387op/s|217192624.709op/s|217391495.086op/s|217411522.980op/s|217465160.687op/s|0.24% |-0.353 |-0.932 |0.19%|29156.829op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|81.673µs |82.057µs ± 0.232µs |82.069µs ± 0.131µs |82.162µs |82.451µs |82.796µs |83.058µs |1.21% |1.117 |2.708 |0.28%|0.016µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |12039799.630op/s |12186704.092op/s ± 34320.133op/s |12184906.573op/s ± 19434.615op/s |12209162.991op/s |12233555.115op/s |12241524.269op/s |12243875.929op/s |0.48% |-1.088 |2.595 |0.28%|2426.800op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|58.863µs |58.896µs ± 0.026µs |58.895µs ± 0.017µs |58.907µs |58.939µs |58.966µs |59.086µs |0.32% |2.519 |13.934 |0.04%|0.002µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |16924365.013op/s |16979210.764op/s ± 7439.325op/s |16979341.239op/s ± 4899.085op/s |16984781.211op/s |16986897.496op/s |16988451.607op/s |16988614.231op/s |0.05% |-2.507 |13.812 |0.04%|526.040op/s |1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|6.819µs |6.829µs ± 0.022µs |6.823µs ± 0.002µs |6.824µs |6.868µs |6.927µs |6.984µs |2.35% |4.398 |22.421 |0.32%|0.002µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |143193110.444op/s|146431310.208op/s ± 464897.545op/s|146560100.210op/s ± 45499.177op/s |146611038.984op/s|146640120.027op/s|146649400.850op/s|146656051.562op/s|0.07% |-4.350 |21.899 |0.32%|32873.221op/s|1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|4.600µs |4.615µs ± 0.008µs |4.615µs ± 0.005µs |4.620µs |4.629µs |4.633µs |4.634µs |0.42% |0.186 |-0.676 |0.18%|0.001µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |215792166.177op/s|216689412.419op/s ± 392470.606op/s|216701219.972op/s ± 255139.271op/s|216981846.041op/s|217351106.791op/s|217389370.865op/s|217410697.729op/s|0.33% |-0.179 |-0.680 |0.18%|27751.863op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|73.422µs |73.722µs ± 0.129µs |73.735µs ± 0.075µs |73.806µs |73.882µs |73.929µs |74.589µs |1.16% |1.109 |8.929 |0.18%|0.009µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |13406793.360op/s |13564590.096op/s ± 23757.019op/s |13562094.624op/s ± 13748.370op/s |13578368.981op/s |13606078.924op/s |13616181.189op/s |13619812.742op/s |0.43% |-1.059 |8.570 |0.17%|1679.875op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|65.261µs |65.477µs ± 0.141µs |65.473µs ± 0.114µs |65.577µs |65.715µs |65.752µs |65.764µs |0.45% |0.197 |-1.106 |0.21%|0.010µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |15205807.625op/s |15272529.476op/s ± 32835.426op/s |15273492.091op/s ± 26622.051op/s |15303777.364op/s |15318265.040op/s |15319988.801op/s |15322982.942op/s |0.32% |-0.191 |-1.110 |0.21%|2321.815op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|4.588µs |4.613µs ± 0.009µs |4.613µs ± 0.006µs |4.619µs |4.629µs |4.631µs |4.633µs |0.43% |0.194 |-0.477 |0.18%|0.001µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |215859578.418op/s|216771002.483op/s ± 400455.347op/s|216790196.290op/s ± 292807.354op/s|217081545.296op/s|217372239.024op/s|217416120.004op/s|217939133.790op/s|0.53% |-0.186 |-0.478 |0.18%|28316.469op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|62.183µs |62.544µs ± 0.147µs |62.523µs ± 0.078µs |62.644µs |62.776µs |63.018µs |63.095µs |0.92% |0.517 |1.021 |0.24%|0.010µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |15849127.333op/s |15988747.457op/s ± 37652.454op/s |15994198.378op/s ± 19831.977op/s |16005795.092op/s |16044073.971op/s |16066057.452op/s |16081506.268op/s |0.55% |-0.498 |0.981 |0.23%|2662.431op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|58.863µs |58.892µs ± 0.020µs |58.892µs ± 0.015µs |58.904µs |58.929µs |58.953µs |58.970µs |0.13% |0.872 |0.997 |0.03%|0.001µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |16957792.056op/s |16980122.767op/s ± 5873.643op/s |16980379.173op/s ± 4436.402op/s |16985108.731op/s |16987634.786op/s |16988509.006op/s |16988559.904op/s |0.05% |-0.870 |0.989 |0.03%|415.329op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|6.818µs |6.835µs ± 0.027µs |6.823µs ± 0.003µs |6.828µs |6.901µs |6.916µs |6.958µs |1.98% |2.127 |3.791 |0.39%|0.002µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |143711816.719op/s|146307353.754op/s ± 574236.301op/s|146557394.866op/s ± 62289.319op/s |146614820.978op/s|146644320.560op/s|146651566.131op/s|146663647.790op/s|0.07% |-2.112 |3.697 |0.39%|40604.638op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[4.610µs; 4.613µs] or [-0.027%; +0.027%] |None |None |None | |credit_card/is_card_number/ |throughput |[216800164.869op/s; 216915435.843op/s] or [-0.027%; +0.027%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[93.432µs; 93.516µs] or [-0.045%; +0.045%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[10693555.846op/s; 10702910.450op/s] or [-0.044%; +0.044%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[85.316µs; 85.399µs] or [-0.049%; +0.049%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[11710091.226op/s; 11721073.762op/s] or [-0.047%; +0.047%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[4.611µs; 4.613µs] or [-0.026%; +0.026%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[216776054.636op/s; 216890347.305op/s] or [-0.026%; +0.026%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[82.025µs; 82.089µs] or [-0.039%; +0.039%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[12181947.651op/s; 12191460.532op/s] or [-0.039%; +0.039%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[58.892µs; 58.899µs] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[16978179.745op/s; 16980241.783op/s] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[6.826µs; 6.832µs] or [-0.045%; +0.045%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[146366879.879op/s; 146495740.537op/s] or [-0.044%; +0.044%]|None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[4.614µs; 4.616µs] or [-0.025%; +0.025%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[216635019.768op/s; 216743805.070op/s] or [-0.025%; +0.025%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[73.704µs; 73.740µs] or [-0.024%; +0.024%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[13561297.602op/s; 13567882.590op/s] or [-0.024%; +0.024%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[65.458µs; 65.497µs] or [-0.030%; +0.030%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[15267978.802op/s; 15277080.150op/s] or [-0.030%; +0.030%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[4.612µs; 4.614µs] or [-0.026%; +0.026%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[216715503.224op/s; 216826501.743op/s] or [-0.026%; +0.026%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[62.524µs; 62.565µs] or [-0.033%; +0.033%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[15983529.189op/s; 15993965.725op/s] or [-0.033%; +0.033%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[58.890µs; 58.895µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[16979308.736op/s; 16980936.797op/s] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[6.831µs; 6.839µs] or [-0.055%; +0.055%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[146227770.126op/s; 146386937.383op/s] or [-0.054%; +0.054%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|293.251ns|303.998ns ± 13.000ns|299.399ns ± 4.608ns|307.523ns|339.400ns|344.051ns|344.912ns|15.20% |1.886 |2.664 |4.27%|0.919ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[302.197ns; 305.800ns] or [-0.593%; +0.593%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|140.396µs|141.432µs ± 0.649µs|141.382µs ± 0.169µs|141.567µs|141.837µs|142.740µs|149.310µs|5.61% |9.122 |107.423 |0.46%|0.046µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[141.342µs; 141.522µs] or [-0.064%; +0.064%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|37.064µs|37.396µs ± 0.541µs|37.159µs ± 0.039µs|37.222µs|38.477µs|38.518µs|40.481µs|8.94% |2.159 |4.966 |1.44%|0.038µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[37.321µs; 37.471µs] or [-0.201%; +0.201%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|--------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|505.818µs |507.049µs ± 0.588µs |507.036µs ± 0.376µs |507.410µs |507.911µs |508.636µs |509.283µs |0.44% |0.358 |0.903 |0.12%|0.042µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1963546.188op/s |1972196.921op/s ± 2287.195op/s |1972246.203op/s ± 1463.175op/s |1973705.082op/s |1976057.472op/s |1976920.718op/s |1976994.069op/s |0.24% |-0.348 |0.881 |0.12%|161.729op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|467.793µs |468.517µs ± 0.554µs |468.484µs ± 0.206µs |468.691µs |469.060µs |469.286µs |474.861µs |1.36% |7.554 |84.185 |0.12%|0.039µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2105881.272op/s |2134397.416op/s ± 2501.454op/s |2134542.458op/s ± 940.925op/s |2135481.823op/s |2136902.924op/s |2137157.180op/s |2137698.378op/s |0.15% |-7.452 |82.634 |0.12%|176.879op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|179.726µs |180.181µs ± 0.181µs |180.164µs ± 0.112µs |180.278µs |180.474µs |180.623µs |181.051µs |0.49% |0.767 |2.210 |0.10%|0.013µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5523305.588op/s |5549984.117op/s ± 5565.349op/s |5550501.818op/s ± 3461.398op/s |5553843.873op/s |5558618.369op/s |5560707.566op/s |5564016.933op/s |0.24% |-0.757 |2.170 |0.10%|393.530op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|44.726µs |44.954µs ± 0.083µs |44.954µs ± 0.051µs |45.008µs |45.084µs |45.179µs |45.182µs |0.51% |0.197 |0.202 |0.18%|0.006µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |22132565.276op/s|22245041.826op/s ± 41149.395op/s|22245201.928op/s ± 25475.987op/s|22269599.964op/s|22312895.045op/s|22331034.092op/s|22358225.068op/s|0.51% |-0.185 |0.194 |0.18%|2909.702op/s|1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|48.966µs |49.151µs ± 0.093µs |49.140µs ± 0.062µs |49.207µs |49.298µs |49.423µs |49.445µs |0.62% |0.489 |0.088 |0.19%|0.007µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |20224299.377op/s|20345740.687op/s ± 38330.090op/s|20350047.148op/s ± 25596.815op/s|20373970.224op/s|20402592.622op/s|20412853.497op/s|20422490.881op/s|0.36% |-0.479 |0.070 |0.19%|2710.347op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[506.968µs; 507.131µs] or [-0.016%; +0.016%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1971879.938op/s; 1972513.905op/s] or [-0.016%; +0.016%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[468.440µs; 468.594µs] or [-0.016%; +0.016%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2134050.739op/s; 2134744.094op/s] or [-0.016%; +0.016%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[180.156µs; 180.206µs] or [-0.014%; +0.014%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5549212.814op/s; 5550755.421op/s] or [-0.014%; +0.014%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[44.942µs; 44.966µs] or [-0.026%; +0.026%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[22239338.915op/s; 22250744.736op/s] or [-0.026%; +0.026%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[49.138µs; 49.163µs] or [-0.026%; +0.026%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[20340428.505op/s; 20351052.869op/s] or [-0.026%; +0.026%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.716µs|2.757µs ± 0.018µs|2.756µs ± 0.009µs|2.764µs|2.802µs|2.810µs|2.813µs|2.07% |0.944 |1.300 |0.67%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.755µs; 2.760µs] or [-0.093%; +0.093%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|9.008ms|9.049ms ± 0.016ms|9.049ms ± 0.009ms|9.057ms|9.072ms|9.092ms|9.161ms|1.24% |1.645 |10.853 |0.18%|0.001ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[9.047ms; 9.051ms] or [-0.025%; +0.025%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|68.953µs|69.143µs ± 0.187µs|69.117µs ± 0.023µs|69.146µs|69.228µs|69.431µs|71.451µs|3.38% |10.277 |118.299 |0.27%|0.013µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[69.117µs; 69.169µs] or [-0.038%; +0.038%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|d8acbcde |1731433340 |ban/tmp-test-benchmark-comments-2| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|---------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|271.821µs |273.203µs ± 0.758µs |273.018µs ± 0.435µs |273.582µs |274.528µs |275.497µs |275.906µs |1.06% |1.017 |1.020 |0.28%|0.054µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |3624428.065op/s |3660306.633op/s ± 10133.105op/s |3662757.243op/s ± 5843.912op/s |3667312.982op/s |3672380.969op/s |3676795.694op/s |3678895.233op/s |0.44% |-1.001 |0.975 |0.28%|716.519op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|25.775µs |25.922µs ± 0.149µs |25.863µs ± 0.037µs |25.926µs |26.266µs |26.376µs |26.424µs |2.17% |1.726 |1.794 |0.57%|0.011µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |37844937.865op/s|38578908.544op/s ± 219852.908op/s|38665218.307op/s ± 54857.125op/s |38708653.751op/s|38762209.302op/s|38776443.460op/s|38796545.790op/s|0.34% |-1.712 |1.741 |0.57%|15545.948op/s|1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|15.457µs |15.610µs ± 0.097µs |15.599µs ± 0.094µs |15.700µs |15.750µs |15.781µs |15.784µs |1.18% |0.092 |-1.374 |0.62%|0.007µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |63354794.770op/s|64063471.883op/s ± 397115.016op/s|64104875.869op/s ± 383804.165op/s|64422621.083op/s|64621336.744op/s|64655130.269op/s|64694177.147op/s|0.92% |-0.081 |-1.376 |0.62%|28080.272op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[273.098µs; 273.308µs] or [-0.038%; +0.038%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[3658902.283op/s; 3661710.984op/s] or [-0.038%; +0.038%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[25.901µs; 25.942µs] or [-0.080%; +0.080%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[38548439.045op/s; 38609378.042op/s] or [-0.079%; +0.079%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[15.597µs; 15.624µs] or [-0.086%; +0.086%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[64008435.562op/s; 64118508.205op/s] or [-0.086%; +0.086%]|None |None |None |

Baseline

Omitted due to size.