pr-commenter[bot]
commented
3 weeks ago Benchmarks
Comparison
Benchmark execution time: 2024-10-11 03:09:17
Comparing candidate commit 14f541f in PR branch bob/update-deps with baseline commit dab84ba in branch main.
Found 33 performance improvements and 10 performance regressions! Performance is the same for 8 metrics, 2 unstable metrics.
scenario:benching string interning on wordpress profile
- 🟥
execution_time[+3.646µs; +3.837µs] or [+2.626%; +2.763%]
scenario:concentrator/add_spans_to_concentrator
- 🟥
execution_time[+331.583µs; +336.780µs] or [+3.696%; +3.754%]
scenario:credit_card/is_card_number/
- 🟩
execution_time[-400.846ns; -400.371ns] or [-19.895%; -19.872%] - 🟩
throughput[+123115218.790op/s; +123243124.800op/s] or [+24.805%; +24.831%]
scenario:credit_card/is_card_number/ 3782-8224-6310-005
- 🟩
execution_time[-13.780µs; -13.527µs] or [-10.979%; -10.778%] - 🟩
throughput[+963414.410op/s; +982177.624op/s] or [+12.092%; +12.327%]
scenario:credit_card/is_card_number/ 378282246310005
- 🟩
execution_time[-9.180µs; -8.924µs] or [-7.841%; -7.622%] - 🟩
throughput[+705473.248op/s; +726328.555op/s] or [+8.260%; +8.504%]
scenario:credit_card/is_card_number/37828224631
- 🟩
execution_time[-400.668ns; -400.203ns] or [-19.886%; -19.863%] - 🟩
throughput[+123042863.879op/s; +123182249.007op/s] or [+24.791%; +24.819%]
scenario:credit_card/is_card_number/378282246310005
- 🟩
execution_time[-9.549µs; -9.298µs] or [-8.444%; -8.222%] - 🟩
throughput[+793172.075op/s; +814414.065op/s] or [+8.970%; +9.210%]
scenario:credit_card/is_card_number/37828224631000521389798
- 🟩
execution_time[-5.325µs; -5.129µs] or [-4.691%; -4.519%] - 🟩
throughput[+417291.538op/s; +433613.231op/s] or [+4.737%; +4.922%]
scenario:credit_card/is_card_number/x371413321323331
- 🟥
execution_time[+819.190ns; +1002.550ns] or [+3.403%; +4.165%] - 🟥
throughput[-1657742.575op/s; -1354492.031op/s] or [-3.990%; -3.260%]
scenario:credit_card/is_card_number_no_luhn/
- 🟩
execution_time[-400.381ns; -400.098ns] or [-19.875%; -19.861%] - 🟩
throughput[+123038233.396op/s; +123126385.884op/s] or [+24.786%; +24.803%]
scenario:credit_card/is_card_number_no_luhn/ 3782-8224-6310-005
- 🟩
execution_time[-8.242µs; -8.084µs] or [-8.354%; -8.193%] - 🟩
throughput[+905613.935op/s; +922384.677op/s] or [+8.935%; +9.100%]
scenario:credit_card/is_card_number_no_luhn/ 378282246310005
- 🟩
execution_time[-5.961µs; -5.708µs] or [-6.570%; -6.291%] - 🟩
throughput[+741070.907op/s; +773470.859op/s] or [+6.723%; +7.017%]
scenario:credit_card/is_card_number_no_luhn/37828224631
- 🟩
execution_time[-400.349ns; -399.977ns] or [-19.874%; -19.856%] - 🟩
throughput[+123004228.619op/s; +123110783.566op/s] or [+24.778%; +24.800%]
scenario:credit_card/is_card_number_no_luhn/378282246310005
- 🟩
execution_time[-4.765µs; -4.489µs] or [-5.511%; -5.191%] - 🟩
throughput[+634599.682op/s; +674716.639op/s] or [+5.487%; +5.834%]
scenario:credit_card/is_card_number_no_luhn/37828224631000521389798
- 🟩
execution_time[-5.082µs; -4.896µs] or [-4.484%; -4.319%] - 🟩
throughput[+398532.744op/s; +414138.537op/s] or [+4.518%; +4.695%]
scenario:credit_card/is_card_number_no_luhn/x371413321323331
- 🟥
execution_time[+1.248µs; +1.403µs] or [+5.283%; +5.941%] - 🟥
throughput[-2360649.001op/s; -2106775.549op/s] or [-5.575%; -4.975%]
scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...
- 🟩
execution_time[-79.096µs; -78.794µs] or [-29.098%; -28.987%] - 🟩
throughput[+1502584.528op/s; +1508944.404op/s] or [+40.844%; +41.017%]
scenario:normalization/normalize_name/normalize_name/bad-name
- 🟩
execution_time[-8.418µs; -8.401µs] or [-31.628%; -31.563%] - 🟩
throughput[+17336923.586op/s; +17371085.014op/s] or [+46.144%; +46.235%]
scenario:normalization/normalize_name/normalize_name/good
- 🟩
execution_time[-4.899µs; -4.887µs] or [-30.346%; -30.273%] - 🟩
throughput[+26906323.959op/s; +26974267.755op/s] or [+43.437%; +43.547%]
scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...
- 🟥
execution_time[+117.471µs; +117.751µs] or [+23.169%; +23.225%] - 🟥
throughput[-371888.705op/s; -370877.536op/s] or [-18.855%; -18.804%]
scenario:normalization/normalize_service/normalize_service/[empty string]
- 🟥
execution_time[+2.317µs; +2.348µs] or [+5.209%; +5.278%] - 🟥
throughput[-1127663.057op/s; -1112804.866op/s] or [-5.016%; -4.950%]
scenario:normalization/normalize_trace/test_trace
- 🟩
execution_time[-37.381ns; -31.355ns] or [-12.326%; -10.339%]
scenario:sql/obfuscate_sql_string
- 🟩
execution_time[-6.946µs; -6.884µs] or [-9.367%; -9.283%]
scenario:tags/replace_trace_tags
- 🟩
execution_time[-62.736ns; -55.589ns] or [-2.299%; -2.037%]
Candidate
Candidate benchmark details
### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|67.069µs|67.239µs ± 0.141µs|67.223µs ± 0.033µs|67.261µs|67.315µs|67.488µs|69.047µs|2.71% |10.682 |133.369 |0.21%|0.010µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[67.219µs; 67.259µs] or [-0.029%; +0.029%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|9.275ms|9.305ms ± 0.013ms|9.304ms ± 0.008ms|9.313ms|9.327ms|9.331ms|9.363ms|0.63% |0.444 |1.256 |0.14%|0.001ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[9.303ms; 9.307ms] or [-0.019%; +0.019%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|256.695ns|268.910ns ± 15.860ns|262.180ns ± 3.042ns|268.728ns|309.579ns|315.600ns|318.084ns|21.32% |1.848 |2.241 |5.88%|1.121ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[266.711ns; 271.108ns] or [-0.817%; +0.817%]|None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|36.607µs|37.167µs ± 1.003µs|36.712µs ± 0.048µs|36.772µs|39.314µs|39.414µs|40.484µs|10.27% |1.727 |1.110 |2.69%|0.071µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[37.028µs; 37.306µs] or [-0.374%; +0.374%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|1.131µs|1.193µs ± 0.024µs|1.198µs ± 0.013µs|1.212µs|1.216µs|1.218µs|1.219µs|1.75% |-1.299 |0.887 |1.98%|0.002µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[1.190µs; 1.197µs] or [-0.274%; +0.274%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|190.777µs |192.882µs ± 0.758µs |192.928µs ± 0.488µs |193.350µs |194.081µs |194.562µs |195.969µs |1.58% |0.264 |0.844 |0.39%|0.054µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |5102854.067op/s |5184608.644op/s ± 20361.658op/s |5183277.274op/s ± 13123.287op/s |5198042.539op/s |5214841.593op/s |5229739.577op/s |5241732.856op/s |1.13% |-0.231 |0.783 |0.39%|1439.787op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|18.169µs |18.207µs ± 0.032µs |18.207µs ± 0.029µs |18.224µs |18.266µs |18.279µs |18.307µs |0.55% |0.705 |-0.501 |0.18%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |54624653.927op/s|54925529.430op/s ± 97762.135op/s |54923865.905op/s ± 86716.584op/s|55013983.897op/s|55028993.931op/s|55037785.369op/s|55039941.592op/s|0.21% |-0.700 |-0.514 |0.18%|6912.827op/s |1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|11.222µs |11.251µs ± 0.027µs |11.238µs ± 0.010µs |11.268µs |11.301µs |11.336µs |11.362µs |1.10% |1.386 |1.707 |0.24%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |88013702.633op/s|88883517.783op/s ± 209911.598op/s|88983402.858op/s ± 78352.424op/s|89040365.720op/s|89076872.021op/s|89099751.498op/s|89110799.533op/s|0.14% |-1.374 |1.649 |0.24%|14842.991op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[192.776µs; 192.987µs] or [-0.054%; +0.054%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[5181786.714op/s; 5187430.574op/s] or [-0.054%; +0.054%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[18.202µs; 18.211µs] or [-0.025%; +0.025%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[54911980.539op/s; 54939078.322op/s] or [-0.025%; +0.025%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[11.247µs; 11.254µs] or [-0.033%; +0.033%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[88854426.055op/s; 88912609.512op/s] or [-0.033%; +0.033%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|---------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|17.904µs|23.575µs ± 11.065µs|18.511µs ± 0.195µs|19.311µs|45.067µs|48.262µs|100.639µs|443.68% |3.134 |14.287 |46.82%|0.782µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[22.042µs; 25.109µs] or [-6.505%; +6.505%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.383µs|3.191µs ± 1.399µs|3.041µs ± 0.024µs|3.064µs|3.096µs|13.807µs|14.886µs|389.57% |7.604 |57.909 |43.74%|0.099µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[2.997µs; 3.385µs] or [-6.077%; +6.077%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|----------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|-------------|----|-----------| |credit_card/is_card_number/ |execution_time|1.613µs |1.614µs ± 0.001µs |1.614µs ± 0.000µs |1.615µs |1.615µs |1.616µs |1.618µs |0.27% |1.848 |7.837 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number/ |throughput |617910795.226op/s|619509184.096op/s ± 245051.418op/s|619578469.616op/s ± 145188.652op/s|619693359.821op/s|619782809.995op/s|619842332.724op/s|619885134.634op/s|0.05% |-1.840 |7.773 |0.04%|17327.752op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|110.219µs |111.856µs ± 0.742µs |111.807µs ± 0.461µs |112.247µs |112.877µs |114.037µs |116.551µs |4.24% |1.580 |7.573 |0.66%|0.052µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |8579926.785op/s |8940480.943op/s ± 58705.421op/s |8943961.618op/s ± 36991.577op/s |8980929.446op/s |9018859.476op/s |9052383.900op/s |9072847.709op/s |1.44% |-1.445 |6.667 |0.65%|4151.100op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|106.400µs |108.035µs ± 0.759µs |107.797µs ± 0.436µs |108.538µs |109.410µs |109.936µs |110.383µs |2.40% |0.794 |0.079 |0.70%|0.054µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |9059341.316op/s |9256716.178op/s ± 64722.265op/s |9276714.991op/s ± 37376.663op/s |9305492.801op/s |9332552.223op/s |9369551.053op/s |9398524.735op/s |1.31% |-0.763 |0.025 |0.70%|4576.555op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|1.613µs |1.614µs ± 0.001µs |1.614µs ± 0.000µs |1.615µs |1.616µs |1.618µs |1.624µs |0.61% |5.530 |47.693 |0.06%|0.000µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |615739865.211op/s|619441928.689op/s ± 375822.969op/s|619509985.249op/s ± 152910.535op/s|619656667.606op/s|619731528.726op/s|619796572.826op/s|619818424.013op/s|0.05% |-5.495 |47.211 |0.06%|26574.697op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|102.487µs |103.667µs ± 0.591µs |103.577µs ± 0.379µs |104.020µs |104.607µs |105.608µs |106.114µs |2.45% |0.960 |1.460 |0.57%|0.042µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |9423788.752op/s |9646602.518op/s ± 54735.611op/s |9654644.893op/s ± 35464.898op/s |9683526.432op/s |9719261.296op/s |9738482.014op/s |9757334.095op/s |1.06% |-0.917 |1.313 |0.57%|3870.392op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|106.211µs |108.285µs ± 0.598µs |108.469µs ± 0.358µs |108.711µs |108.992µs |109.140µs |109.549µs |1.00% |-0.845 |0.275 |0.55%|0.042µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |9128337.057op/s |9235134.932op/s ± 51207.062op/s |9219199.743op/s ± 30530.444op/s |9271213.808op/s |9334047.022op/s |9377122.318op/s |9415224.458op/s |2.13% |0.871 |0.344 |0.55%|3620.886op/s |1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|23.541µs |24.984µs ± 0.539µs |25.029µs ± 0.326µs |25.357µs |25.744µs |26.024µs |26.096µs |4.26% |-0.431 |-0.133 |2.15%|0.038µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |38320620.316op/s |40043881.120op/s ± 873443.930op/s |39954430.319op/s ± 520338.331op/s |40470287.208op/s |41694090.564op/s |42261945.638op/s |42479074.554op/s |6.32% |0.541 |-0.010 |2.18%|61761.813op/s|1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|1.613µs |1.614µs ± 0.001µs |1.614µs ± 0.000µs |1.615µs |1.616µs |1.616µs |1.617µs |0.17% |1.169 |1.370 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |618528584.785op/s|619491740.455op/s ± 253765.020op/s|619575093.081op/s ± 143954.948op/s|619689436.682op/s|619773893.063op/s|619841888.962op/s|619864806.245op/s|0.05% |-1.167 |1.361 |0.04%|17943.897op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|89.571µs |90.499µs ± 0.236µs |90.509µs ± 0.074µs |90.607µs |90.792µs |91.010µs |91.551µs |1.15% |-0.761 |4.532 |0.26%|0.017µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |10922856.392op/s |11049859.842op/s ± 28867.228op/s |11048611.252op/s ± 9080.115op/s |11055209.818op/s |11102936.175op/s |11152207.388op/s |11164388.377op/s |1.05% |0.808 |4.535 |0.26%|2041.221op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|83.761µs |84.898µs ± 0.571µs |84.824µs ± 0.249µs |84.988µs |86.046µs |86.959µs |87.868µs |3.59% |1.827 |4.938 |0.67%|0.040µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |11380738.159op/s |11779388.225op/s ± 78320.180op/s |11789047.976op/s ± 34583.613op/s |11827573.920op/s |11864078.484op/s |11896660.821op/s |11938688.159op/s |1.27% |-1.756 |4.576 |0.66%|5538.073op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|1.613µs |1.614µs ± 0.001µs |1.614µs ± 0.000µs |1.615µs |1.615µs |1.616µs |1.617µs |0.18% |1.123 |1.630 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |618377961.473op/s|619475496.377op/s ± 257233.031op/s|619502800.014op/s ± 179772.690op/s|619691327.010op/s|619760387.793op/s|619812658.343op/s|619871193.647op/s|0.06% |-1.120 |1.617 |0.04%|18189.122op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|79.436µs |81.842µs ± 0.839µs |81.913µs ± 0.551µs |82.459µs |83.052µs |83.615µs |84.460µs |3.11% |-0.204 |0.101 |1.02%|0.059µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |11839983.012op/s |12219928.632op/s ± 125546.167op/s |12208106.276op/s ± 81567.007op/s |12293169.286op/s |12428418.888op/s |12502063.592op/s |12588689.347op/s |3.12% |0.267 |0.112 |1.02%|8877.455op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|106.373µs |108.369µs ± 0.584µs |108.528µs ± 0.309µs |108.800µs |109.030µs |109.421µs |109.482µs |0.88% |-1.016 |0.774 |0.54%|0.041µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |9133960.133op/s |9227997.625op/s ± 50024.233op/s |9214197.860op/s ± 26196.836op/s |9259383.527op/s |9326088.826op/s |9377947.835op/s |9400886.554op/s |2.03% |1.045 |0.848 |0.54%|3537.247op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|23.243µs |24.942µs ± 0.536µs |24.989µs ± 0.396µs |25.313µs |25.724µs |25.963µs |26.146µs |4.63% |-0.248 |-0.219 |2.14%|0.038µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |38247322.640op/s |40111588.608op/s ± 866891.928op/s |40017994.501op/s ± 625282.285op/s |40785674.512op/s |41450313.723op/s |42245313.434op/s |43024066.118op/s |7.51% |0.361 |-0.070 |2.16%|61298.516op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[1.614µs; 1.614µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number/ |throughput |[619475222.326op/s; 619543145.866op/s] or [-0.005%; +0.005%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[111.753µs; 111.958µs] or [-0.092%; +0.092%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[8932344.936op/s; 8948616.949op/s] or [-0.091%; +0.091%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[107.930µs; 108.140µs] or [-0.097%; +0.097%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[9247746.295op/s; 9265686.062op/s] or [-0.097%; +0.097%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[1.614µs; 1.614µs] or [-0.008%; +0.008%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[619389843.240op/s; 619494014.138op/s] or [-0.008%; +0.008%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[103.585µs; 103.749µs] or [-0.079%; +0.079%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[9639016.688op/s; 9654188.347op/s] or [-0.079%; +0.079%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[108.203µs; 108.368µs] or [-0.076%; +0.076%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[9228038.125op/s; 9242231.738op/s] or [-0.077%; +0.077%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[24.910µs; 25.059µs] or [-0.299%; +0.299%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[39922830.192op/s; 40164932.049op/s] or [-0.302%; +0.302%] |None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[1.614µs; 1.614µs] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[619456571.063op/s; 619526909.846op/s] or [-0.006%; +0.006%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[90.467µs; 90.532µs] or [-0.036%; +0.036%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[11045859.122op/s; 11053860.562op/s] or [-0.036%; +0.036%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[84.819µs; 84.977µs] or [-0.093%; +0.093%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[11768533.801op/s; 11790242.648op/s] or [-0.092%; +0.092%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[1.614µs; 1.614µs] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[619439846.353op/s; 619511146.401op/s] or [-0.006%; +0.006%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[81.726µs; 81.958µs] or [-0.142%; +0.142%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[12202529.141op/s; 12237328.123op/s] or [-0.142%; +0.142%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[108.288µs; 108.450µs] or [-0.075%; +0.075%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[9221064.747op/s; 9234930.502op/s] or [-0.075%; +0.075%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[24.868µs; 25.016µs] or [-0.298%; +0.298%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[39991445.725op/s; 40231731.492op/s] or [-0.300%; +0.300%] |None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.619µs|2.670µs ± 0.015µs|2.671µs ± 0.007µs|2.680µs|2.686µs|2.688µs|2.692µs|0.78% |-1.689 |3.191 |0.55%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.668µs; 2.672µs] or [-0.077%; +0.077%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|622.635µs |624.621µs ± 0.456µs |624.663µs ± 0.252µs |624.886µs |625.267µs |625.522µs |625.872µs |0.19% |-0.981 |3.007 |0.07%|0.032µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1597769.878op/s |1600971.986op/s ± 1169.765op/s |1600861.904op/s ± 646.259op/s |1601548.423op/s |1602542.747op/s |1605201.815op/s |1606076.476op/s |0.33% |0.990 |3.034 |0.07%|82.715op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|461.929µs |462.946µs ± 0.391µs |462.920µs ± 0.261µs |463.183µs |463.581µs |463.874µs |464.411µs |0.32% |0.381 |0.655 |0.08%|0.028µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2153264.371op/s |2160080.461op/s ± 1824.507op/s |2160202.432op/s ± 1216.405op/s |2161374.229op/s |2162739.303op/s |2164413.182op/s |2164833.376op/s |0.21% |-0.374 |0.645 |0.08%|129.012op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|178.094µs |178.360µs ± 0.126µs |178.352µs ± 0.069µs |178.413µs |178.517µs |178.625µs |179.480µs |0.63% |3.593 |29.777 |0.07%|0.009µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5571650.680op/s |5606628.039op/s ± 3943.498op/s |5606890.130op/s ± 2160.033op/s |5609197.113op/s |5611056.392op/s |5613243.029op/s |5615002.300op/s |0.14% |-3.553 |29.325 |0.07%|278.847op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|46.664µs |46.811µs ± 0.076µs |46.802µs ± 0.050µs |46.856µs |46.941µs |47.001µs |47.131µs |0.70% |0.666 |0.852 |0.16%|0.005µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |21217288.509op/s|21362566.050op/s ± 34718.662op/s |21366571.034op/s ± 22799.519op/s|21388074.670op/s|21415323.548op/s|21427787.133op/s|21429844.843op/s|0.30% |-0.655 |0.818 |0.16%|2454.980op/s |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|48.928µs |49.581µs ± 0.458µs |49.389µs ± 0.208µs |49.931µs |50.447µs |50.736µs |51.470µs |4.21% |1.031 |0.566 |0.92%|0.032µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |19428916.373op/s|20170689.249op/s ± 184677.192op/s|20247509.417op/s ± 85632.456op/s|20303751.201op/s|20376819.283op/s|20426092.525op/s|20438321.187op/s|0.94% |-0.990 |0.408 |0.91%|13058.649op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[624.558µs; 624.684µs] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1600809.868op/s; 1601134.104op/s] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[462.892µs; 463.000µs] or [-0.012%; +0.012%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2159827.601op/s; 2160333.320op/s] or [-0.012%; +0.012%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[178.343µs; 178.378µs] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5606081.508op/s; 5607174.570op/s] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[46.800µs; 46.822µs] or [-0.023%; +0.023%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[21357754.378op/s; 21367377.723op/s] or [-0.023%; +0.023%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[49.518µs; 49.645µs] or [-0.128%; +0.128%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[20145094.766op/s; 20196283.731op/s] or [-0.127%; +0.127%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|14f541f |1728615524 |bob/update-deps| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|140.910µs|142.606µs ± 0.533µs|142.556µs ± 0.203µs|142.774µs|143.275µs|144.510µs|146.315µs|2.64% |3.330 |21.313 |0.37%|0.038µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[142.532µs; 142.680µs] or [-0.052%; +0.052%]|None |None |None |Baseline
Omitted due to size.
Primarily reduces duplicate dependencies with different versions to reduce binary size slightly.
Fixes Datadog/dd-trace-php#2878.