pr-commenter[bot]
commented
6 days ago Benchmarks
Comparison
Benchmark execution time: 2024-11-25 23:29:00
Comparing candidate commit 535f3a1b in PR branch dsn/crashinfo-builder with baseline commit 6fe032fd in branch main.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|---------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|301.410µs |304.718µs ± 1.736µs |304.449µs ± 1.018µs |305.628µs |308.091µs |310.050µs |310.677µs |2.05% |0.931 |1.150 |0.57%|0.123µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |3218778.209op/s |3281830.636op/s ± 18599.500op/s |3284619.387op/s ± 11010.527op/s |3294643.843op/s |3306301.755op/s |3315156.336op/s |3317738.325op/s |1.01% |-0.892 |1.054 |0.57%|1315.183op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|27.893µs |28.204µs ± 0.136µs |28.213µs ± 0.085µs |28.284µs |28.381µs |28.471µs |29.032µs |2.90% |1.114 |6.067 |0.48%|0.010µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |34445138.499op/s|35456334.067op/s ± 170116.615op/s|35444157.929op/s ± 106760.771op/s|35568992.735op/s|35729369.473op/s|35765345.188op/s|35851770.853op/s|1.15% |-1.018 |5.469 |0.48%|12029.061op/s|1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|16.542µs |16.676µs ± 0.052µs |16.672µs ± 0.031µs |16.709µs |16.764µs |16.797µs |16.829µs |0.94% |0.219 |0.268 |0.31%|0.004µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |59419577.380op/s|59965926.852op/s ± 186242.646op/s|59979314.866op/s ± 113165.944op/s|60085930.586op/s|60248925.391op/s|60437548.667op/s|60451901.212op/s|0.79% |-0.198 |0.260 |0.31%|13169.344op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[304.477µs; 304.958µs] or [-0.079%; +0.079%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[3279252.924op/s; 3284408.348op/s] or [-0.079%; +0.079%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[28.186µs; 28.223µs] or [-0.067%; +0.067%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[35432757.540op/s; 35479910.594op/s] or [-0.066%; +0.066%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[16.669µs; 16.683µs] or [-0.043%; +0.043%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[59940115.412op/s; 59991738.291op/s] or [-0.043%; +0.043%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.413µs|3.234µs ± 1.435µs|3.082µs ± 0.023µs|3.101µs|3.133µs|14.206µs|15.219µs|393.75% |7.652 |58.375 |44.26%|0.101µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[3.035µs; 3.432µs] or [-6.150%; +6.150%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|38.081µs|38.704µs ± 1.116µs|38.188µs ± 0.048µs|38.283µs|41.115µs|41.205µs|41.544µs|8.79% |1.694 |0.908 |2.88%|0.079µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[38.549µs; 38.858µs] or [-0.400%; +0.400%]|None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.679µs|2.732µs ± 0.020µs|2.734µs ± 0.007µs|2.744µs|2.762µs|2.773µs|2.776µs|1.52% |-0.825 |0.706 |0.72%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.730µs; 2.735µs] or [-0.100%; +0.100%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|--------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|620.070µs |621.388µs ± 0.509µs |621.388µs ± 0.235µs |621.609µs |621.978µs |622.273µs |625.737µs |0.70% |2.894 |25.456 |0.08%|0.036µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1598116.354op/s |1609300.804op/s ± 1313.994op/s |1609300.383op/s ± 608.067op/s |1609932.295op/s |1611194.000op/s |1612455.093op/s |1612720.451op/s |0.21% |-2.848 |24.988 |0.08%|92.913op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|466.310µs |467.233µs ± 0.803µs |467.148µs ± 0.225µs |467.450µs |467.781µs |467.876µs |477.493µs |2.21% |10.470 |131.487 |0.17%|0.057µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2094269.692op/s |2140263.869op/s ± 3615.123op/s |2140649.457op/s ± 1029.714op/s |2141486.250op/s |2142814.674op/s |2143736.895op/s |2144493.972op/s |0.18% |-10.347 |129.415 |0.17%|255.628op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|191.234µs |191.771µs ± 0.194µs |191.781µs ± 0.128µs |191.889µs |192.120µs |192.237µs |192.303µs |0.27% |0.148 |0.010 |0.10%|0.014µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5200126.190op/s |5214570.653op/s ± 5282.435op/s |5214287.496op/s ± 3488.074op/s |5218774.891op/s |5222670.116op/s |5226047.772op/s |5229183.726op/s |0.29% |-0.142 |0.008 |0.10%|373.525op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|46.999µs |47.313µs ± 0.139µs |47.305µs ± 0.085µs |47.395µs |47.572µs |47.638µs |47.666µs |0.76% |0.250 |-0.265 |0.29%|0.010µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |20979512.767op/s|21136196.309op/s ± 62047.713op/s|21139612.735op/s ± 37904.430op/s|21174972.377op/s|21231856.021op/s|21266781.893op/s|21276901.795op/s|0.65% |-0.235 |-0.272 |0.29%|4387.436op/s|1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|51.186µs |51.588µs ± 0.206µs |51.596µs ± 0.095µs |51.691µs |51.817µs |51.959µs |52.913µs |2.55% |2.202 |13.783 |0.40%|0.015µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |18898905.309op/s|19384653.635op/s ± 76586.335op/s|19381380.537op/s ± 35796.138op/s|19417521.289op/s|19500011.451op/s|19522512.823op/s|19536618.979op/s|0.80% |-2.074 |12.867 |0.39%|5415.472op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[621.318µs; 621.459µs] or [-0.011%; +0.011%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1609118.697op/s; 1609482.911op/s] or [-0.011%; +0.011%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[467.122µs; 467.345µs] or [-0.024%; +0.024%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2139762.848op/s; 2140764.890op/s] or [-0.023%; +0.023%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[191.744µs; 191.797µs] or [-0.014%; +0.014%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5213838.558op/s; 5215302.747op/s] or [-0.014%; +0.014%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[47.293µs; 47.332µs] or [-0.041%; +0.041%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[21127597.093op/s; 21144795.525op/s] or [-0.041%; +0.041%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[51.560µs; 51.616µs] or [-0.055%; +0.055%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[19374039.506op/s; 19395267.765op/s] or [-0.055%; +0.055%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|---------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|18.228µs|24.999µs ± 14.290µs|18.449µs ± 0.122µs|27.299µs|47.104µs|59.556µs|152.750µs|727.97% |4.475 |32.208 |57.02%|1.010µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[23.019µs; 26.980µs] or [-7.922%; +7.922%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|138.009µs|138.882µs ± 0.414µs|138.837µs ± 0.187µs|139.033µs|139.591µs|139.893µs|142.249µs|2.46% |2.998 |20.913 |0.30%|0.029µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[138.824µs; 138.939µs] or [-0.041%; +0.041%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|300.006ns|310.597ns ± 13.674ns|303.506ns ± 2.246ns|316.784ns|341.543ns|352.400ns|357.682ns|17.85% |1.698 |1.947 |4.39%|0.967ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[308.701ns; 312.492ns] or [-0.610%; +0.610%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|8.984ms|9.011ms ± 0.015ms|9.010ms ± 0.010ms|9.021ms|9.037ms|9.047ms|9.092ms|0.91% |1.005 |3.090 |0.17%|0.001ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[9.009ms; 9.013ms] or [-0.023%; +0.023%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|60.377ms|60.607ms ± 0.086ms|60.606ms ± 0.044ms|60.649ms|60.733ms|60.885ms|61.101ms|0.82% |1.249 |5.702 |0.14%|0.006ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[60.595ms; 60.619ms] or [-0.020%; +0.020%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|69.866µs|70.025µs ± 0.137µs|70.010µs ± 0.037µs|70.048µs|70.128µs|70.251µs|71.593µs|2.26% |8.060 |86.798 |0.19%|0.010µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[70.006µs; 70.044µs] or [-0.027%; +0.027%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|535f3a1b |1732576674 |dsn/crashinfo-builder| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|----------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|-------------|----|-----------| |credit_card/is_card_number/ |execution_time|4.617µs |4.631µs ± 0.005µs |4.630µs ± 0.003µs |4.633µs |4.639µs |4.643µs |4.669µs |0.85% |1.963 |11.894 |0.12%|0.000µs |1 |200 | |credit_card/is_card_number/ |throughput |214166350.540op/s|215959419.234op/s ± 254043.449op/s|215985788.145op/s ± 143846.412op/s|216118941.059op/s|216324566.935op/s|216404675.683op/s|216583258.716op/s|0.28% |-1.928 |11.606 |0.12%|17963.585op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|90.834µs |91.777µs ± 0.564µs |91.726µs ± 0.376µs |92.115µs |92.673µs |92.921µs |95.600µs |4.22% |1.721 |9.072 |0.61%|0.040µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |10460271.935op/s |10896331.358op/s ± 66235.741op/s |10902038.642op/s ± 44905.354op/s |10945336.543op/s |10986788.512op/s |10999341.113op/s |11009051.642op/s |0.98% |-1.579 |7.909 |0.61%|4683.574op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|83.743µs |84.042µs ± 0.360µs |83.990µs ± 0.044µs |84.039µs |84.320µs |84.729µs |88.701µs |5.61% |11.051 |139.018 |0.43%|0.025µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |11273852.488op/s |11898979.387op/s ± 48683.402op/s |11906227.552op/s ± 6210.892op/s |11911780.155op/s |11921904.115op/s |11930259.181op/s |11941282.207op/s |0.29% |-10.809 |134.597 |0.41%|3442.436op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|4.616µs |4.633µs ± 0.006µs |4.633µs ± 0.003µs |4.635µs |4.640µs |4.642µs |4.690µs |1.24% |4.540 |44.418 |0.13%|0.000µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |213224520.385op/s|215846151.113op/s ± 269543.190op/s|215860338.363op/s ± 129650.501op/s|215989313.929op/s|216184340.387op/s|216314286.601op/s|216629416.770op/s|0.36% |-4.444 |43.260 |0.12%|19059.582op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|81.022µs |81.205µs ± 0.130µs |81.175µs ± 0.036µs |81.211µs |81.447µs |81.680µs |81.892µs |0.88% |2.593 |7.875 |0.16%|0.009µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |12211266.331op/s |12314604.007op/s ± 19595.741op/s |12319073.542op/s ± 5391.137op/s |12324396.299op/s |12332844.947op/s |12340545.180op/s |12342352.574op/s |0.19% |-2.578 |7.785 |0.16%|1385.628op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|59.266µs |59.669µs ± 0.152µs |59.662µs ± 0.108µs |59.782µs |59.898µs |59.979µs |60.107µs |0.75% |-0.176 |-0.172 |0.25%|0.011µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |16636946.583op/s |16759251.112op/s ± 42833.979op/s |16761175.573op/s ± 30300.804op/s |16783205.672op/s |16837173.854op/s |16857454.606op/s |16872949.288op/s |0.67% |0.189 |-0.168 |0.25%|3028.820op/s |1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|6.832µs |6.843µs ± 0.007µs |6.843µs ± 0.002µs |6.845µs |6.849µs |6.854µs |6.904µs |0.90% |5.985 |48.836 |0.11%|0.001µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |144842305.295op/s|146135157.679op/s ± 153039.380op/s|146143813.916op/s ± 47226.555op/s |146192144.924op/s|146278761.484op/s|146358440.033op/s|146373894.832op/s|0.16% |-5.937 |48.332 |0.10%|10821.518op/s|1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|4.621µs |4.632µs ± 0.004µs |4.632µs ± 0.003µs |4.635µs |4.639µs |4.641µs |4.643µs |0.24% |-0.029 |-0.136 |0.09%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |215381726.950op/s|215887465.614op/s ± 193841.887op/s|215890824.640op/s ± 130103.875op/s|216016881.338op/s|216190168.538op/s|216349093.150op/s|216419883.845op/s|0.25% |0.034 |-0.135 |0.09%|13706.691op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|73.048µs |73.633µs ± 0.151µs |73.647µs ± 0.062µs |73.709µs |73.792µs |73.898µs |74.598µs |1.29% |0.315 |9.174 |0.21%|0.011µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |13405120.381op/s |13580875.528op/s ± 27898.465op/s |13578278.153op/s ± 11426.042op/s |13589688.498op/s |13631294.800op/s |13662215.762op/s |13689683.857op/s |0.82% |-0.248 |8.868 |0.20%|1972.719op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|64.707µs |65.161µs ± 0.225µs |65.144µs ± 0.158µs |65.312µs |65.576µs |65.651µs |65.817µs |1.03% |0.349 |-0.440 |0.34%|0.016µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |15193693.946op/s |15346667.579op/s ± 52879.448op/s |15350544.384op/s ± 37303.034op/s |15387162.497op/s |15428339.546op/s |15443845.154op/s |15454391.732op/s |0.68% |-0.334 |-0.454 |0.34%|3739.142op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|4.620µs |4.631µs ± 0.004µs |4.631µs ± 0.003µs |4.634µs |4.638µs |4.641µs |4.646µs |0.31% |0.170 |0.327 |0.09%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |215257714.033op/s|215919505.140op/s ± 197939.085op/s|215923751.627op/s ± 123661.972op/s|216054381.662op/s|216228014.659op/s|216387116.927op/s|216433703.870op/s|0.24% |-0.164 |0.323 |0.09%|13996.407op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|62.989µs |63.490µs ± 0.153µs |63.529µs ± 0.090µs |63.605µs |63.663µs |63.704µs |63.726µs |0.31% |-1.040 |0.659 |0.24%|0.011µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |15692189.947op/s |15750507.643op/s ± 38138.126op/s |15740848.258op/s ± 22215.731op/s |15767561.792op/s |15827708.224op/s |15858050.841op/s |15875808.574op/s |0.86% |1.051 |0.691 |0.24%|2696.773op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|59.022µs |59.200µs ± 0.130µs |59.166µs ± 0.080µs |59.269µs |59.439µs |59.595µs |59.702µs |0.91% |1.055 |0.971 |0.22%|0.009µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |16749968.854op/s |16892093.768op/s ± 37077.974op/s |16901579.455op/s ± 22964.519op/s |16921642.358op/s |16935622.983op/s |16941871.497op/s |16942977.557op/s |0.24% |-1.043 |0.927 |0.22%|2621.809op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|6.831µs |6.843µs ± 0.004µs |6.843µs ± 0.002µs |6.845µs |6.849µs |6.853µs |6.876µs |0.49% |1.998 |14.526 |0.07%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |145428255.875op/s|146135617.251op/s ± 95761.794op/s |146139878.057op/s ± 51573.220op/s |146193823.316op/s|146239837.339op/s|146368848.190op/s|146383257.200op/s|0.17% |-1.973 |14.328 |0.07%|6771.381op/s |1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[4.630µs; 4.631µs] or [-0.016%; +0.016%] |None |None |None | |credit_card/is_card_number/ |throughput |[215924211.255op/s; 215994627.212op/s] or [-0.016%; +0.016%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[91.699µs; 91.856µs] or [-0.085%; +0.085%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[10887151.721op/s; 10905510.995op/s] or [-0.084%; +0.084%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[83.992µs; 84.092µs] or [-0.059%; +0.059%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[11892232.335op/s; 11905726.438op/s] or [-0.057%; +0.057%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[4.632µs; 4.634µs] or [-0.017%; +0.017%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[215808795.019op/s; 215883507.207op/s] or [-0.017%; +0.017%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[81.187µs; 81.223µs] or [-0.022%; +0.022%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[12311888.226op/s; 12317319.789op/s] or [-0.022%; +0.022%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[59.648µs; 59.690µs] or [-0.035%; +0.035%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[16753314.734op/s; 16765187.489op/s] or [-0.035%; +0.035%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[6.842µs; 6.844µs] or [-0.015%; +0.015%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[146113947.893op/s; 146156367.465op/s] or [-0.015%; +0.015%]|None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[4.631µs; 4.633µs] or [-0.012%; +0.012%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[215860600.993op/s; 215914330.236op/s] or [-0.012%; +0.012%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[73.612µs; 73.654µs] or [-0.028%; +0.028%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[13577009.069op/s; 13584741.987op/s] or [-0.028%; +0.028%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[65.130µs; 65.193µs] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[15339338.996op/s; 15353996.162op/s] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[4.631µs; 4.632µs] or [-0.013%; +0.013%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[215892072.686op/s; 215946937.593op/s] or [-0.013%; +0.013%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[63.469µs; 63.512µs] or [-0.033%; +0.033%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[15745222.066op/s; 15755793.221op/s] or [-0.034%; +0.034%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[59.182µs; 59.218µs] or [-0.030%; +0.030%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[16886955.118op/s; 16897232.419op/s] or [-0.030%; +0.030%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[6.842µs; 6.844µs] or [-0.009%; +0.009%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[146122345.587op/s; 146148888.915op/s] or [-0.009%; +0.009%]|None |None |None |Baseline
Omitted due to size.
codecov-commenter
What does this PR do?
Adds a builder class that provides a way to incrementally construct a
CrashInfo.Motivation
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Tests are incoming.