DataDog / libdatadog

Datadog shared rust-based library. For now only used in other products (e.g. Ruby or PHP libraries).
Apache License 2.0
47 stars 8 forks source link

Enable code coverage. #681

Closed hoolioh closed 2 weeks ago

hoolioh commented 2 weeks ago

What does this PR do?

Code coverage started to malfunction due to some compatibility issue between current Rust and llvm-cov/nextest versions. This PR bumps llvm-cov and nextest to bring back code coverage.

pr-commenter[bot] commented 2 weeks ago

Benchmarks

Comparison

Benchmark execution time: 2024-10-16 15:10:44

Comparing candidate commit 938cd0e in PR branch julio/enable-codecov with baseline commit f399485 in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

Candidate

Candidate benchmark details ### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|622.747µs |624.548µs ± 0.430µs |624.573µs ± 0.296µs |624.859µs |625.186µs |625.363µs |625.519µs |0.15% |-0.546 |0.887 |0.07%|0.030µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1598673.010op/s |1601158.706op/s ± 1102.663op/s |1601094.600op/s ± 758.332op/s |1601867.228op/s |1602925.247op/s |1604135.651op/s |1605787.441op/s |0.29% |0.552 |0.902 |0.07%|77.970op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|460.970µs |462.118µs ± 0.418µs |462.112µs ± 0.296µs |462.407µs |462.783µs |463.103µs |463.461µs |0.29% |0.226 |0.034 |0.09%|0.030µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2157680.816op/s |2163952.595op/s ± 1955.935op/s |2163976.948op/s ± 1388.353op/s |2165363.327op/s |2166988.981op/s |2167967.193op/s |2169338.321op/s |0.25% |-0.221 |0.030 |0.09%|138.306op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|178.234µs |178.431µs ± 0.118µs |178.419µs ± 0.070µs |178.498µs |178.629µs |178.789µs |178.932µs |0.29% |0.815 |1.524 |0.07%|0.008µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5588724.408op/s |5604401.149op/s ± 3702.046op/s |5604772.368op/s ± 2183.229op/s |5606687.137op/s |5609817.427op/s |5610582.775op/s |5610615.613op/s |0.10% |-0.810 |1.505 |0.07%|261.774op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|46.718µs |46.861µs ± 0.080µs |46.851µs ± 0.049µs |46.902µs |47.013µs |47.101µs |47.177µs |0.70% |0.966 |1.710 |0.17%|0.006µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |21196715.441op/s|21339651.304op/s ± 36323.346op/s |21344038.668op/s ± 22384.028op/s|21364783.104op/s|21391762.643op/s|21402632.806op/s|21404882.924op/s|0.29% |-0.952 |1.663 |0.17%|2568.448op/s|1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|48.612µs |49.302µs ± 0.306µs |49.302µs ± 0.241µs |49.537µs |49.780µs |49.875µs |50.079µs |1.58% |-0.003 |-0.864 |0.62%|0.022µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |19968626.038op/s|20283771.420op/s ± 125763.404op/s|20283277.248op/s ± 99031.228op/s|20383622.168op/s|20481316.169op/s|20513978.577op/s|20570860.515op/s|1.42% |0.024 |-0.872 |0.62%|8892.816op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[624.488µs; 624.608µs] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1601005.888op/s; 1601311.525op/s] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[462.060µs; 462.176µs] or [-0.013%; +0.013%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2163681.521op/s; 2164223.669op/s] or [-0.013%; +0.013%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[178.415µs; 178.448µs] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5603888.081op/s; 5604914.217op/s] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[46.850µs; 46.872µs] or [-0.024%; +0.024%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[21334617.238op/s; 21344685.371op/s] or [-0.024%; +0.024%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[49.260µs; 49.345µs] or [-0.086%; +0.086%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[20266341.822op/s; 20301201.019op/s] or [-0.086%; +0.086%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|141.278µs|142.213µs ± 0.434µs|142.168µs ± 0.200µs|142.400µs|142.791µs|143.433µs|145.890µs|2.62% |3.165 |24.729 |0.30%|0.031µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[142.153µs; 142.273µs] or [-0.042%; +0.042%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|----------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|-------------|----|-----------| |credit_card/is_card_number/ |execution_time|2.013µs |2.014µs ± 0.001µs |2.014µs ± 0.000µs |2.014µs |2.015µs |2.016µs |2.026µs |0.61% |7.660 |82.405 |0.05%|0.000µs |1 |200 | |credit_card/is_card_number/ |throughput |493498313.748op/s|496521660.225op/s ± 266721.673op/s|496499036.921op/s ± 106107.219op/s|496683417.986op/s|496733146.837op/s|496759129.834op/s|496770491.633op/s|0.05% |-7.618 |81.762 |0.05%|18860.070op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|118.015µs |118.819µs ± 0.356µs |118.755µs ± 0.227µs |119.042µs |119.449µs |119.715µs |119.734µs |0.82% |0.481 |-0.254 |0.30%|0.025µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |8351863.006op/s |8416214.187op/s ± 25186.962op/s |8420726.022op/s ± 16095.683op/s |8433605.605op/s |8452803.230op/s |8462796.911op/s |8473475.480op/s |0.63% |-0.467 |-0.268 |0.30%|1780.987op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|109.372µs |110.216µs ± 0.417µs |110.159µs ± 0.191µs |110.374µs |110.888µs |111.657µs |112.704µs |2.31% |2.078 |8.318 |0.38%|0.029µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |8872765.806op/s |9073225.503op/s ± 34032.952op/s |9077775.789op/s ± 15773.000op/s |9093076.986op/s |9113463.366op/s |9134453.038op/s |9143146.508op/s |0.72% |-2.011 |7.903 |0.37%|2406.493op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|2.013µs |2.014µs ± 0.001µs |2.014µs ± 0.001µs |2.015µs |2.015µs |2.016µs |2.024µs |0.49% |4.208 |32.985 |0.05%|0.000µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |494094795.943op/s|496496232.242op/s ± 266030.464op/s|496515143.786op/s ± 155661.304op/s|496677052.953op/s|496750297.572op/s|496773024.969op/s|496791020.180op/s|0.06% |-4.180 |32.647 |0.05%|18811.194op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|105.044µs |106.060µs ± 0.320µs |106.073µs ± 0.176µs |106.223µs |106.651µs |106.782µs |107.203µs |1.06% |0.050 |1.052 |0.30%|0.023µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |9328091.666op/s |9428722.144op/s ± 28466.063op/s |9427428.130op/s ± 15685.463op/s |9444478.287op/s |9474146.476op/s |9500608.505op/s |9519817.404op/s |0.98% |-0.022 |1.038 |0.30%|2012.855op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|103.601µs |104.819µs ± 0.564µs |104.803µs ± 0.369µs |105.144µs |105.844µs |106.428µs |106.469µs |1.59% |0.498 |0.084 |0.54%|0.040µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |9392374.058op/s |9540570.353op/s ± 51166.322op/s |9541682.193op/s ± 33629.826op/s |9578790.179op/s |9613071.714op/s |9632264.087op/s |9652449.480op/s |1.16% |-0.468 |0.040 |0.53%|3618.005op/s |1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|23.238µs |23.965µs ± 0.378µs |23.963µs ± 0.257µs |24.231µs |24.541µs |24.840µs |24.931µs |4.04% |0.083 |-0.662 |1.57%|0.027µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |40110724.885op/s |41738004.720op/s ± 658175.454op/s |41731060.570op/s ± 447862.477op/s |42169497.142op/s |42787250.239op/s |43021990.272op/s |43033257.053op/s |3.12% |-0.021 |-0.687 |1.57%|46540.033op/s|1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|2.013µs |2.014µs ± 0.001µs |2.014µs ± 0.001µs |2.014µs |2.015µs |2.016µs |2.017µs |0.16% |0.969 |1.212 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |495704740.884op/s|496519540.461op/s ± 199611.019op/s|496511593.546op/s ± 150177.653op/s|496691164.012op/s|496767136.528op/s|496791526.712op/s|496827160.685op/s|0.06% |-0.966 |1.202 |0.04%|14114.631op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|96.913µs |98.094µs ± 0.434µs |98.053µs ± 0.285µs |98.362µs |98.864µs |99.034µs |99.729µs |1.71% |0.391 |0.357 |0.44%|0.031µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |10027214.056op/s |10194522.528op/s ± 45046.437op/s |10198559.480op/s ± 29593.294op/s |10224361.074op/s |10259146.755op/s |10291500.081op/s |10318566.520op/s |1.18% |-0.362 |0.314 |0.44%|3185.264op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|87.914µs |88.775µs ± 0.423µs |88.734µs ± 0.260µs |89.028µs |89.537µs |89.848µs |90.129µs |1.57% |0.441 |0.094 |0.48%|0.030µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |11095249.378op/s |11264646.710op/s ± 53585.757op/s |11269587.336op/s ± 33082.921op/s |11299478.257op/s |11347256.903op/s |11371339.304op/s |11374689.624op/s |0.93% |-0.414 |0.058 |0.47%|3789.085op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|2.013µs |2.014µs ± 0.001µs |2.014µs ± 0.001µs |2.014µs |2.015µs |2.016µs |2.016µs |0.11% |0.815 |-0.104 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |496001369.823op/s|496529282.678op/s ± 182685.873op/s|496550772.325op/s ± 131361.013op/s|496682332.084op/s|496734483.513op/s|496752567.385op/s|496763234.838op/s|0.04% |-0.814 |-0.107 |0.04%|12917.842op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|83.850µs |84.774µs ± 0.444µs |84.731µs ± 0.278µs |85.017µs |85.667µs |85.891µs |86.062µs |1.57% |0.531 |0.135 |0.52%|0.031µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |11619512.943op/s |11796425.720op/s ± 61685.344op/s |11802050.852op/s ± 38684.024op/s |11837925.165op/s |11887565.418op/s |11915802.239op/s |11926112.679op/s |1.05% |-0.502 |0.098 |0.52%|4361.813op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|103.864µs |105.149µs ± 0.635µs |105.082µs ± 0.460µs |105.595µs |106.233µs |106.562µs |106.776µs |1.61% |0.243 |-0.564 |0.60%|0.045µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |9365404.158op/s |9510673.203op/s ± 57322.603op/s |9516351.948op/s ± 41667.858op/s |9556605.222op/s |9599365.278op/s |9625907.519op/s |9628019.930op/s |1.17% |-0.218 |-0.577 |0.60%|4053.320op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|23.243µs |24.152µs ± 0.471µs |24.142µs ± 0.348µs |24.487µs |24.950µs |25.187µs |25.416µs |5.28% |0.085 |-0.603 |1.94%|0.033µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |39346049.372op/s |41420494.418op/s ± 806367.871op/s |41421740.330op/s ± 595868.728op/s |42028687.409op/s |42693132.442op/s |43004139.198op/s |43023157.109op/s |3.87% |-0.005 |-0.645 |1.94%|57018.819op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[2.014µs; 2.014µs] or [-0.007%; +0.007%] |None |None |None | |credit_card/is_card_number/ |throughput |[496484695.166op/s; 496558625.283op/s] or [-0.007%; +0.007%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[118.770µs; 118.869µs] or [-0.042%; +0.042%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[8412723.517op/s; 8419704.858op/s] or [-0.041%; +0.041%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[110.158µs; 110.274µs] or [-0.052%; +0.052%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[9068508.863op/s; 9077942.143op/s] or [-0.052%; +0.052%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[2.014µs; 2.014µs] or [-0.007%; +0.007%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[496459362.978op/s; 496533101.506op/s] or [-0.007%; +0.007%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[106.015µs; 106.104µs] or [-0.042%; +0.042%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[9424777.022op/s; 9432667.267op/s] or [-0.042%; +0.042%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[104.740µs; 104.897µs] or [-0.075%; +0.075%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[9533479.193op/s; 9547661.513op/s] or [-0.074%; +0.074%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[23.912µs; 24.017µs] or [-0.219%; +0.219%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[41646787.932op/s; 41829221.508op/s] or [-0.219%; +0.219%] |None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[2.014µs; 2.014µs] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[496491876.294op/s; 496547204.629op/s] or [-0.006%; +0.006%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[98.034µs; 98.154µs] or [-0.061%; +0.061%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[10188279.525op/s; 10200765.531op/s] or [-0.061%; +0.061%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[88.717µs; 88.834µs] or [-0.066%; +0.066%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[11257220.240op/s; 11272073.181op/s] or [-0.066%; +0.066%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[2.014µs; 2.014µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[496503964.173op/s; 496554601.183op/s] or [-0.005%; +0.005%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[84.712µs; 84.835µs] or [-0.073%; +0.073%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[11787876.724op/s; 11804974.715op/s] or [-0.072%; +0.072%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[105.061µs; 105.237µs] or [-0.084%; +0.084%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[9502728.842op/s; 9518617.565op/s] or [-0.084%; +0.084%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[24.087µs; 24.217µs] or [-0.270%; +0.270%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[41308739.587op/s; 41532249.250op/s] or [-0.270%; +0.270%] |None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|1.119µs|1.176µs ± 0.024µs|1.179µs ± 0.017µs|1.197µs|1.200µs|1.204µs|1.205µs|2.23% |-0.948 |0.066 |2.03%|0.002µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[1.173µs; 1.180µs] or [-0.282%; +0.282%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|80.726µs|80.893µs ± 0.188µs|80.873µs ± 0.040µs|80.916µs|80.967µs|81.353µs|83.233µs|2.92% |10.000 |119.190 |0.23%|0.013µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[80.867µs; 80.919µs] or [-0.032%; +0.032%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.387µs|3.186µs ± 1.398µs|3.036µs ± 0.025µs|3.060µs|3.089µs|13.803µs|14.859µs|389.36% |7.601 |57.866 |43.78%|0.099µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[2.992µs; 3.379µs] or [-6.083%; +6.083%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|18.219µs|23.024µs ± 10.054µs|18.630µs ± 0.172µs|19.165µs|37.607µs|38.663µs|99.597µs|434.61% |3.825 |21.799 |43.56%|0.711µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[21.630µs; 24.417µs] or [-6.052%; +6.052%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|8.872ms|8.908ms ± 0.014ms|8.907ms ± 0.009ms|8.916ms|8.931ms|8.951ms|8.957ms|0.56% |0.456 |0.812 |0.16%|0.001ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[8.906ms; 8.910ms] or [-0.022%; +0.022%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.644µs|2.686µs ± 0.016µs|2.683µs ± 0.006µs|2.696µs|2.719µs|2.726µs|2.728µs|1.67% |0.129 |1.149 |0.59%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.684µs; 2.688µs] or [-0.082%; +0.082%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|---------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|190.393µs |192.961µs ± 0.735µs |193.020µs ± 0.441µs |193.411µs |194.159µs |194.354µs |194.373µs |0.70% |-0.526 |0.705 |0.38%|0.052µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |5144758.615op/s |5182472.523op/s ± 19784.650op/s |5180804.370op/s ± 11802.142op/s |5193549.584op/s |5218059.678op/s |5239172.911op/s |5252284.502op/s |1.38% |0.553 |0.762 |0.38%|1398.986op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|18.171µs |18.211µs ± 0.028µs |18.199µs ± 0.020µs |18.229µs |18.264µs |18.282µs |18.322µs |0.68% |0.837 |0.508 |0.15%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |54578159.393op/s|54913193.035op/s ± 82972.999op/s |54946833.854op/s ± 60445.187op/s |54985789.901op/s|55006255.680op/s|55016465.685op/s|55032000.175op/s|0.15% |-0.829 |0.476 |0.15%|5867.077op/s |1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|11.320µs |11.365µs ± 0.023µs |11.358µs ± 0.016µs |11.384µs |11.405µs |11.418µs |11.430µs |0.63% |0.561 |-0.592 |0.20%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |87490200.072op/s|87993634.467op/s ± 179984.664op/s|88040974.849op/s ± 123890.695op/s|88133860.193op/s|88225664.709op/s|88275147.019op/s|88342575.945op/s|0.34% |-0.555 |-0.602 |0.20%|12726.838op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[192.859µs; 193.063µs] or [-0.053%; +0.053%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[5179730.560op/s; 5185214.485op/s] or [-0.053%; +0.053%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[18.207µs; 18.214µs] or [-0.021%; +0.021%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[54901693.775op/s; 54924692.294op/s] or [-0.021%; +0.021%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[11.361µs; 11.368µs] or [-0.028%; +0.028%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[87968690.323op/s; 88018578.610op/s] or [-0.028%; +0.028%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|37.058µs|37.718µs ± 1.179µs|37.182µs ± 0.065µs|37.274µs|40.268µs|40.302µs|40.684µs|9.42% |1.700 |0.918 |3.12%|0.083µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[37.555µs; 37.882µs] or [-0.433%; +0.433%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|938cd0e |1729090817 |julio/enable-codecov| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|255.629ns|268.477ns ± 14.226ns|262.970ns ± 4.312ns|274.351ns|306.918ns|312.105ns|313.942ns|19.38% |1.837 |2.507 |5.29%|1.006ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[266.506ns; 270.449ns] or [-0.734%; +0.734%]|None |None |None |

Baseline

Omitted due to size.

codecov-commenter commented 2 weeks ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 71.81%. Comparing base (67d4f7a) to head (938cd0e). Report is 17 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #681 +/- ## ========================================== + Coverage 71.79% 71.81% +0.01% ========================================== Files 271 271 Lines 40931 40935 +4 ========================================== + Hits 29388 29399 +11 + Misses 11543 11536 -7 ``` | [Components](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | Coverage Δ | | |---|---|---| | [crashtracker](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `20.41% <ø> (ø)` | | | [crashtracker-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `9.07% <ø> (ø)` | | | [datadog-alloc](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `98.73% <ø> (ø)` | | | [data-pipeline](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `91.92% <ø> (+0.32%)` | :arrow_up: | | [data-pipeline-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [ddcommon](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `82.73% <0.00%> (ø)` | | | [ddcommon-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `69.12% <ø> (ø)` | | | [ddtelemetry](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `59.10% <85.71%> (ø)` | | | [ddtelemetry-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `22.13% <ø> (ø)` | | | [dogstatsd](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `89.05% <ø> (ø)` | | | [dogstatsd-client](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `79.77% <ø> (ø)` | | | [ipc](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `82.65% <94.44%> (-0.04%)` | :arrow_down: | | [profiling](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `84.26% <ø> (ø)` | | | [profiling-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `77.42% <ø> (ø)` | | | [serverless](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [sidecar](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `36.08% <33.33%> (+<0.01%)` | :arrow_up: | | [sidecar-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <0.00%> (ø)` | | | [spawn-worker](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `50.36% <ø> (ø)` | | | [tinybytes](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `94.77% <ø> (ø)` | | | [trace-mini-agent](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `72.40% <58.82%> (-0.26%)` | :arrow_down: | | [trace-normalization](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `98.25% <ø> (ø)` | | | [trace-obfuscation](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `95.73% <ø> (ø)` | | | [trace-protobuf](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `77.67% <ø> (ø)` | | | [trace-utils](https://app.codecov.io/gh/DataDog/libdatadog/pull/681/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `93.48% <59.09%> (+0.19%)` | :arrow_up: |