DataDog / libdatadog

Datadog shared rust-based library. For now only used in other products (e.g. Ruby or PHP libraries).
Apache License 2.0
47 stars 8 forks source link

ci: setup building nuget packages in CI #697

Open ganeshnj opened 6 days ago

ganeshnj commented 6 days ago

What does this PR do?

Motivation

Additional Notes

Anything else we should know when reviewing?

How to test the change?

The libdatadog nuget version attached in artifacts can be used directly in .NET tracer.

pr-commenter[bot] commented 6 days ago

Benchmarks

Comparison

Benchmark execution time: 2024-10-29 15:23:47

Comparing candidate commit 8eedd6c in PR branch ganeshnj/feat/datapipeline-nuget with baseline commit 490a276 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details ### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|256.240ns|268.042ns ± 15.061ns|260.859ns ± 3.030ns|276.044ns|301.847ns|309.952ns|313.537ns|20.19% |1.537 |1.166 |5.60%|1.065ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[265.954ns; 270.129ns] or [-0.779%; +0.779%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|1.136µs|1.195µs ± 0.024µs|1.195µs ± 0.019µs|1.216µs|1.220µs|1.222µs|1.222µs|2.28% |-0.871 |-0.087 |1.99%|0.002µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[1.192µs; 1.198µs] or [-0.277%; +0.277%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.701µs|2.720µs ± 0.014µs|2.716µs ± 0.005µs|2.723µs|2.762µs|2.765µs|2.769µs|1.93% |1.923 |3.341 |0.53%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.718µs; 2.722µs] or [-0.074%; +0.074%]|None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|623.718µs |624.630µs ± 0.374µs |624.627µs ± 0.231µs |624.883µs |625.267µs |625.434µs |625.542µs |0.15% |-0.044 |-0.151 |0.06%|0.026µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1598614.412op/s |1600948.038op/s ± 958.481op/s |1600955.084op/s ± 593.385op/s |1601533.995op/s |1602750.265op/s |1603147.558op/s |1603288.849op/s |0.15% |0.047 |-0.150 |0.06%|67.775op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|461.130µs |462.358µs ± 0.747µs |462.367µs ± 0.662µs |463.019µs |463.571µs |463.792µs |463.905µs |0.33% |0.163 |-1.187 |0.16%|0.053µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2155613.757op/s |2162831.070op/s ± 3492.488op/s |2162784.233op/s ± 3091.186op/s |2166121.388op/s |2167705.568op/s |2168395.247op/s |2168583.885op/s |0.27% |-0.159 |-1.189 |0.16%|246.956op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|178.202µs |178.389µs ± 0.127µs |178.374µs ± 0.066µs |178.440µs |178.581µs |178.822µs |179.136µs |0.43% |1.866 |7.015 |0.07%|0.009µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5582337.919op/s |5605744.932op/s ± 3977.384op/s |5606189.397op/s ± 2081.231op/s |5608253.380op/s |5610587.935op/s |5611519.567op/s |5611610.065op/s |0.10% |-1.854 |6.938 |0.07%|281.244op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|46.730µs |46.869µs ± 0.057µs |46.867µs ± 0.036µs |46.903µs |46.974µs |47.014µs |47.033µs |0.35% |0.266 |0.169 |0.12%|0.004µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |21261594.119op/s|21335897.378op/s ± 25932.315op/s |21337063.012op/s ± 16308.144op/s|21353183.575op/s|21377516.747op/s|21391971.812op/s|21399438.913op/s|0.29% |-0.259 |0.163 |0.12%|1833.692op/s|1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|48.426µs |48.986µs ± 0.302µs |49.109µs ± 0.160µs |49.214µs |49.337µs |49.482µs |49.665µs |1.13% |-0.437 |-1.202 |0.61%|0.021µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |20135011.967op/s|20414685.064op/s ± 126066.009op/s|20363071.299op/s ± 66289.496op/s|20549907.548op/s|20619308.496op/s|20639203.093op/s|20650054.539op/s|1.41% |0.448 |-1.203 |0.62%|8914.213op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[624.578µs; 624.682µs] or [-0.008%; +0.008%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1600815.202op/s; 1601080.874op/s] or [-0.008%; +0.008%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[462.255µs; 462.462µs] or [-0.022%; +0.022%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2162347.045op/s; 2163315.095op/s] or [-0.022%; +0.022%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[178.371µs; 178.406µs] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5605193.705op/s; 5606296.159op/s] or [-0.010%; +0.010%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[46.862µs; 46.877µs] or [-0.017%; +0.017%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[21332303.409op/s; 21339491.347op/s] or [-0.017%; +0.017%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[48.944µs; 49.028µs] or [-0.085%; +0.085%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[20397213.528op/s; 20432156.600op/s] or [-0.086%; +0.086%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|143.398µs|144.738µs ± 0.382µs|144.764µs ± 0.195µs|144.937µs|145.213µs|145.854µs|146.853µs|1.44% |0.647 |5.539 |0.26%|0.027µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[144.685µs; 144.791µs] or [-0.037%; +0.037%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|9.075ms|9.110ms ± 0.017ms|9.108ms ± 0.010ms|9.119ms|9.136ms|9.160ms|9.173ms|0.71% |0.726 |1.347 |0.18%|0.001ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[9.107ms; 9.112ms] or [-0.025%; +0.025%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|---------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|190.481µs |192.438µs ± 0.756µs |192.320µs ± 0.445µs |192.914µs |193.757µs |194.237µs |195.730µs |1.77% |0.612 |1.559 |0.39%|0.053µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |5109081.581op/s |5196569.396op/s ± 20377.816op/s |5199655.126op/s ± 12053.746op/s |5209697.525op/s |5228977.834op/s |5236540.104op/s |5249867.441op/s |0.97% |-0.575 |1.462 |0.39%|1440.929op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|18.177µs |18.206µs ± 0.027µs |18.192µs ± 0.007µs |18.224µs |18.262µs |18.289µs |18.312µs |0.66% |1.464 |1.850 |0.15%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |54610086.298op/s|54927931.387op/s ± 80048.961op/s |54970600.046op/s ± 19943.211op/s |54983323.861op/s|54998040.112op/s|55006373.632op/s|55014040.236op/s|0.08% |-1.457 |1.816 |0.15%|5660.316op/s |1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|11.308µs |11.358µs ± 0.023µs |11.355µs ± 0.017µs |11.376µs |11.398µs |11.414µs |11.426µs |0.63% |0.467 |-0.368 |0.20%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |87518375.440op/s|88042339.911op/s ± 179776.040op/s|88067324.718op/s ± 128492.044op/s|88176435.549op/s|88289915.399op/s|88332783.033op/s|88432845.617op/s|0.42% |-0.458 |-0.379 |0.20%|12712.086op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[192.333µs; 192.542µs] or [-0.054%; +0.054%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[5193745.226op/s; 5199393.565op/s] or [-0.054%; +0.054%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[18.202µs; 18.209µs] or [-0.020%; +0.020%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[54916837.370op/s; 54939025.403op/s] or [-0.020%; +0.020%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[11.355µs; 11.361µs] or [-0.028%; +0.028%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[88017424.681op/s; 88067255.141op/s] or [-0.028%; +0.028%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|72.645µs|72.754µs ± 0.118µs|72.740µs ± 0.018µs|72.755µs|72.825µs|73.206µs|74.109µs|1.88% |8.450 |88.610 |0.16%|0.008µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[72.738µs; 72.770µs] or [-0.022%; +0.022%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|18.121µs|23.968µs ± 11.289µs|18.883µs ± 0.291µs|19.253µs|44.059µs|47.387µs|98.036µs|419.17% |3.348 |16.393 |46.98%|0.798µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[22.404µs; 25.533µs] or [-6.528%; +6.528%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|---------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|------------|----|-----------| |credit_card/is_card_number/ |execution_time|4.605µs |4.615µs ± 0.002µs |4.615µs ± 0.001µs |4.616µs |4.618µs |4.620µs |4.621µs |0.15% |-0.156 |2.846 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number/ |throughput |216382415.529op/s|216695699.841op/s ± 95876.195op/s |216704474.948op/s ± 58933.944op/s|216759825.712op/s|216830190.267op/s|216874978.876op/s|217178291.752op/s|0.22% |0.163 |2.866 |0.04%|6779.471op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|90.102µs |91.313µs ± 0.564µs |91.210µs ± 0.264µs |91.552µs |92.296µs |92.678µs |95.326µs |4.51% |2.299 |12.193 |0.62%|0.040µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |10490293.427op/s |10951790.694op/s ± 66677.151op/s |10963726.512op/s ± 31841.176op/s |10992522.064op/s |11031371.904op/s |11062074.153op/s |11098545.092op/s |1.23% |-2.141 |10.834 |0.61%|4714.787op/s|1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|82.641µs |83.555µs ± 0.559µs |83.423µs ± 0.348µs |83.870µs |84.443µs |85.123µs |87.016µs |4.31% |1.641 |6.347 |0.67%|0.040µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |11492194.406op/s |11968651.357op/s ± 79220.971op/s |11987036.037op/s ± 50024.205op/s |12029202.714op/s |12067439.295op/s |12080248.570op/s |12100486.066op/s |0.95% |-1.534 |5.548 |0.66%|5601.769op/s|1 |200 | |credit_card/is_card_number/37828224631 |execution_time|4.602µs |4.615µs ± 0.002µs |4.614µs ± 0.002µs |4.616µs |4.619µs |4.620µs |4.623µs |0.20% |-0.041 |2.536 |0.05%|0.000µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |216296175.041op/s|216704781.903op/s ± 115152.748op/s|216718897.927op/s ± 79329.535op/s|216785147.787op/s|216849383.208op/s|216881489.253op/s|217279179.381op/s|0.26% |0.048 |2.558 |0.05%|8142.529op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|79.433µs |80.528µs ± 0.400µs |80.539µs ± 0.286µs |80.841µs |81.150µs |81.298µs |81.357µs |1.02% |-0.233 |-0.452 |0.50%|0.028µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |12291525.888op/s |12418290.750op/s ± 61834.494op/s |12416286.304op/s ± 44245.591op/s |12459512.517op/s |12526201.221op/s |12557502.002op/s |12589231.212op/s |1.39% |0.256 |-0.434 |0.50%|4372.359op/s|1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|59.260µs |59.534µs ± 0.219µs |59.558µs ± 0.201µs |59.705µs |59.893µs |60.065µs |60.067µs |0.85% |0.332 |-0.903 |0.37%|0.016µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |16648166.515op/s |16797244.519op/s ± 61843.423op/s |16790460.089op/s ± 56519.646op/s |16862951.674op/s |16872935.222op/s |16874324.113op/s |16874888.478op/s |0.50% |-0.321 |-0.922 |0.37%|4372.990op/s|1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|7.219µs |7.223µs ± 0.006µs |7.223µs ± 0.002µs |7.224µs |7.225µs |7.228µs |7.303µs |1.12% |11.783 |154.157 |0.08%|0.000µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |136922813.496op/s|138451964.694op/s ± 115280.022op/s|138451251.315op/s ± 31424.078op/s|138493473.495op/s|138518959.090op/s|138525914.182op/s|138531405.070op/s|0.06% |-11.740 |153.390 |0.08%|8151.529op/s|1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|4.604µs |4.615µs ± 0.002µs |4.614µs ± 0.002µs |4.616µs |4.618µs |4.620µs |4.622µs |0.16% |-0.126 |1.543 |0.05%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |216376236.238op/s|216705397.612op/s ± 108760.041op/s|216714671.583op/s ± 74009.461op/s|216774857.778op/s|216867500.868op/s|216918166.096op/s|217206460.303op/s|0.23% |0.132 |1.558 |0.05%|7690.496op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|73.990µs |74.411µs ± 0.175µs |74.422µs ± 0.089µs |74.505µs |74.650µs |74.740µs |75.542µs |1.51% |0.957 |8.097 |0.23%|0.012µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |13237628.872op/s |13439033.992op/s ± 31527.300op/s |13436944.451op/s ± 16097.706op/s |13453398.779op/s |13499436.666op/s |13509813.798op/s |13515283.082op/s |0.58% |-0.894 |7.697 |0.23%|2229.317op/s|1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|66.472µs |66.831µs ± 0.233µs |66.811µs ± 0.175µs |66.995µs |67.269µs |67.373µs |67.464µs |0.98% |0.383 |-0.553 |0.35%|0.016µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |14822794.968op/s |14963184.967op/s ± 52134.380op/s |14967690.022op/s ± 39303.996op/s |15004057.849op/s |15039609.520op/s |15042996.087op/s |15043965.991op/s |0.51% |-0.369 |-0.572 |0.35%|3686.457op/s|1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|4.600µs |4.615µs ± 0.003µs |4.614µs ± 0.001µs |4.616µs |4.619µs |4.620µs |4.626µs |0.26% |-0.164 |6.421 |0.06%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |216150230.791op/s|216706662.736op/s ± 119592.954op/s|216720030.310op/s ± 67114.213op/s|216774951.654op/s|216874643.947op/s|216897393.220op/s|217398301.867op/s|0.31% |0.177 |6.461 |0.06%|8456.499op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|62.358µs |62.651µs ± 0.155µs |62.613µs ± 0.107µs |62.751µs |62.938µs |63.008µs |63.158µs |0.87% |0.714 |-0.300 |0.25%|0.011µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |15833280.308op/s |15961608.236op/s ± 39488.832op/s |15971086.744op/s ± 27359.670op/s |15996010.595op/s |16005606.204op/s |16013231.721op/s |16036409.063op/s |0.41% |-0.705 |-0.318 |0.25%|2792.282op/s|1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|59.255µs |59.512µs ± 0.219µs |59.468µs ± 0.170µs |59.680µs |59.878µs |60.076µs |60.093µs |1.05% |0.620 |-0.678 |0.37%|0.015µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |16640892.976op/s |16803641.215op/s ± 61656.834op/s |16815860.162op/s ± 48003.885op/s |16861271.790op/s |16872380.842op/s |16874416.444op/s |16876302.296op/s |0.36% |-0.610 |-0.700 |0.37%|4359.797op/s|1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|7.217µs |7.223µs ± 0.003µs |7.222µs ± 0.002µs |7.224µs |7.227µs |7.229µs |7.230µs |0.11% |0.534 |-0.348 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |138312876.509op/s|138453893.362op/s ± 50363.245op/s |138460075.037op/s ± 36203.702op/s|138495807.039op/s|138520021.685op/s|138533009.924op/s|138556697.401op/s|0.07% |-0.533 |-0.350 |0.04%|3561.219op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[4.614µs; 4.615µs] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number/ |throughput |[216682412.322op/s; 216708987.359op/s] or [-0.006%; +0.006%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[91.235µs; 91.391µs] or [-0.086%; +0.086%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[10942549.883op/s; 10961031.506op/s] or [-0.084%; +0.084%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[83.478µs; 83.633µs] or [-0.093%; +0.093%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[11957672.093op/s; 11979630.622op/s] or [-0.092%; +0.092%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[4.614µs; 4.615µs] or [-0.007%; +0.007%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[216688822.840op/s; 216720740.967op/s] or [-0.007%; +0.007%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[80.473µs; 80.584µs] or [-0.069%; +0.069%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[12409721.084op/s; 12426860.416op/s] or [-0.069%; +0.069%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[59.504µs; 59.565µs] or [-0.051%; +0.051%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[16788673.615op/s; 16805815.423op/s] or [-0.051%; +0.051%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[7.222µs; 7.224µs] or [-0.012%; +0.012%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[138435987.992op/s; 138467941.397op/s] or [-0.012%; +0.012%]|None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[4.614µs; 4.615µs] or [-0.007%; +0.007%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[216690324.516op/s; 216720470.707op/s] or [-0.007%; +0.007%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[74.386µs; 74.435µs] or [-0.033%; +0.033%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[13434664.612op/s; 13443403.373op/s] or [-0.033%; +0.033%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[66.799µs; 66.864µs] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[14955959.644op/s; 14970410.291op/s] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[4.614µs; 4.615µs] or [-0.008%; +0.008%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[216690088.303op/s; 216723237.169op/s] or [-0.008%; +0.008%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[62.629µs; 62.672µs] or [-0.034%; +0.034%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[15956135.464op/s; 15967081.009op/s] or [-0.034%; +0.034%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[59.481µs; 59.542µs] or [-0.051%; +0.051%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[16795096.171op/s; 16812186.259op/s] or [-0.051%; +0.051%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[7.222µs; 7.223µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[138446913.500op/s; 138460873.223op/s] or [-0.005%; +0.005%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|37.781µs|38.200µs ± 0.680µs|37.884µs ± 0.037µs|37.977µs|39.587µs|39.655µs|41.235µs|8.84% |1.825 |2.051 |1.77%|0.048µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[38.106µs; 38.294µs] or [-0.247%; +0.247%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|8eedd6c |1730214785 |ganeshnj/feat/datapipeline-nuget| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.384µs|3.212µs ± 1.391µs|3.066µs ± 0.026µs|3.089µs|3.122µs|13.893µs|14.927µs|386.78% |7.575 |57.649 |43.20%|0.098µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[3.020µs; 3.405µs] or [-6.002%; +6.002%]|None |None |None |

Baseline

Omitted due to size.

codecov-commenter commented 6 days ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 71.79%. Comparing base (22c2da5) to head (8eedd6c). Report is 1 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #697 +/- ## ========================================== + Coverage 71.73% 71.79% +0.05% ========================================== Files 271 271 Lines 41064 41102 +38 ========================================== + Hits 29458 29508 +50 + Misses 11606 11594 -12 ``` | [Components](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | Coverage Δ | | |---|---|---| | [crashtracker](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `20.15% <ø> (ø)` | | | [crashtracker-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `8.97% <ø> (ø)` | | | [datadog-alloc](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `98.73% <ø> (ø)` | | | [data-pipeline](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `91.93% <ø> (+0.01%)` | :arrow_up: | | [data-pipeline-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [ddcommon](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `82.74% <ø> (ø)` | | | [ddcommon-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `69.12% <ø> (ø)` | | | [ddtelemetry](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `59.10% <ø> (ø)` | | | [ddtelemetry-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `22.13% <ø> (ø)` | | | [dogstatsd](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `88.86% <ø> (ø)` | | | [dogstatsd-client](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `79.77% <ø> (ø)` | | | [ipc](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `82.65% <ø> (ø)` | | | [profiling](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `84.30% <ø> (ø)` | | | [profiling-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `77.46% <ø> (ø)` | | | [serverless](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [sidecar](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `36.13% <ø> (+0.04%)` | :arrow_up: | | [sidecar-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [spawn-worker](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `50.36% <ø> (ø)` | | | [tinybytes](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `94.77% <ø> (ø)` | | | [trace-mini-agent](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `72.45% <ø> (ø)` | | | [trace-normalization](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `98.25% <ø> (ø)` | | | [trace-obfuscation](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `95.77% <ø> (ø)` | | | [trace-protobuf](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `77.67% <ø> (ø)` | | | [trace-utils](https://app.codecov.io/gh/DataDog/libdatadog/pull/697/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `93.14% <ø> (+0.02%)` | :arrow_up: |