search

DataDog / libdatadog

Datadog shared rust-based library. For now only used in other products (e.g. Ruby or PHP libraries).
Apache License 2.0
47 stars 8 forks source link

[crashtracker] Enable timeout on receiver #702

Open danielsn opened 3 days ago

danielsn commented 3 days ago

What does this PR do?

Adds a timeout to the crashtracker receiver, enabling it to post a partial crash report if the collector hangs. Previously, a collector hang could cause the receiver to also hang.

Motivation

This implements a mitigation from the RFC.

Additional Notes

There is an open question about how to configure this timeout. Currently, we're offering an environment variable. We could take the value from the config, but that is passed on the socket, so its odd for a timeout on the socket to depend on a value that came on the socket.

How to test the change?

Added two new tests.

codecov-commenter commented 3 days ago

Codecov Report

Attention: Patch coverage is 86.60714% with 15 lines in your changes missing coverage. Please review.

Project coverage is 70.89%. Comparing base (fb66952) to head (9c74207).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #702 +/- ## ========================================== + Coverage 70.56% 70.89% +0.32% ========================================== Files 281 281 Lines 41822 41929 +107 ========================================== + Hits 29511 29724 +213 + Misses 12311 12205 -106 ``` | [Components](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | Coverage Δ | | |---|---|---| | [crashtracker](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `28.07% <86.60%> (+8.87%)` | :arrow_up: | | [crashtracker-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `9.20% <ø> (ø)` | | | [datadog-alloc](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `98.73% <ø> (ø)` | | | [data-pipeline](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `91.93% <ø> (ø)` | | | [data-pipeline-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [ddcommon](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `82.76% <ø> (ø)` | | | [ddcommon-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `69.12% <ø> (ø)` | | | [ddtelemetry](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `59.10% <ø> (ø)` | | | [ddtelemetry-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `22.13% <ø> (ø)` | | | [dogstatsd](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `89.22% <ø> (ø)` | | | [dogstatsd-client](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `79.77% <ø> (ø)` | | | [ipc](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `82.65% <ø> (ø)` | | | [profiling](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `84.30% <ø> (ø)` | | | [profiling-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `77.46% <ø> (ø)` | | | [serverless](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [sidecar](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `36.13% <ø> (ø)` | | | [sidecar-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [spawn-worker](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `50.36% <ø> (ø)` | | | [tinybytes](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `94.77% <ø> (ø)` | | | [trace-mini-agent](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `72.45% <ø> (ø)` | | | [trace-normalization](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `98.25% <ø> (ø)` | | | [trace-obfuscation](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `95.77% <ø> (ø)` | | | [trace-protobuf](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `77.67% <ø> (ø)` | | | [trace-utils](https://app.codecov.io/gh/DataDog/libdatadog/pull/702/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `93.55% <ø> (ø)` | |
pr-commenter[bot] commented 3 days ago

Benchmarks

Comparison

Benchmark execution time: 2024-11-01 21:24:09

Comparing candidate commit 9c74207 in PR branch dsn/crashtracker-receiver-timeout with baseline commit fb66952 in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

Candidate

Candidate benchmark details ### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|--------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|623.721µs |624.732µs ± 0.408µs |624.764µs ± 0.300µs |625.032µs |625.375µs |625.548µs |625.704µs |0.15% |-0.126 |-0.407 |0.07%|0.029µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1598200.700op/s |1600687.293op/s ± 1044.616op/s |1600604.937op/s ± 768.761op/s |1601463.326op/s |1602515.143op/s |1603015.799op/s |1603280.771op/s |0.17% |0.129 |-0.406 |0.07%|73.866op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|461.064µs |462.344µs ± 0.448µs |462.344µs ± 0.294µs |462.606µs |463.002µs |463.554µs |464.039µs |0.37% |0.331 |0.943 |0.10%|0.032µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2154989.572op/s |2162895.037op/s ± 2095.908op/s |2162890.715op/s ± 1373.285op/s |2164302.328op/s |2166147.134op/s |2167193.111op/s |2168894.807op/s |0.28% |-0.323 |0.930 |0.10%|148.203op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|178.168µs |179.751µs ± 1.067µs |179.615µs ± 0.760µs |180.468µs |181.691µs |182.208µs |182.586µs |1.65% |0.537 |-0.606 |0.59%|0.075µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5476869.710op/s |5563443.214op/s ± 32912.284op/s |5567462.990op/s ± 23668.990op/s |5589708.637op/s |5606464.922op/s |5611241.203op/s |5612682.472op/s |0.81% |-0.517 |-0.634 |0.59%|2327.250op/s|1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|46.531µs |46.672µs ± 0.059µs |46.674µs ± 0.043µs |46.717µs |46.764µs |46.797µs |46.815µs |0.30% |-0.038 |-0.481 |0.13%|0.004µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |21360535.849op/s|21425994.150op/s ± 27040.430op/s|21425048.343op/s ± 19877.840op/s|21445214.284op/s|21468819.429op/s|21488570.424op/s|21490904.851op/s|0.31% |0.044 |-0.481 |0.13%|1912.047op/s|1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|48.842µs |49.401µs ± 0.211µs |49.360µs ± 0.141µs |49.563µs |49.771µs |49.883µs |49.966µs |1.23% |0.207 |-0.267 |0.43%|0.015µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |20013627.884op/s|20242764.989op/s ± 86185.560op/s|20259276.339op/s ± 57813.687op/s|20297527.572op/s|20382237.101op/s|20434260.940op/s|20474065.073op/s|1.06% |-0.186 |-0.268 |0.42%|6094.239op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[624.675µs; 624.788µs] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1600542.519op/s; 1600832.067op/s] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[462.282µs; 462.406µs] or [-0.013%; +0.013%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2162604.565op/s; 2163185.510op/s] or [-0.013%; +0.013%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[179.603µs; 179.899µs] or [-0.082%; +0.082%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5558881.888op/s; 5568004.540op/s] or [-0.082%; +0.082%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[46.664µs; 46.681µs] or [-0.017%; +0.017%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[21422246.607op/s; 21429741.694op/s] or [-0.017%; +0.017%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[49.372µs; 49.430µs] or [-0.059%; +0.059%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[20230820.499op/s; 20254709.479op/s] or [-0.059%; +0.059%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.375µs|3.221µs ± 1.403µs|3.073µs ± 0.026µs|3.097µs|3.140µs|13.980µs|15.003µs|388.27% |7.593 |57.828 |43.45%|0.099µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[3.027µs; 3.415µs] or [-6.037%; +6.037%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|-----------------------------------|---------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|--------------|----|-----------| |credit_card/is_card_number/ |execution_time|4.813µs |4.818µs ± 0.002µs |4.818µs ± 0.001µs |4.819µs |4.820µs |4.821µs |4.833µs |0.31% |2.548 |20.103 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number/ |throughput |206926454.391op/s|207572348.499op/s ± 79795.218op/s |207574873.062op/s ± 43866.746op/s|207614190.430op/s|207685772.161op/s|207716664.688op/s|207755463.413op/s|0.09% |-2.530 |19.926 |0.04%|5642.374op/s |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|93.702µs |94.769µs ± 0.779µs |94.618µs ± 0.482µs |95.227µs |96.164µs |96.797µs |98.829µs |4.45% |1.225 |2.824 |0.82%|0.055µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |10118465.273op/s |10552654.492op/s ± 85909.769op/s |10568757.785op/s ± 54010.751op/s |10616714.159op/s |10662734.430op/s |10671221.138op/s |10672167.330op/s |0.98% |-1.147 |2.391 |0.81%|6074.738op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|84.558µs |85.169µs ± 0.491µs |84.945µs ± 0.057µs |85.312µs |85.998µs |86.739µs |89.245µs |5.06% |3.719 |23.310 |0.58%|0.035µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |11205168.051op/s |11741808.883op/s ± 66323.819op/s |11772317.983op/s ± 7869.668op/s |11778358.738op/s |11789608.286op/s |11801168.268op/s |11826209.245op/s |0.46% |-3.531 |21.070 |0.56%|4689.802op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|4.813µs |4.817µs ± 0.002µs |4.817µs ± 0.001µs |4.818µs |4.820µs |4.821µs |4.823µs |0.13% |0.383 |0.104 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |207349728.877op/s|207602137.752op/s ± 75279.974op/s |207614159.287op/s ± 53464.221op/s|207654950.692op/s|207704248.880op/s|207773554.081op/s|207777067.617op/s|0.08% |-0.380 |0.101 |0.04%|5323.098op/s |1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|81.606µs |82.733µs ± 0.438µs |82.696µs ± 0.100µs |82.796µs |83.636µs |83.897µs |85.320µs |3.17% |1.523 |6.212 |0.53%|0.031µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |11720540.805op/s |12087367.667op/s ± 63523.879op/s |12092505.487op/s ± 14640.481op/s |12107040.869op/s |12171042.712op/s |12207165.658op/s |12253986.161op/s |1.34% |-1.432 |5.729 |0.52%|4491.817op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|60.463µs |60.494µs ± 0.033µs |60.494µs ± 0.016µs |60.504µs |60.535µs |60.553µs |60.852µs |0.59% |6.760 |69.644 |0.05%|0.002µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |16433315.240op/s |16530449.009op/s ± 8909.503op/s |16530452.255op/s ± 4298.018op/s |16535952.535op/s |16537490.766op/s |16538389.307op/s |16538964.605op/s |0.05% |-6.718 |69.016 |0.05%|629.997op/s |1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|8.025µs |8.372µs ± 0.101µs |8.420µs ± 0.004µs |8.424µs |8.427µs |8.432µs |8.516µs |1.14% |-2.106 |3.796 |1.20%|0.007µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |117420886.587op/s|119458940.962op/s ± 1473930.517op/s|118759045.448op/s ± 54148.222op/s|119369689.874op/s|122935013.799op/s|124603718.508op/s|124614733.639op/s|4.93% |2.156 |4.045 |1.23%|104222.626op/s|1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|4.811µs |4.817µs ± 0.002µs |4.816µs ± 0.001µs |4.818µs |4.819µs |4.821µs |4.834µs |0.38% |3.044 |24.725 |0.04%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |206849599.925op/s|207619388.610op/s ± 90713.037op/s |207626531.359op/s ± 52601.380op/s|207672659.895op/s|207733936.456op/s|207775362.901op/s|207856640.764op/s|0.11% |-3.022 |24.486 |0.04%|6414.380op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|73.280µs |73.829µs ± 0.195µs |73.837µs ± 0.114µs |73.938µs |74.110µs |74.160µs |75.021µs |1.60% |0.728 |6.608 |0.26%|0.014µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |13329610.190op/s |13544896.914op/s ± 35655.578op/s |13543416.964op/s ± 20891.569op/s |13566607.491op/s |13603297.644op/s |13641746.343op/s |13646289.579op/s |0.76% |-0.665 |6.278 |0.26%|2521.230op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|66.077µs |66.573µs ± 0.150µs |66.564µs ± 0.077µs |66.646µs |66.826µs |66.890µs |66.962µs |0.60% |-0.259 |1.166 |0.22%|0.011µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |14933757.412op/s |15021108.172op/s ± 33834.291op/s |15023238.014op/s ± 17282.292op/s |15039774.352op/s |15075759.085op/s |15127483.970op/s |15133858.983op/s |0.74% |0.280 |1.200 |0.22%|2392.446op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|4.812µs |4.817µs ± 0.001µs |4.817µs ± 0.001µs |4.818µs |4.820µs |4.821µs |4.821µs |0.08% |-0.181 |0.448 |0.03%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |207416436.454op/s|207583471.611op/s ± 64526.034op/s |207588759.069op/s ± 41204.226op/s|207619978.232op/s|207686173.157op/s|207726995.157op/s|207824970.531op/s|0.11% |0.183 |0.451 |0.03%|4562.680op/s |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|63.273µs |63.728µs ± 0.170µs |63.725µs ± 0.087µs |63.825µs |64.029µs |64.096µs |64.146µs |0.66% |-0.210 |0.492 |0.27%|0.012µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |15589500.065op/s |15691797.444op/s ± 41821.067op/s |15692508.397op/s ± 21437.194op/s |15706750.769op/s |15767992.902op/s |15803421.129op/s |15804629.810op/s |0.71% |0.229 |0.503 |0.27%|2957.196op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|60.465µs |60.493µs ± 0.020µs |60.495µs ± 0.016µs |60.505µs |60.531µs |60.538µs |60.564µs |0.11% |0.598 |0.037 |0.03%|0.001µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |16511396.544op/s |16530820.751op/s ± 5416.016op/s |16530246.493op/s ± 4486.385op/s |16535818.700op/s |16537743.746op/s |16538133.373op/s |16538455.446op/s |0.05% |-0.597 |0.032 |0.03%|382.970op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|8.024µs |8.339µs ± 0.116µs |8.420µs ± 0.007µs |8.423µs |8.426µs |8.429µs |8.430µs |0.12% |-1.188 |0.293 |1.38%|0.008µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |118623763.024op/s|119936600.106op/s ± 1693598.683op/s|118770795.388op/s ± 99831.536op/s|121048489.445op/s|123404748.181op/s|124617937.164op/s|124622930.101op/s|4.93% |1.226 |0.424 |1.41%|119755.511op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[4.817µs; 4.818µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number/ |throughput |[207561289.650op/s; 207583407.349op/s] or [-0.005%; +0.005%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[94.661µs; 94.877µs] or [-0.114%; +0.114%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[10540748.224op/s; 10564560.760op/s] or [-0.113%; +0.113%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[85.100µs; 85.237µs] or [-0.080%; +0.080%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[11732617.040op/s; 11751000.727op/s] or [-0.078%; +0.078%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[4.817µs; 4.817µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[207591704.672op/s; 207612570.832op/s] or [-0.005%; +0.005%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[82.673µs; 82.794µs] or [-0.073%; +0.073%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[12078563.869op/s; 12096171.466op/s] or [-0.073%; +0.073%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[60.490µs; 60.499µs] or [-0.007%; +0.007%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[16529214.237op/s; 16531683.780op/s] or [-0.007%; +0.007%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[8.358µs; 8.386µs] or [-0.167%; +0.167%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[119254668.368op/s; 119663213.556op/s] or [-0.171%; +0.171%]|None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[4.816µs; 4.817µs] or [-0.006%; +0.006%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[207606816.656op/s; 207631960.565op/s] or [-0.006%; +0.006%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[73.802µs; 73.856µs] or [-0.037%; +0.037%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[13539955.394op/s; 13549838.434op/s] or [-0.036%; +0.036%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[66.553µs; 66.594µs] or [-0.031%; +0.031%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[15016419.065op/s; 15025797.280op/s] or [-0.031%; +0.031%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[4.817µs; 4.818µs] or [-0.004%; +0.004%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[207574528.923op/s; 207592414.299op/s] or [-0.004%; +0.004%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[63.704µs; 63.752µs] or [-0.037%; +0.037%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[15686001.446op/s; 15697593.442op/s] or [-0.037%; +0.037%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[60.490µs; 60.496µs] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[16530070.144op/s; 16531571.359op/s] or [-0.005%; +0.005%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[8.323µs; 8.355µs] or [-0.192%; +0.192%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[119701883.617op/s; 120171316.596op/s] or [-0.196%; +0.196%]|None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|257.576ns|269.937ns ± 17.507ns|261.951ns ± 2.181ns|267.469ns|313.148ns|327.745ns|329.101ns|25.63% |2.104 |3.385 |6.47%|1.238ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[267.511ns; 272.364ns] or [-0.899%; +0.899%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|1.153µs|1.212µs ± 0.023µs|1.214µs ± 0.016µs|1.232µs|1.236µs|1.238µs|1.238µs|1.97% |-1.024 |0.302 |1.91%|0.002µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[1.209µs; 1.215µs] or [-0.266%; +0.266%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|192.223µs |193.701µs ± 0.624µs |193.723µs ± 0.402µs |194.105µs |194.696µs |195.101µs |195.861µs |1.10% |0.082 |0.017 |0.32%|0.044µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |5105656.180op/s |5162640.682op/s ± 16625.212op/s |5162020.544op/s ± 10717.853op/s |5173236.403op/s |5189878.866op/s |5197006.646op/s |5202296.074op/s |0.78% |-0.063 |-0.004 |0.32%|1175.580op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|18.175µs |18.214µs ± 0.029µs |18.197µs ± 0.014µs |18.233µs |18.273µs |18.283µs |18.287µs |0.50% |0.786 |-0.486 |0.16%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |54683756.422op/s|54903678.528op/s ± 88189.324op/s |54955060.267op/s ± 43005.489op/s|54974281.471op/s|54995935.662op/s|55014173.098op/s|55019196.104op/s|0.12% |-0.782 |-0.496 |0.16%|6235.927op/s |1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|11.322µs |11.358µs ± 0.029µs |11.350µs ± 0.013µs |11.370µs |11.400µs |11.450µs |11.592µs |2.13% |3.330 |20.742 |0.26%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |86269320.592op/s|88045809.646op/s ± 223728.901op/s|88105757.440op/s ± 98518.107op/s|88183421.596op/s|88274338.851op/s|88307613.742op/s|88326197.689op/s|0.25% |-3.242 |19.797 |0.25%|15820.022op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[193.615µs; 193.788µs] or [-0.045%; +0.045%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[5160336.587op/s; 5164944.776op/s] or [-0.045%; +0.045%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[18.210µs; 18.218µs] or [-0.022%; +0.022%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[54891456.336op/s; 54915900.720op/s] or [-0.022%; +0.022%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[11.354µs; 11.362µs] or [-0.036%; +0.036%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[88014802.972op/s; 88076816.320op/s] or [-0.035%; +0.035%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|137.817µs|138.947µs ± 0.549µs|138.919µs ± 0.204µs|139.155µs|139.508µs|140.038µs|144.707µs|4.17% |5.766 |58.990 |0.39%|0.039µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[138.871µs; 139.023µs] or [-0.055%; +0.055%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|-------------------|------------------|--------|--------|--------|---------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|19.057µs|25.928µs ± 12.125µs|19.959µs ± 0.199µs|28.394µs|48.639µs|50.684µs|104.271µs|422.43% |2.999 |13.503 |46.65%|0.857µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[24.248µs; 27.608µs] or [-6.481%; +6.481%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|73.410µs|73.538µs ± 0.111µs|73.525µs ± 0.024µs|73.549µs|73.612µs|73.790µs|74.914µs|1.89% |9.781 |116.669 |0.15%|0.008µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[73.523µs; 73.553µs] or [-0.021%; +0.021%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|37.343µs|38.015µs ± 1.182µs|37.500µs ± 0.092µs|37.580µs|40.584µs|40.607µs|40.647µs|8.39% |1.691 |0.893 |3.10%|0.084µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[37.851µs; 38.179µs] or [-0.431%; +0.431%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|9.088ms|9.122ms ± 0.015ms|9.122ms ± 0.008ms|9.130ms|9.146ms|9.156ms|9.205ms|0.90% |0.869 |3.756 |0.16%|0.001ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[9.120ms; 9.124ms] or [-0.023%; +0.023%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|---------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|9c74207 |1730495628 |dsn/crashtracker-receiver-timeout| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.585µs|2.629µs ± 0.013µs|2.629µs ± 0.006µs|2.634µs|2.655µs|2.661µs|2.665µs|1.40% |-0.376 |2.221 |0.50%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.627µs; 2.631µs] or [-0.069%; +0.069%]|None |None |None |

Baseline

Omitted due to size.