DataDog / libdatadog

Datadog shared rust-based library. For now only used in other products (e.g. Ruby or PHP libraries).
Apache License 2.0
47 stars 8 forks source link

add stale PR GH workflow #688

Closed ekump closed 1 week ago

ekump commented 1 week ago

What does this PR do?

Introduce the stale action for PRs.

Motivation

Good repository hygiene suggested by @hoolioh

Additional Notes

stale and keep-open labels have been added to the repo.

How to test the change?

I don't think we can really test the action until it is merged into main.

pr-commenter[bot] commented 1 week ago

Benchmarks

Comparison

Benchmark execution time: 2024-10-23 19:26:51

Comparing candidate commit feb75e8 in PR branch ekump/APMSP-1457-add-stale-pr-workflow with baseline commit 6e7ce4c in branch main.

Found 2 performance improvements and 1 performance regressions! Performance is the same for 48 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

scenario:redis/obfuscate_redis_string

scenario:tags/replace_trace_tags

Candidate

Candidate benchmark details ### Group 1 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |benching deserializing traces from msgpack to their internal representation |execution_time|1.158µs|1.207µs ± 0.021µs|1.206µs ± 0.018µs|1.225µs|1.230µs|1.232µs|1.232µs|2.20% |-0.700 |-0.491 |1.75%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |benching deserializing traces from msgpack to their internal representation |execution_time|[1.204µs; 1.210µs] or [-0.243%; +0.243%]|None |None |None | ### Group 2 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------|--------------|---------|-------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |benching string interning on wordpress profile|execution_time|142.796µs|144.104µs ± 0.420µs|144.066µs ± 0.191µs|144.301µs|144.640µs|145.478µs|146.445µs|1.65% |1.262 |7.020 |0.29%|0.030µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |benching string interning on wordpress profile|execution_time|[144.045µs; 144.162µs] or [-0.040%; +0.040%]|None |None |None | ### Group 3 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |concentrator/add_spans_to_concentrator|execution_time|9.066ms|9.107ms ± 0.016ms|9.108ms ± 0.010ms|9.117ms|9.134ms|9.146ms|9.155ms|0.52% |0.060 |0.273 |0.17%|0.001ms|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |concentrator/add_spans_to_concentrator|execution_time|[9.105ms; 9.110ms] or [-0.024%; +0.024%]|None |None |None | ### Group 4 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------------------------|--------------|-----------------|----------------------------------|---------------------------------|-----------------|-----------------|-----------------|-----------------|--------------------|--------|--------|-----|-------------|----|-----------| |credit_card/is_card_number/ |execution_time|4.602µs |4.614µs ± 0.003µs |4.614µs ± 0.002µs |4.616µs |4.618µs |4.620µs |4.650µs |0.77% |5.781 |62.419 |0.07%|0.000µs |1 |200 | |credit_card/is_card_number/ |throughput |215065438.150op/s|216709353.286op/s ± 155441.689op/s|216719678.149op/s ± 74959.293op/s|216795850.866op/s|216852984.359op/s|216895920.133op/s|217302841.543op/s|0.27% |-5.714 |61.581 |0.07%|10991.387op/s|1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|90.536µs |91.468µs ± 0.463µs |91.431µs ± 0.232µs |91.694µs |92.080µs |92.414µs |95.310µs |4.24% |2.922 |22.183 |0.51%|0.033µs |1 |200 | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |10492103.500op/s |10933075.034op/s ± 54601.707op/s |10937156.748op/s ± 27765.335op/s |10961924.577op/s |11004712.328op/s |11033439.087op/s |11045346.671op/s |0.99% |-2.695 |19.853 |0.50%|3860.924op/s |1 |200 | |credit_card/is_card_number/ 378282246310005 |execution_time|82.718µs |83.562µs ± 0.540µs |83.489µs ± 0.279µs |83.789µs |84.417µs |85.212µs |87.496µs |4.80% |2.487 |13.557 |0.64%|0.038µs |1 |200 | |credit_card/is_card_number/ 378282246310005 |throughput |11429139.620op/s |11967581.938op/s ± 76178.949op/s |11977624.002op/s ± 40064.624op/s |12015093.964op/s |12062219.038op/s |12080691.956op/s |12089264.713op/s |0.93% |-2.314 |12.000 |0.63%|5386.665op/s |1 |200 | |credit_card/is_card_number/37828224631 |execution_time|4.601µs |4.615µs ± 0.004µs |4.614µs ± 0.002µs |4.616µs |4.618µs |4.620µs |4.657µs |0.92% |6.852 |77.119 |0.08%|0.000µs |1 |200 | |credit_card/is_card_number/37828224631 |throughput |214744472.411op/s|216704449.394op/s ± 175819.798op/s|216725129.300op/s ± 75406.558op/s|216785570.685op/s|216852198.800op/s|216896564.049op/s|217332480.986op/s|0.28% |-6.774 |76.056 |0.08%|12432.337op/s|1 |200 | |credit_card/is_card_number/378282246310005 |execution_time|79.751µs |80.696µs ± 0.341µs |80.712µs ± 0.216µs |80.927µs |81.198µs |81.380µs |81.531µs |1.02% |-0.177 |-0.329 |0.42%|0.024µs |1 |200 | |credit_card/is_card_number/378282246310005 |throughput |12265208.343op/s |12392445.747op/s ± 52417.365op/s |12389792.795op/s ± 33127.334op/s |12423291.487op/s |12483698.102op/s |12512761.571op/s |12539022.693op/s |1.20% |0.197 |-0.320 |0.42%|3706.467op/s |1 |200 | |credit_card/is_card_number/37828224631000521389798 |execution_time|59.255µs |59.481µs ± 0.207µs |59.436µs ± 0.155µs |59.619µs |59.800µs |60.077µs |60.121µs |1.15% |0.776 |-0.171 |0.35%|0.015µs |1 |200 | |credit_card/is_card_number/37828224631000521389798 |throughput |16633111.742op/s |16812430.379op/s ± 58225.936op/s |16824742.959op/s ± 44064.087op/s |16864549.452op/s |16872175.168op/s |16874479.257op/s |16876138.827op/s |0.31% |-0.763 |-0.210 |0.35%|4117.195op/s |1 |200 | |credit_card/is_card_number/x371413321323331 |execution_time|7.217µs |7.222µs ± 0.005µs |7.222µs ± 0.002µs |7.223µs |7.226µs |7.229µs |7.283µs |0.84% |9.319 |109.498 |0.07%|0.000µs |1 |200 | |credit_card/is_card_number/x371413321323331 |throughput |137311786.189op/s|138458876.455op/s ± 94230.065op/s |138464559.997op/s ± 30676.019op/s|138496894.207op/s|138528554.892op/s|138534893.200op/s|138554410.317op/s|0.06% |-9.268 |108.650 |0.07%|6663.072op/s |1 |200 | |credit_card/is_card_number_no_luhn/ |execution_time|4.601µs |4.614µs ± 0.002µs |4.614µs ± 0.001µs |4.616µs |4.618µs |4.619µs |4.631µs |0.36% |0.996 |13.058 |0.05%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/ |throughput |215950005.630op/s|216716641.958op/s ± 113143.979op/s|216727405.188op/s ± 63831.404op/s|216786199.613op/s|216851739.843op/s|216882761.466op/s|217326203.723op/s|0.28% |-0.974 |12.987 |0.05%|8000.487op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|73.832µs |74.432µs ± 0.187µs |74.457µs ± 0.115µs |74.544µs |74.674µs |74.769µs |75.360µs |1.21% |0.061 |2.677 |0.25%|0.013µs |1 |200 | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |13269656.022op/s |13435125.320op/s ± 33712.832op/s |13430557.337op/s ± 20702.696op/s |13453669.953op/s |13494627.993op/s |13522609.277op/s |13544307.493op/s |0.85% |-0.026 |2.574 |0.25%|2383.857op/s |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|66.319µs |66.931µs ± 0.252µs |66.946µs ± 0.186µs |67.118µs |67.321µs |67.496µs |67.530µs |0.87% |0.078 |-0.610 |0.37%|0.018µs |1 |200 | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |14808337.173op/s |14941079.062op/s ± 56145.093op/s |14937448.695op/s ± 41578.080op/s |14983492.349op/s |15031949.055op/s |15042029.597op/s |15078574.451op/s |0.94% |-0.063 |-0.616 |0.37%|3970.058op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|4.602µs |4.615µs ± 0.004µs |4.614µs ± 0.001µs |4.616µs |4.618µs |4.625µs |4.650µs |0.78% |5.596 |45.010 |0.09%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631 |throughput |215032028.168op/s|216689809.919op/s ± 190011.441op/s|216710975.138op/s ± 59885.099op/s|216763502.445op/s|216844904.245op/s|216892171.586op/s|217303034.795op/s|0.27% |-5.555 |44.597 |0.09%|13435.838op/s|1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|62.173µs |62.648µs ± 0.178µs |62.629µs ± 0.122µs |62.754µs |62.982µs |63.140µs |63.198µs |0.91% |0.675 |0.524 |0.28%|0.013µs |1 |200 | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |15823307.455op/s |15962395.271op/s ± 45263.365op/s |15967004.987op/s ± 31275.998op/s |15998222.597op/s |16012606.128op/s |16032098.978op/s |16084221.811op/s |0.73% |-0.658 |0.502 |0.28%|3200.603op/s |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|59.260µs |59.490µs ± 0.207µs |59.453µs ± 0.157µs |59.616µs |59.924µs |60.066µs |60.072µs |1.04% |0.799 |-0.137 |0.35%|0.015µs |1 |200 | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |16646807.059op/s |16809772.476op/s ± 58291.677op/s |16819889.390op/s ± 44506.100op/s |16863312.600op/s |16872317.336op/s |16873959.970op/s |16874674.489op/s |0.33% |-0.786 |-0.169 |0.35%|4121.844op/s |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|7.218µs |7.222µs ± 0.002µs |7.222µs ± 0.002µs |7.224µs |7.226µs |7.227µs |7.232µs |0.14% |0.445 |0.620 |0.03%|0.000µs |1 |200 | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |138272417.428op/s|138464059.473op/s ± 43942.850op/s |138459209.917op/s ± 33851.580op/s|138502569.223op/s|138528985.112op/s|138535041.192op/s|138548408.814op/s|0.06% |-0.443 |0.612 |0.03%|3107.229op/s |1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------------------------|--------------|------------------------------------------------------------|-------------------|------------------------|---------------| |credit_card/is_card_number/ |execution_time|[4.614µs; 4.615µs] or [-0.010%; +0.010%] |None |None |None | |credit_card/is_card_number/ |throughput |[216687810.563op/s; 216730896.009op/s] or [-0.010%; +0.010%]|None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |execution_time|[91.404µs; 91.532µs] or [-0.070%; +0.070%] |None |None |None | |credit_card/is_card_number/ 3782-8224-6310-005 |throughput |[10925507.762op/s; 10940642.305op/s] or [-0.069%; +0.069%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |execution_time|[83.488µs; 83.637µs] or [-0.090%; +0.090%] |None |None |None | |credit_card/is_card_number/ 378282246310005 |throughput |[11957024.268op/s; 11978139.608op/s] or [-0.088%; +0.088%] |None |None |None | |credit_card/is_card_number/37828224631 |execution_time|[4.614µs; 4.615µs] or [-0.011%; +0.011%] |None |None |None | |credit_card/is_card_number/37828224631 |throughput |[216680082.461op/s; 216728816.327op/s] or [-0.011%; +0.011%]|None |None |None | |credit_card/is_card_number/378282246310005 |execution_time|[80.648µs; 80.743µs] or [-0.059%; +0.059%] |None |None |None | |credit_card/is_card_number/378282246310005 |throughput |[12385181.204op/s; 12399710.289op/s] or [-0.059%; +0.059%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |execution_time|[59.452µs; 59.509µs] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number/37828224631000521389798 |throughput |[16804360.824op/s; 16820499.934op/s] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number/x371413321323331 |execution_time|[7.222µs; 7.223µs] or [-0.009%; +0.009%] |None |None |None | |credit_card/is_card_number/x371413321323331 |throughput |[138445817.075op/s; 138471935.836op/s] or [-0.009%; +0.009%]|None |None |None | |credit_card/is_card_number_no_luhn/ |execution_time|[4.614µs; 4.615µs] or [-0.007%; +0.007%] |None |None |None | |credit_card/is_card_number_no_luhn/ |throughput |[216700961.291op/s; 216732322.625op/s] or [-0.007%; +0.007%]|None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |execution_time|[74.406µs; 74.458µs] or [-0.035%; +0.035%] |None |None |None | |credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 |throughput |[13430453.046op/s; 13439797.594op/s] or [-0.035%; +0.035%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |execution_time|[66.896µs; 66.965µs] or [-0.052%; +0.052%] |None |None |None | |credit_card/is_card_number_no_luhn/ 378282246310005 |throughput |[14933297.892op/s; 14948860.232op/s] or [-0.052%; +0.052%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |execution_time|[4.614µs; 4.615µs] or [-0.012%; +0.012%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631 |throughput |[216663476.161op/s; 216716143.678op/s] or [-0.012%; +0.012%]|None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |execution_time|[62.623µs; 62.672µs] or [-0.039%; +0.039%] |None |None |None | |credit_card/is_card_number_no_luhn/378282246310005 |throughput |[15956122.204op/s; 15968668.338op/s] or [-0.039%; +0.039%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|execution_time|[59.461µs; 59.519µs] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number_no_luhn/37828224631000521389798|throughput |[16801693.811op/s; 16817851.142op/s] or [-0.048%; +0.048%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |execution_time|[7.222µs; 7.222µs] or [-0.004%; +0.004%] |None |None |None | |credit_card/is_card_number_no_luhn/x371413321323331 |throughput |[138457969.417op/s; 138470149.529op/s] or [-0.004%; +0.004%]|None |None |None | ### Group 5 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|---------------------------------|---------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|-------------|----|-----------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|190.650µs |192.812µs ± 0.773µs |192.785µs ± 0.503µs |193.327µs |193.921µs |194.450µs |195.509µs |1.41% |0.063 |0.460 |0.40%|0.055µs |1 |200 | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |5114866.440op/s |5186489.408op/s ± 20786.860op/s |5187136.885op/s ± 13530.477op/s |5199407.901op/s |5220163.574op/s |5234720.855op/s |5245210.122op/s |1.12% |-0.034 |0.434 |0.40%|1469.853op/s |1 |200 | |normalization/normalize_name/normalize_name/bad-name |execution_time|18.196µs |18.233µs ± 0.022µs |18.239µs ± 0.021µs |18.251µs |18.263µs |18.286µs |18.287µs |0.26% |0.171 |-1.156 |0.12%|0.002µs |1 |200 | |normalization/normalize_name/normalize_name/bad-name |throughput |54683300.276op/s|54845618.927op/s ± 65033.599op/s |54826548.316op/s ± 61704.089op/s |54909228.182op/s|54930935.987op/s|54942103.696op/s|54956493.552op/s|0.24% |-0.168 |-1.161 |0.12%|4598.570op/s |1 |200 | |normalization/normalize_name/normalize_name/good |execution_time|11.309µs |11.366µs ± 0.057µs |11.359µs ± 0.014µs |11.376µs |11.404µs |11.433µs |12.090µs |6.44% |10.469 |130.844 |0.50%|0.004µs |1 |200 | |normalization/normalize_name/normalize_name/good |throughput |82714842.185op/s|87986917.965op/s ± 418010.954op/s|88039042.939op/s ± 111153.833op/s|88133657.092op/s|88282327.712op/s|88361346.470op/s|88421390.300op/s|0.43% |-10.121 |124.915 |0.47%|29557.838op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|execution_time|[192.705µs; 192.919µs] or [-0.056%; +0.056%] |None |None |None | |normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...|throughput |[5183608.549op/s; 5189370.267op/s] or [-0.056%; +0.056%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |execution_time|[18.230µs; 18.236µs] or [-0.016%; +0.016%] |None |None |None | |normalization/normalize_name/normalize_name/bad-name |throughput |[54836605.895op/s; 54854631.958op/s] or [-0.016%; +0.016%]|None |None |None | |normalization/normalize_name/normalize_name/good |execution_time|[11.358µs; 11.373µs] or [-0.069%; +0.069%] |None |None |None | |normalization/normalize_name/normalize_name/good |throughput |[87928985.667op/s; 88044850.263op/s] or [-0.066%; +0.066%]|None |None |None | ### Group 6 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |redis/obfuscate_redis_string|execution_time|37.224µs|37.850µs ± 1.141µs|37.315µs ± 0.059µs|37.448µs|40.309µs|40.382µs|40.788µs|9.31% |1.697 |0.921 |3.01%|0.081µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |redis/obfuscate_redis_string|execution_time|[37.692µs; 38.009µs] or [-0.418%; +0.418%]|None |None |None | ### Group 7 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |two way interface|execution_time|18.793µs|24.719µs ± 9.941µs|19.913µs ± 0.212µs|25.669µs|38.169µs|41.911µs|97.751µs|390.88% |3.448 |18.655 |40.12%|0.703µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |two way interface|execution_time|[23.341µs; 26.097µs] or [-5.574%; +5.574%]|None |None |None | ### Group 8 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |------------------------|--------------|--------|------------------|------------------|--------|--------|--------|--------|--------------------|--------|--------|-----|-------|----|-----------| |sql/obfuscate_sql_string|execution_time|73.644µs|73.758µs ± 0.145µs|73.729µs ± 0.033µs|73.780µs|73.873µs|74.180µs|75.460µs|2.35% |8.613 |95.181 |0.20%|0.010µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |------------------------|--------------|------------------------------------------|-------------------|------------------------|---------------| |sql/obfuscate_sql_string|execution_time|[73.737µs; 73.778µs] or [-0.027%; +0.027%]|None |None |None | ### Group 9 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |----------------------------------------|--------------|---------|--------------------|-------------------|---------|---------|---------|---------|--------------------|--------|--------|-----|-------|----|-----------| |normalization/normalize_trace/test_trace|execution_time|255.233ns|267.456ns ± 13.773ns|260.967ns ± 2.958ns|272.685ns|297.575ns|301.481ns|303.062ns|16.13% |1.295 |0.107 |5.14%|0.974ns|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |----------------------------------------|--------------|--------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_trace/test_trace|execution_time|[265.547ns; 269.364ns] or [-0.714%; +0.714%]|None |None |None | ### Group 10 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-------------------------------------------------------------------------------------------------------|--------------|----------------|--------------------------------|--------------------------------|----------------|----------------|----------------|----------------|--------------------|--------|--------|-----|------------|----|-----------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|623.444µs |624.688µs ± 0.398µs |624.682µs ± 0.277µs |624.965µs |625.266µs |625.481µs |626.557µs |0.30% |0.246 |1.831 |0.06%|0.028µs |1 |200 | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |1596023.985op/s |1600800.885op/s ± 1018.673op/s |1600815.684op/s ± 710.218op/s |1601482.973op/s |1602341.552op/s |1603259.557op/s |1603992.567op/s |0.20% |-0.239 |1.811 |0.06%|72.031op/s |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|461.249µs |462.209µs ± 0.493µs |462.146µs ± 0.309µs |462.526µs |463.056µs |463.466µs |463.692µs |0.33% |0.587 |-0.069 |0.11%|0.035µs |1 |200 | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |2156605.666op/s |2163523.696op/s ± 2307.225op/s |2163818.360op/s ± 1446.046op/s |2165185.907op/s |2166736.473op/s |2167665.291op/s |2168024.649op/s |0.19% |-0.581 |-0.078 |0.11%|163.145op/s |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|178.163µs |178.377µs ± 0.098µs |178.375µs ± 0.058µs |178.428µs |178.536µs |178.609µs |178.792µs |0.23% |0.552 |0.914 |0.05%|0.007µs |1 |200 | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |5593095.991op/s |5606106.187op/s ± 3085.246op/s |5606164.867op/s ± 1812.148op/s |5608113.956op/s |5610589.854op/s |5611400.497op/s |5612842.293op/s |0.12% |-0.548 |0.901 |0.05%|218.160op/s |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |execution_time|46.600µs |46.742µs ± 0.060µs |46.744µs ± 0.039µs |46.778µs |46.838µs |46.884µs |46.913µs |0.36% |0.146 |-0.191 |0.13%|0.004µs |1 |200 | |normalization/normalize_service/normalize_service/[empty string] |throughput |21315898.440op/s|21393919.061op/s ± 27367.513op/s|21393235.201op/s ± 17727.786op/s|21415851.293op/s|21437258.896op/s|21448599.357op/s|21459103.363op/s|0.31% |-0.139 |-0.197 |0.13%|1935.175op/s|1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|48.954µs |49.291µs ± 0.155µs |49.290µs ± 0.110µs |49.392µs |49.543µs |49.621µs |49.723µs |0.88% |0.183 |-0.418 |0.31%|0.011µs |1 |200 | |normalization/normalize_service/normalize_service/test_ASCII |throughput |20111337.299op/s|20288019.749op/s ± 63587.361op/s|20288074.141op/s ± 45272.629op/s|20336525.776op/s|20388534.844op/s|20419488.397op/s|20427359.360op/s|0.69% |-0.169 |-0.425 |0.31%|4496.305op/s|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-------------------------------------------------------------------------------------------------------|--------------|----------------------------------------------------------|-------------------|------------------------|---------------| |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|execution_time|[624.632µs; 624.743µs] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...|throughput |[1600659.707op/s; 1600942.063op/s] or [-0.009%; +0.009%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |execution_time|[462.141µs; 462.278µs] or [-0.015%; +0.015%] |None |None |None | |normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて |throughput |[2163203.937op/s; 2163843.455op/s] or [-0.015%; +0.015%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |execution_time|[178.363µs; 178.391µs] or [-0.008%; +0.008%] |None |None |None | |normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters |throughput |[5605678.602op/s; 5606533.772op/s] or [-0.008%; +0.008%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |execution_time|[46.734µs; 46.751µs] or [-0.018%; +0.018%] |None |None |None | |normalization/normalize_service/normalize_service/[empty string] |throughput |[21390126.187op/s; 21397711.935op/s] or [-0.018%; +0.018%]|None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |execution_time|[49.269µs; 49.312µs] or [-0.043%; +0.043%] |None |None |None | |normalization/normalize_service/normalize_service/test_ASCII |throughput |[20279207.152op/s; 20296832.345op/s] or [-0.043%; +0.043%]|None |None |None | ### Group 11 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |--------------------|--------------|-------|-----------------|-----------------|-------|-------|--------|--------|--------------------|--------|--------|------|-------|----|-----------| |write only interface|execution_time|1.383µs|3.206µs ± 1.387µs|3.058µs ± 0.025µs|3.076µs|3.197µs|13.823µs|14.936µs|388.34% |7.586 |57.812 |43.16%|0.098µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |--------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |write only interface|execution_time|[3.014µs; 3.398µs] or [-5.996%; +5.996%]|None |None |None | ### Group 12 |cpu_model |git_commit_sha|git_commit_date|git_branch | |----------------------------------------------|--------------|---------------|--------------------------------------| |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|feb75e8 |1729710979 |ekump/APMSP-1457-add-stale-pr-workflow| |scenario |metric |min |mean ± sd |median ± mad |p75 |p95 |p99 |max |peak_to_median_ratio|skewness|kurtosis|cv |sem |runs|sample_size| |-----------------------|--------------|-------|-----------------|-----------------|-------|-------|-------|-------|--------------------|--------|--------|-----|-------|----|-----------| |tags/replace_trace_tags|execution_time|2.668µs|2.706µs ± 0.018µs|2.708µs ± 0.010µs|2.714µs|2.736µs|2.748µs|2.752µs|1.64% |0.008 |0.009 |0.66%|0.001µs|1 |200 | |scenario |metric |95% CI mean |Shapiro-Wilk pvalue|Ljung-Box pvalue (lag=1)|Dip test pvalue| |-----------------------|--------------|----------------------------------------|-------------------|------------------------|---------------| |tags/replace_trace_tags|execution_time|[2.703µs; 2.708µs] or [-0.092%; +0.092%]|None |None |None |

Baseline

Omitted due to size.

codecov-commenter commented 1 week ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 71.80%. Comparing base (6e7ce4c) to head (feb75e8).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #688 +/- ## ========================================== + Coverage 71.78% 71.80% +0.02% ========================================== Files 271 271 Lines 41003 41003 ========================================== + Hits 29432 29444 +12 + Misses 11571 11559 -12 ``` | [Components](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | Coverage Δ | | |---|---|---| | [crashtracker](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `20.33% <ø> (ø)` | | | [crashtracker-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `9.07% <ø> (ø)` | | | [datadog-alloc](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `98.73% <ø> (ø)` | | | [data-pipeline](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `91.85% <ø> (-0.07%)` | :arrow_down: | | [data-pipeline-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [ddcommon](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `82.74% <ø> (ø)` | | | [ddcommon-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `69.12% <ø> (ø)` | | | [ddtelemetry](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `59.10% <ø> (ø)` | | | [ddtelemetry-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `22.13% <ø> (ø)` | | | [dogstatsd](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `88.86% <ø> (ø)` | | | [dogstatsd-client](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `79.77% <ø> (ø)` | | | [ipc](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `82.65% <ø> (ø)` | | | [profiling](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `84.30% <ø> (ø)` | | | [profiling-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `77.46% <ø> (ø)` | | | [serverless](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [sidecar](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `36.09% <ø> (ø)` | | | [sidecar-ffi](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `0.00% <ø> (ø)` | | | [spawn-worker](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `50.36% <ø> (ø)` | | | [tinybytes](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `94.77% <ø> (ø)` | | | [trace-mini-agent](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `72.45% <ø> (ø)` | | | [trace-normalization](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `98.25% <ø> (ø)` | | | [trace-obfuscation](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `95.77% <ø> (ø)` | | | [trace-protobuf](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `77.67% <ø> (ø)` | | | [trace-utils](https://app.codecov.io/gh/DataDog/libdatadog/pull/688/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=DataDog) | `93.08% <ø> (ø)` | |
ekump commented 1 week ago

I'm not sure if there's a way of testing it out before actually merging it in

@ivoanjo I couldn't find a way to test an action before it is initially merged to main. I may be able to do a dry-run test after the merge but before the cron job kicks off at 0:00 GMT.