search

P403n1x87 / austin

Python frame stack sampler for CPython
https://pypi.org/project/austin-dist/
GNU General Public License v3.0
1.89k stars 54 forks source link

ci: bump GitHub action versions #193

Closed P403n1x87 closed 1 year ago

P403n1x87 commented 1 year ago

We bump the checkout action version from 2 to 3, and setup-python from 2 to 4 (the latest at the time this change is being made) to resolve the node12 deprecation warnings.

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage has no change and project coverage change: +0.32% :tada:

Comparison is base (76c0245) 68.04% compared to head (2e2b00f) 68.37%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## devel #193 +/- ## ========================================== + Coverage 68.04% 68.37% +0.32% ========================================== Files 27 27 Lines 2485 2485 Branches 761 761 ========================================== + Hits 1691 1699 +8 + Misses 458 454 -4 + Partials 336 332 -4 ``` [see 4 files with indirect coverage changes](https://app.codecov.io/gh/P403n1x87/austin/pull/193/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Gabriele+N.+Tornetta)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

github-actions[bot] commented 1 year ago

Austin Benchmarks

Running Austin benchmarks with Python 3.10.12

Benchmark Summary

Comparison of dev against 3.5.0.

The following scenarios show a statistically significant difference in performance between the two versions.

Sample Rate Saturation Error Rate Sampling Speed
Wall time [sampling interval: 10] :yellow_circle: :green_circle: :yellow_circle: :yellow_circle:
CPU time [sampling interval: 1000] :green_circle: :yellow_circle: :yellow_circle: :yellow_circle:
RSA keygen [sampling interval: 1] :green_circle: :yellow_circle: :green_circle: :yellow_circle:
Full metrics [sampling interval: 1000] :green_circle: :yellow_circle: :yellow_circle: :yellow_circle:
Multiprocess wall time [sampling interval: 1000] :yellow_circle: :yellow_circle: :green_circle: :yellow_circle:

Benchmark Results

Wall time [sampling interval: 1] ## Wall time [sampling interval: 1] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 88000 ± 4000 | 1 ± 0 | 8e-06 ± 5e-06 | 18 ± 1 | | 3.5.0 | 90000 ± 3000 | 1 ± 0 | 1e-05 ± 7e-06 | 17.4 ± 0.7 | | dev | 92000 ± 3000 | 1 ± 0 | 8e-06 ± 3e-06 | 17.2 ± 0.9 |
Wall time [sampling interval: 10] ## Wall time [sampling interval: 10] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 86000 ± 6000 | 0.61 ± 0.01 | 9e-06 ± 4e-06 | 18 ± 1 | | 3.5.0 | 87000 ± 4000 | 0.61 ± 0.01 | 7e-06 ± 3e-06 | 18 ± 1 | | dev | 87000 ± 4000 | 0.6 ± 0.01 | 7e-06 ± 5e-06 | 17.6 ± 0.5 |
Wall time [sampling interval: 100] ## Wall time [sampling interval: 100] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 9400 ± 300 | 0.01 ± 0.001 | 4e-05 ± 3e-05 | 22.2 ± 0.9 | | 3.5.0 | 9400 ± 200 | 0.01 ± 0.001 | 3e-05 ± 5e-05 | 22.5 ± 0.7 | | dev | 9400 ± 200 | 0.011 ± 0.001 | 3e-05 ± 2e-05 | 23.0 ± 0.9 |
Wall time [sampling interval: 1000] ## Wall time [sampling interval: 1000] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 1740 ± 20 | 0.001 ± 0.0005 | 2e-05 ± 5e-05 | 36 ± 2 | | 3.5.0 | 1750 ± 20 | 0.0012 ± 0.0006 | 0 ± 0 | 36 ± 2 | | dev | 1740 ± 20 | 0.0012 ± 0.0005 | 2e-05 ± 5e-05 | 36 ± 1 |
CPU time [sampling interval: 1] ## CPU time [sampling interval: 1] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 37000 ± 2000 | 1 ± 0 | 1.7e-05 ± 1e-05 | 32.0 ± 0.9 | | 3.5.0 | 37000 ± 2000 | 1 ± 0 | 1.5e-05 ± 6e-06 | 32 ± 1 | | dev | 37000 ± 2000 | 1 ± 0 | 1.4e-05 ± 9e-06 | 32 ± 1 |
CPU time [sampling interval: 10] ## CPU time [sampling interval: 10] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 38000 ± 1000 | 0.9999 ± 0.0001 | 1.4e-05 ± 8e-06 | 31.6 ± 0.5 | | 3.5.0 | 36000 ± 4000 | 0.9999 ± 0.0002 | 2e-05 ± 1e-05 | 33 ± 2 | | dev | 36000 ± 3000 | 0.9996 ± 0.0007 | 1.6e-05 ± 8e-06 | 32 ± 1 |
CPU time [sampling interval: 100] ## CPU time [sampling interval: 100] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 4500 ± 200 | 0.024 ± 0.001 | 7e-05 ± 4e-05 | 41 ± 1 | | 3.5.0 | 4600 ± 100 | 0.023 ± 0.002 | 5e-05 ± 5e-05 | 40 ± 1 | | dev | 4600 ± 200 | 0.025 ± 0.002 | 5e-05 ± 7e-05 | 41 ± 1 |
CPU time [sampling interval: 1000] ## CPU time [sampling interval: 1000] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 870 ± 9 | 0.0016 ± 0.0006 | 0.0001 ± 0.0002 | 64 ± 3 | | 3.5.0 | 880 ± 9 | 0.002 ± 0.001 | 0.0001 ± 0.0002 | 65 ± 3 | | dev | 888 ± 3 | 0.002 ± 0.001 | 0.0001 ± 0.0002 | 65 ± 4 |
RSA keygen [sampling interval: 1] ## RSA keygen [sampling interval: 1] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 28100 ± 900 | 1 ± 0 | 0.0002 ± 0.0002 | 35 ± 1 | | 3.5.0 | 27400 ± 800 | 1 ± 0 | 0.0005 ± 0.0003 | 35 ± 1 | | dev | 28200 ± 600 | 1 ± 0 | 0.0002 ± 0.0001 | 34.8 ± 0.9 |
RSA keygen [sampling interval: 10] ## RSA keygen [sampling interval: 10] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 27600 ± 800 | 0.998 ± 0.002 | 0.0004 ± 0.0004 | 35.0 ± 0.9 | | 3.5.0 | 27900 ± 700 | 0.999 ± 0.002 | 0.0002 ± 0.0001 | 35 ± 1 | | dev | 27500 ± 900 | 0.997 ± 0.004 | 0.0002 ± 0.0002 | 36 ± 2 |
RSA keygen [sampling interval: 100] ## RSA keygen [sampling interval: 100] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 5800 ± 100 | 0.044 ± 0.007 | 0.0008 ± 0.0006 | 48 ± 3 | | 3.5.0 | 5800 ± 100 | 0.04 ± 0.01 | 0.0007 ± 0.0008 | 46 ± 5 | | dev | 5800 ± 100 | 0.04 ± 0.02 | 0.0005 ± 0.0007 | 47 ± 4 |
RSA keygen [sampling interval: 1000] ## RSA keygen [sampling interval: 1000] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 885 ± 6 | 0.002 ± 0.001 | 0.001 ± 0.002 | 76 ± 3 | | 3.5.0 | 887 ± 8 | 0.001 ± 0.001 | 0.001 ± 0.001 | 74 ± 3 | | dev | 886 ± 9 | 0.002 ± 0.002 | 0.001 ± 0.001 | 74 ± 4 |
Full metrics [sampling interval: 1] ## Full metrics [sampling interval: 1] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 34000 ± 2000 | 1 ± 0 | 2.1e-05 ± 9e-06 | 45 ± 3 | | 3.5.0 | 35000 ± 3000 | 1 ± 0 | 2.1e-05 ± 9e-06 | 43 ± 3 | | dev | 35000 ± 2000 | 1 ± 0 | 1.8e-05 ± 7e-06 | 44 ± 2 |
Full metrics [sampling interval: 10] ## Full metrics [sampling interval: 10] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 35000 ± 3000 | 1 ± 0 | 2e-05 ± 8e-06 | 44 ± 4 | | 3.5.0 | 34000 ± 2000 | 1 ± 0 | 4e-05 ± 9e-05 | 45 ± 3 | | dev | 35000 ± 1000 | 1 ± 0 | 1.7e-05 ± 8e-06 | 43 ± 1 |
Full metrics [sampling interval: 100] ## Full metrics [sampling interval: 100] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 8100 ± 200 | 0.055 ± 0.003 | 7e-05 ± 4e-05 | 63 ± 3 | | 3.5.0 | 8000 ± 300 | 0.053 ± 0.002 | 5e-05 ± 4e-05 | 63 ± 3 | | dev | 8100 ± 200 | 0.054 ± 0.003 | 4e-05 ± 4e-05 | 63 ± 3 |
Full metrics [sampling interval: 1000] ## Full metrics [sampling interval: 1000] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 1690 ± 40 | 0.002 ± 0.001 | 0.0001 ± 0.0001 | 83 ± 4 | | 3.5.0 | 1660 ± 30 | 0.0021 ± 0.0008 | 8e-05 ± 9e-05 | 84 ± 3 | | dev | 1700 ± 30 | 0.0026 ± 0.0006 | 2e-05 ± 5e-05 | 83 ± 1 |
Multiprocess wall time [sampling interval: 1] ## Multiprocess wall time [sampling interval: 1] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 1400 ± 100 | 1 ± 0 | 0.0004 ± 0.0004 | 430 ± 30 | | 3.5.0 | 2000 ± 100 | 1 ± 0 | 0.0002 ± 0.0002 | 460 ± 20 | | dev | 2000 ± 100 | 1 ± 0 | 0.00015 ± 4e-05 | 460 ± 30 |
Multiprocess wall time [sampling interval: 10] ## Multiprocess wall time [sampling interval: 10] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 1400 ± 200 | 1 ± 0 | 0.0003 ± 0.0003 | 440 ± 30 | | 3.5.0 | 2000 ± 100 | 1 ± 0 | 0.0002 ± 0.0002 | 460 ± 30 | | dev | 2000 ± 300 | 1 ± 0 | 0.00017 ± 9e-05 | 400 ± 100 |
Multiprocess wall time [sampling interval: 100] ## Multiprocess wall time [sampling interval: 100] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 1300 ± 100 | 0.09 ± 0.02 | 0.00021 ± 7e-05 | 450 ± 30 | | 3.5.0 | 1910 ± 100 | 0.1 ± 0.03 | 0.00014 ± 7e-05 | 490 ± 20 | | dev | 1900 ± 100 | 0.09 ± 0.03 | 0.00012 ± 8e-05 | 470 ± 30 |
Multiprocess wall time [sampling interval: 1000] ## Multiprocess wall time [sampling interval: 1000] | | Sample Rate | Saturation | Error Rate | Sampling Speed | | --- |:-----------:|:----------:|:----------:|:--------------:| | 3.4.1 | 1140 ± 60 | 0.03 ± 0.02 | 7e-05 ± 4e-05 | 260 ± 80 | | 3.5.0 | 1900 ± 100 | 0.02 ± 0.01 | 3e-05 ± 2e-05 | 220 ± 60 | | dev | 1860 ± 80 | 0.031 ± 0.007 | 1e-05 ± 1e-05 | 250 ± 30 |