search

openssl / project

Tracking of project related issues
2 stars 1 forks source link

Capture perf data for Debian 11 on x86_64 #581

Closed nhorman closed 3 months ago

nhorman commented 5 months ago
As per the description in #577 record the requested perf programs output in the format specified: thread count number of iterations openssl 1.1.1 per operation avg usec openssl 3.0.0 avg usec master usec std deviation

And post results here and in #577

andrewkdinh commented 3 months ago

Results from Debian 11 AMD64 Proxmox

evp_fetch

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 N/A N/A 0.1618 0.0003 0.0824 0.0002 0.0820 0.0001
2 25 N/A N/A 0.3211 0.0005 0.1631 0.0003 0.1625 0.0003
4 25 N/A N/A 0.6348 0.0012 0.3217 0.0007 0.3210 0.0017
8 25 N/A N/A 1.2470 0.0030 0.6321 0.0018 0.6306 0.0014
16 25 N/A N/A 2.4620 0.0531 1.2270 0.0039 1.2260 0.0041
32 25 N/A N/A 4.7441 0.0125 2.3391 0.0112 2.3319 0.0090
64 25 N/A N/A 9.0716 0.0220 4.2605 0.0246 4.2504 0.0199
128 25 N/A N/A 16.4936 0.1381 5.9813 0.1359 5.9980 0.0954

randbytes

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 2.2541 0.0019 1.3947 0.0023 1.0642 0.0087 1.0631 0.0009
2 25 4.5084 0.0061 2.7938 0.0097 2.1168 0.0072 2.1207 0.0030
4 25 9.0477 0.0893 5.6258 0.0670 4.2192 0.0178 4.2325 0.0077
8 25 18.1525 0.1867 11.3251 0.1802 8.3653 0.0380 8.3926 0.0263
16 25 36.6059 1.0324 22.8913 0.8649 16.4176 0.1449 16.4358 0.0969
32 25 72.8887 3.6023 45.4407 3.3320 31.8911 0.6966 31.7136 0.3772
64 25 145.0330 13.8209 93.4990 11.6442 58.9559 0.6375 60.2034 2.7258
128 25 282.8700 30.5477 180.4504 46.7035 109.2727 13.0516 104.5485 8.4999

handshake

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 1217.2953 1.0240 1427.5974 2.1388 1326.4975 2.6612 1329.0060 1.7230
2 25 2439.8476 2.0067 2861.1862 2.9452 2659.6500 1.8641 2663.9048 2.2322
4 25 4880.5055 3.6224 5726.6675 7.8634 5323.1182 7.5582 5333.5367 5.7776
8 25 9772.8319 19.5223 11474.4904 27.5823 10648.9131 9.9322 10662.3953 7.9100
16 25 19566.8806 60.2966 23024.6991 84.7282 21298.6090 22.0242 21337.1727 25.4520
32 25 39187.7532 315.3131 46251.8248 359.7922 42429.6979 93.4631 42462.5956 56.2892
64 25 77638.9437 1008.5838 92787.7061 1163.1798 83885.1756 224.6088 83820.1271 269.6739
128 25 152954.7732 1891.5601 186055.1772 5109.1674 163696.5080 621.8416 163309.7661 645.3759

sslnew

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 1.4429 0.0407 1.4330 0.0517 1.9216 0.0936 2.0188 0.0913
2 25 2.8979 0.0866 2.8934 0.1463 3.8558 0.1476 3.9973 0.1921
4 25 5.9677 0.1670 5.8995 0.2510 7.5727 0.2290 7.9837 0.3548
8 25 12.2883 0.5586 12.1416 0.8192 15.1375 0.4864 15.7390 0.7073
16 25 26.0390 2.4912 25.4244 1.9196 29.8451 1.0322 31.1349 1.5428
32 25 56.1338 7.5938 52.4186 7.2151 58.2142 1.7719 61.2895 3.2254
64 25 110.4661 17.4287 108.5656 10.5930 110.2805 2.6176 116.7135 6.1346
128 25 207.4845 44.5883 237.7705 86.7578 191.6068 8.8171 198.5697 15.3038

newrawkey

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 0.0920 0.0002 2.3771 0.1343 1.5854 0.0995 1.5795 0.0854
2 25 0.1794 0.0017 4.8067 0.2642 3.1729 0.1835 3.1692 0.1554
4 25 0.3356 0.0049 9.8132 0.5085 6.4576 0.3495 6.2155 0.2677
8 25 0.5557 0.0172 19.9872 0.7353 12.7301 0.7110 12.4412 0.6510
16 25 0.8464 0.0342 43.0194 2.4242 25.4735 1.4168 24.5431 1.1301
32 25 0.7996 0.0540 96.4069 7.4576 48.9889 3.2234 47.4449 2.6698
64 25 0.9767 0.0914 198.5409 37.0168 92.0090 6.2834 89.7006 5.4520
128 25 0.0939 0.0027 544.2705 102.2980 159.8957 17.5108 158.2936 17.1086

rsasign

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 36.8219 0.0571 36.9107 0.0240 36.8098 0.0287 36.7735 0.0236
2 25 73.6618 0.1140 73.8674 0.0604 73.6347 0.0899 74.2690 1.3529
4 25 147.3235 0.2301 147.5825 0.1679 147.1017 0.2011 146.9186 0.1158
8 25 293.7885 0.6995 294.4138 0.8322 293.2784 0.7144 292.9053 0.3866
16 25 584.4971 2.4802 585.8835 3.5845 583.6632 2.8538 582.4994 2.2247
32 25 1149.9694 9.1564 1155.3581 11.1623 1147.5965 6.9968 1148.8752 8.1201
64 25 2259.4180 27.7588 2283.3765 20.1037 2264.0223 35.8312 2254.1091 24.1051
128 25 4490.4688 92.2341 4479.2352 88.5992 4486.3810 150.4046 4446.5574 66.5155

x509storeissuer

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 1.0507 0.0016 6.9832 0.0301 6.8554 0.0586 1.2121 0.0071
2 25 2.1057 0.0084 14.0590 0.0841 13.7337 0.1093 2.4264 0.0126
4 25 4.2432 0.0791 28.2996 0.2333 27.3568 0.1321 4.8655 0.0468
8 25 8.6115 0.2214 56.9002 0.5833 54.9786 0.4804 9.7140 0.1985
16 25 17.4687 1.0853 114.4961 1.8440 110.6370 1.2263 19.5668 0.7648
32 25 35.7722 3.7879 235.1906 4.8748 223.4953 4.0410 38.7867 2.2617
64 25 72.4844 12.0918 482.8155 18.3627 450.2735 10.6277 70.2320 5.6537
128 25 147.9289 47.3754 1013.6201 111.2415 919.9396 61.9776 133.6722 19.1145

providerdoall

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 N/A N/A 0.1680 0.0004 0.0910 0.0003 0.0911 0.0005
2 25 N/A N/A 0.3084 0.0289 0.1477 0.0160 0.1470 0.0115
4 25 N/A N/A 0.4466 0.0954 0.1447 0.0278 0.1495 0.0306
8 25 N/A N/A 0.3959 0.1898 0.1369 0.0230 0.1058 0.0117
16 25 N/A N/A 0.3674 0.5692 0.0995 0.0193 0.1027 0.0231
32 25 N/A N/A 0.1818 0.0409 0.0920 0.0012 0.0918 0.0003
64 25 N/A N/A 0.1700 0.0021 0.0920 0.0007 0.0921 0.0008
128 25 N/A N/A 0.1696 0.0013 0.2793 0.9363 0.0923 0.0006

rwlocks_rlock

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 0.0056 0.0000 0.0056 0.0000 0.0059 0.0000 0.0056 0.0000
2 25 0.0432 0.0829 0.0351 0.0604 0.0524 0.0964 0.0338 0.0553
4 25 0.0148 0.0068 0.0141 0.0052 0.0290 0.0635 0.0194 0.0135
8 25 0.0130 0.0040 0.0131 0.0070 0.0128 0.0042 0.0121 0.0047
16 25 0.0221 0.0061 0.0188 0.0022 0.0224 0.0050 0.0229 0.0063
32 25 0.0185 0.0010 0.0182 0.0008 0.0189 0.0005 0.0196 0.0047
64 25 0.0188 0.0007 0.0183 0.0002 0.0195 0.0012 0.0192 0.0014
128 25 0.0191 0.0003 0.0189 0.0006 0.0195 0.0003 0.0193 0.0002

rwlocks_wlock

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 N/A N/A N/A N/A N/A N/A N/A N/A
2 25 0.0667 0.1012 0.0514 0.0789 0.0770 0.1101 0.0313 0.0436
4 25 0.0203 0.0042 0.0202 0.0057 0.0223 0.0089 0.0236 0.0074
8 25 0.0015 0.0077 0.0033 0.0083 0.0029 0.0086 0.0022 0.0082
16 25 0.0204 0.0073 0.0226 0.0088 0.0292 0.0113 0.0223 0.0070
32 25 0.0169 0.0012 0.0163 0.0006 0.0171 0.0005 0.0193 0.0120
64 25 0.0181 0.0010 0.0177 0.0004 0.0184 0.0002 0.0189 0.0018
128 25 0.0038 0.0078 0.0008 0.0038 0.0032 0.0074 0.0055 0.0089

pkeyread_dh_der

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 2119.6935 0.3623 2173.9181 0.6069 2125.6942 0.6163 2130.4837 5.8753
2 25 4239.3585 0.6279 4350.2474 1.7914 4258.7950 14.6483 4259.3225 6.2943
4 25 8478.0310 1.3495 8701.4875 4.5845 8510.8482 3.3816 8519.6751 18.4837
8 25 16950.4092 5.3438 17403.9766 6.2914 17021.6048 7.9262 17028.6147 7.4205
16 25 33908.2405 17.9907 34829.9331 34.2376 34014.9718 10.1443 34013.9971 8.3615
32 25 67710.1862 62.3018 69653.5840 141.2003 67915.6756 18.9725 67967.0700 29.7632
64 25 134918.5023 63.0800 138930.4869 763.5402 135437.4104 229.4031 135322.9416 35.2597
128 25 267781.9750 904.5858 276296.1019 2300.2387 268816.1123 646.6851 268878.4531 845.2557

pkeyread_dhx_der

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 401.8265 0.2857 459.4595 0.1169 408.3516 0.9428 408.2239 0.0901
2 25 803.2940 0.3501 921.1383 2.8495 817.5227 1.3954 816.9660 0.7183
4 25 1604.9473 1.1751 1840.5492 2.2300 1634.0402 2.3774 1633.0278 1.0207
8 25 3200.5837 2.0036 3677.9250 12.2722 3260.9954 2.7915 3259.2631 2.3965
16 25 6375.5180 6.5325 7330.5351 37.6333 6489.7130 4.7098 6491.1519 4.4341
32 25 12622.4887 9.2584 14578.0392 150.8379 12868.4170 47.0906 12850.8866 39.5205
64 25 24768.5042 328.2891 28879.9279 715.5722 25338.9324 204.6700 25245.5793 34.0579
128 25 46362.9681 389.0770 56632.7605 2517.3686 48963.6192 410.2140 48794.0973 140.9153

pkeyread_dsa_der

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 402.1981 0.0425 523.7696 0.5027 413.3822 1.0681 412.0439 0.4933
2 25 805.1261 0.4413 1049.0491 1.4944 826.2465 0.3602 823.5864 0.5182
4 25 1611.6915 1.4619 2096.2320 2.5328 1651.8049 0.9281 1644.8588 1.5301
8 25 3215.3184 4.3708 4191.5417 12.8323 3298.1842 1.5231 3283.8701 2.7550
16 25 6395.2048 16.4984 8353.5843 53.4394 6567.6664 9.3389 6535.4084 7.3555
32 25 12660.8065 80.2584 16584.5476 190.6711 13017.5271 49.3831 12946.6179 12.6445
64 25 24829.3116 410.3704 33131.6662 773.2359 25530.7733 28.5823 25437.9047 31.3920
128 25 46523.0872 633.0417 65898.9388 3318.9230 49512.3632 743.1650 49251.4781 562.0272

pkeyread_ec_der

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 13.9072 0.0966 86.8188 0.2145 22.0625 0.1947 22.2325 0.1304
2 25 27.3586 0.2295 173.7660 0.6439 43.8338 0.3230 44.1177 0.4564
4 25 52.7120 0.6118 343.9675 2.1853 85.1640 0.6144 85.9317 0.8789
8 25 97.6809 1.0168 677.6261 8.3507 159.8614 2.2767 161.5501 3.4762
16 25 169.0555 2.2849 1343.2404 43.4967 291.0802 6.7335 292.1118 5.7532
32 25 238.0827 4.5241 2623.7829 238.9999 428.5964 49.7282 415.8142 13.4366
64 25 228.7477 9.8960 4829.5870 582.6401 309.2854 75.7277 344.8187 156.6314
128 25 106.8867 74.4102 7215.1491 1517.9245 499.3620 409.1402 368.3754 255.2665

pkeyread_rsa_der

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 3.3573 0.0149 91.6874 0.1976 12.6919 0.1604 12.6075 0.1493
2 25 6.3901 0.2107 183.1657 0.5679 24.7520 0.3820 24.6975 0.3081
4 25 11.1703 0.9078 363.7412 2.7276 46.9312 0.6420 47.1876 0.6792
8 25 15.4998 1.5548 720.3792 13.0146 82.8245 1.6274 83.7487 2.0909
16 25 18.2200 11.5524 1412.4542 43.7813 121.3359 10.4247 121.8664 12.0297
32 25 20.4126 34.5063 2757.0400 208.0600 77.4323 84.7437 82.6355 60.7782
64 25 5.4502 10.1964 5204.6783 772.8287 76.7321 71.2146 130.3885 105.6709
128 25 3.4169 0.0432 8281.4763 2762.6284 195.1133 243.6549 175.2710 221.0369

pkeyread_x25519_der

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 29.5906 0.0272 78.9259 0.1318 34.4410 0.1071 34.4154 0.0799
2 25 58.7441 0.2088 157.6364 0.4516 68.3071 0.1979 68.3921 0.1611
4 25 115.3998 0.5713 314.0202 2.5247 135.0573 0.6964 134.9584 0.6098
8 25 223.4049 1.1263 618.4718 8.9576 260.6194 2.3465 260.2532 2.2295
16 25 409.0777 3.8303 1214.7301 38.9906 491.5253 6.0970 491.9842 6.2674
32 25 698.5504 5.8475 2344.4232 128.6802 830.0724 46.5504 817.8570 11.2215
64 25 991.3202 27.7503 4614.3667 669.4993 1269.9392 176.1576 1225.9594 18.6817
128 25 971.2447 44.1812 6768.1111 1830.1738 1301.6368 315.5216 1290.8480 305.0250

pkeyread_dh_pem

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 2123.1114 0.9229 2428.5531 2.7823 2142.2985 0.8020 2144.2257 0.6771
2 25 4246.4338 0.7888 4855.4946 3.3739 4287.1289 3.5955 4287.8172 3.7822
4 25 8492.6578 1.7713 9714.1907 4.2381 8579.2541 4.8817 8580.4365 4.9265
8 25 16980.2532 4.6857 19437.2314 11.3314 17158.6307 6.7586 17165.6103 6.1355
16 25 33957.4739 16.1818 38879.9600 50.1715 34330.7472 13.8631 34318.5339 10.2609
32 25 67821.1278 48.7454 77741.3438 152.8395 68592.1373 50.1963 68543.2433 35.2210
64 25 135212.5730 321.3963 154942.8137 571.3131 136553.7670 104.4938 136563.6843 221.0406
128 25 268125.9316 198.4090 309359.3731 3623.0626 270952.0693 546.4156 271314.5589 761.6337

pkeyread_dhx_pem

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 406.3669 0.0803 703.2361 0.8477 419.2016 0.1437 419.4964 0.1395
2 25 812.5796 0.3744 1406.0193 1.3588 838.4663 0.4492 839.0210 0.3797
4 25 1623.2019 1.0165 2813.9637 25.7337 1675.5802 0.6445 1677.9762 5.6708
8 25 3238.9082 4.2881 5589.9475 13.8831 3344.4470 2.6668 3345.2734 1.8998
16 25 6452.0141 4.8067 11168.6536 54.2865 6663.5338 8.4127 6666.1246 9.0599
32 25 12801.6110 76.7596 22287.5699 207.5816 13192.1879 13.6985 13208.2375 38.9583
64 25 24914.1366 36.0366 44178.4313 822.2042 25897.5774 38.0233 25910.0771 47.8527
128 25 48987.7923 1489.1090 87149.2618 4175.6006 49775.9125 236.6263 49977.8313 671.0732

pkeyread_dsa_pem

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 406.4001 0.0743 707.9876 0.5097 425.1177 0.4092 423.7330 0.5134
2 25 812.5810 0.3139 1419.8500 16.6716 850.1444 0.2403 847.7346 1.2955
4 25 1623.3475 0.9464 2827.9029 3.8927 1698.5186 0.6577 1692.8095 1.3366
8 25 3239.0644 1.7463 5643.2949 12.5468 3434.5826 118.4755 3375.8879 2.4587
16 25 6459.3265 22.0023 11263.2769 41.3823 6760.5023 3.6532 6729.4021 9.1542
32 25 12788.6237 11.3003 22519.3249 249.0942 13403.1126 11.7396 13340.2173 40.8127
64 25 24943.5479 55.4791 44835.1804 862.5015 26281.0868 48.3368 26162.7528 155.5144
128 25 48551.1429 345.2528 88244.0557 3749.6927 50420.9256 107.5408 50219.7613 350.1545

pkeyread_ec_pem

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 15.2846 0.2315 316.0164 1.3438 30.2371 0.1425 30.7375 0.1805
2 25 29.9717 0.2616 629.9803 1.5970 59.9107 0.4589 60.7995 0.5245
4 25 57.9898 0.7180 1254.4399 14.1119 117.3012 2.0894 118.9699 2.8893
8 25 107.2419 4.3190 2484.0773 18.2156 227.1051 2.0766 230.7479 2.3779
16 25 188.0628 19.6770 4939.3239 58.5323 418.0104 7.8861 420.9083 5.9251
32 25 261.6497 7.5889 9785.7954 275.6402 736.5735 45.1231 744.3260 53.0852
64 25 250.8081 7.0072 19522.3500 1184.5605 1081.8211 176.5714 1005.2177 97.8553
128 25 122.6335 31.9950 37635.5252 3514.6874 1151.5559 395.6963 1266.2714 478.0694

pkeyread_rsa_pem

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 11.5590 0.0130 315.8612 1.1601 32.9409 0.2348 32.7628 0.1972
2 25 22.7682 0.3775 629.1879 2.1849 65.5854 0.4891 65.5398 0.3324
4 25 43.9943 1.3017 1254.5515 10.5792 128.6775 3.9182 129.8131 1.3628
8 25 79.2816 5.4900 2483.5817 13.8354 251.2079 2.7846 251.9997 2.0747
16 25 110.8717 6.8127 4936.3358 45.8618 473.7450 9.8109 476.2854 4.0219
32 25 62.8332 6.9002 9791.4585 176.4389 785.4670 10.8984 812.4943 51.6783
64 25 67.7560 5.5446 19379.9739 939.7709 1164.8757 171.3838 1181.5229 245.5899
128 25 53.9260 12.3010 37647.7471 2514.4182 1172.5047 308.7309 1240.9241 390.7515

pkeyread_x25519_pem

thread_ count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 30.4896 0.0538 321.9565 1.1371 40.3435 0.1328 40.2816 0.1447
2 25 60.4738 0.2035 641.7616 1.4237 80.2215 0.2390 80.2451 0.3003
4 25 119.3897 0.8889 1275.2844 6.1901 158.5470 0.5621 158.5357 0.6274
8 25 229.0977 1.1364 2535.5274 11.3190 308.6740 2.1497 308.1921 2.0103
16 25 417.8799 5.0185 5025.4497 47.3901 588.1075 6.0606 587.6021 9.6050
32 25 723.7232 7.3061 9973.9151 198.5209 1070.3448 19.4664 1068.6121 8.5520
64 25 1075.7612 250.0052 19533.7435 711.0144 1535.6984 142.8870 1513.6987 39.3100
128 25 1035.0720 303.5174 37807.5877 2551.4530 1500.0506 322.9381 1564.9574 486.3523
andrewkdinh commented 3 months ago

These results seem kinda off, maybe because it was run in Proxmox on a machine with only 1 CPU. Most of these operations are taking much longer than previous performance tests on other machines. These are the steps I followed:

# Run once
export WORK_PATH=FIXME \
    && cd ${WORK_PATH} \
    && cpan install File::TempDir \
    && mkdir -p ${WORK_PATH}/binaries \
    && wget https://raw.githubusercontent.com/Sashan/perftools/run-perf.pl/run-perf.pl \
    && chmod u+x run-perf.pl \
    && git clone --depth 1 https://github.com/openssl/perftools.git \
    && git clone --depth 1 https://github.com/openssl/openssl.git openssl-master \
    && git clone --depth 1 --branch OpenSSL_1_1_1-stable https://github.com/openssl/openssl.git openssl-1.1.1 \
    && git clone --depth 1 --branch openssl-3.0 https://github.com/openssl/openssl.git openssl-3.0 \
    && git clone --depth 1 --branch openssl-3.3 https://github.com/openssl/openssl.git openssl-3.3

# Do this manually, using screen or tmux for each version
# for VERSION in 1.1.1 3.0 master
export VERSION=FIXME \
    && cd ${WORK_PATH}/openssl-${VERSION} \
    && ./config --prefix=${WORK_PATH}/binaries/openssl-${VERSION} \
    && make \
    && make install

# IMPORTANT: Uncomment the line in Makefile saying `For setting RUNPATH on built executables uncomment this`
cd ${WORK_PATH}/perftools/source \
    && mkdir ${WORK_PATH}/tools-binaries/build-${VERSION} \
    && export TARGET_OSSL_INCLUDE_PATH=${WORK_PATH}/binaries/openssl-${VERSION}/include \
    && export TARGET_OSSL_LIBRARY_PATH=${WORK_PATH}/binaries/openssl-${VERSION}/lib64 \
    && export LD_LIBRARY_PATH=${TARGET_OSSL_LIBRARY_PATH} \
    && make clean \
    && make all \
    && mv evp_fetch handshake newrawkey pkeyread providerdoall randbytes rsasign rwlocks sslnew x509storeissuer ${WORK_PATH}/tools-binaries/build-${VERSION} \
    && ls # Make sure no other executable files exist

# For 1.1.1
mkdir ${WORK_PATH}/tools-binaries/build-${VERSION} \
    && cd ${WORK_PATH}/perftools/source \
    && export TARGET_OSSL_INCLUDE_PATH=${WORK_PATH}/binaries/openssl-${VERSION}/include \
    && export TARGET_OSSL_LIBRARY_PATH=${WORK_PATH}/binaries/openssl-${VERSION}/lib \
    && export LD_LIBRARY_PATH=${TARGET_OSSL_LIBRARY_PATH} \
    && make clean \
    && make all111 \
    && cp handshake newrawkey pkeyread randbytes rsasign rwlocks sslnew x509storeissuer ${WORK_PATH}/tools-binaries/build-${VERSION} \
    && ls # Make sure no other executable files exist

# Run once
export TOOLS_PATH=${WORK_PATH}/tools-binaries \
    && export OPENSSL_SRC=${WORK_PATH}/openssl-master \
    && cd ${WORK_PATH} \
    && ./run-perf.pl output.md