search

openssl / project

Tracking of project related issues
2 stars 1 forks source link

Capture perf data for FreeBSD on x86_64 #583

Closed nhorman closed 4 months ago

nhorman commented 5 months ago
As per the description in #577 record the requested perf programs output in the format specified: thread count number of iterations openssl 1.1.1 per operation avg usec openssl 3.0.0 avg usec master usec std deviation

And post results here and in #577

nhorman commented 5 months ago

blocked on updated script availability (Friday)

vdukhovni commented 4 months ago

The results (more releases than perhaps requested) are below:

evp_fetch

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 N/A N/A .379756 .004000 .168001 .002236 .167760 .002449 .170085 .001000 .171349 .006082
2 25 N/A N/A .984457 .093610 .488145 .022226 .457047 .010049 .475492 .013856 .459170 .011575
4 25 N/A N/A 3.366545 .101133 1.041810 .019595 1.061068 .018165 1.057743 .012727 1.048695 .014106
8 25 N/A N/A 7.258940 .186649 2.143066 .044899 2.169732 .039357 2.162273 .073837 2.148477 .050527
16 25 N/A N/A 15.120971 .343113 4.498992 .061587 4.517611 .054267 4.487281 .051672 4.514398 .065299
32 25 N/A N/A 29.801463 .870917 8.773778 .149090 8.743973 .178075 8.768534 .150023 8.743018 .173908
64 25 N/A N/A 60.182209 1.613143 17.489750 .304639 17.490840 .362672 17.246919 .361678 17.462597 .368396
128 25 N/A N/A 118.910843 2.747406 32.212194 2.315647 32.211296 2.365434 31.888290 2.182311 32.667197 1.883337

randbytes

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 1.525769 .003872 1.294649 .020074 .989411 .018493 .778632 .018708 .777267 .009591 .772227 .009110
2 25 1.633594 .006708 1.620597 .022825 1.207215 .025139 .887319 .011575 .886738 .008366 .887432 .010488
4 25 1.710260 .024939 8.465674 .691937 8.846750 .776591 .912180 .015427 .914007 .017492 .909043 .012767
8 25 10.120951 1.279805 20.653120 .980354 19.978017 .908765 1.550615 .031717 1.509039 .035637 1.511601 .029933
16 25 34.511921 1.633562 51.992363 .629485 54.332088 1.290813 2.942551 .108747 3.136368 .102171 2.897519 .106263
32 25 40.600287 .618705 57.058432 .536161 61.053592 1.062544 4.376772 .159053 4.658188 .210192 4.373042 .094778
64 25 78.603085 1.587045 108.760709 2.590068 119.487624 2.096940 7.305106 .286291 7.810763 .239712 7.280709 .264134
128 25 153.606733 2.500693 219.886171 17.126538 237.805405 4.129675 13.368244 .764560 14.785373 .821412 13.438123 .588011

handshake

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 1340.987856 2.891380 1765.406188 2.595491 1584.903556 3.820831 1568.477196 2.873935 1545.799056 3.505467 1554.239324 3.821304
2 25 1355.550052 3.233694 1904.941388 29.546815 1617.423264 7.203813 1634.144976 11.381918 1578.634016 4.888229 1590.389696 6.326700
4 25 1345.952812 2.536894 2255.202532 35.745776 1633.896524 3.055118 1611.051720 3.308278 1582.497372 4.130406 1593.293900 4.119055
8 25 1371.403360 2.384746 3876.612220 82.980216 1700.292828 3.527598 1656.341780 4.207099 1632.201484 3.858471 1644.051964 6.010510
16 25 2606.378884 6.912380 7207.316500 224.376722 3130.690736 9.820131 2994.973804 6.005365 2958.505224 5.208879 2974.462616 4.507924
32 25 4894.009185 28.696646 14670.955770 380.536804 5609.541485 22.731452 5541.959225 19.212007 5460.953921 20.823733 5484.504337 23.993183
64 25 9718.493805 55.435508 28717.434510 646.133790 10957.281484 76.044343 10684.341206 78.409500 10553.010784 55.577868 10581.850043 81.770463
128 25 18661.459098 183.846275 55869.197025 1473.728322 20990.574129 203.579938 20469.311542 154.191495 20274.002575 151.810102 20517.984367 375.952419

sslnew

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 2.679884 .029376 2.501310 .017635 2.519848 .028705 3.364705 .051565 3.307527 .045011 3.467315 .053018
2 25 2.907174 .036290 2.721178 .046946 2.996062 .038704 4.041482 .055253 4.013751 .055946 4.168611 .064404
4 25 20.351315 1.212556 27.228907 2.172767 4.453157 .123328 5.990812 .255943 6.034419 .210853 5.979836 .141308
8 25 60.096215 3.327791 68.953233 3.125856 10.042005 .358418 13.326824 .511994 13.600384 .467037 13.888007 .428189
16 25 181.832766 5.698160 197.675185 7.423581 19.420034 .519864 26.144233 .942869 26.084678 .824206 25.968014 1.008207
32 25 275.331346 4.847312 282.484837 4.764565 32.276556 1.276070 44.828998 1.698972 44.103976 1.745783 44.107266 2.098863
64 25 554.710568 10.847492 576.521310 10.947884 62.537249 5.258471 89.730268 5.201489 87.999773 5.323580 88.088127 5.269875
128 25 1108.201350 19.344313 1151.707638 21.580714 115.826061 14.759245 160.909142 16.560851 165.415315 14.151658 165.048472 17.483222

newrawkey

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 .166481 .001732 4.513798 .024819 3.871800 .016703 3.546411 .028319 2.872320 .029189 2.885332 .035270
2 25 .166565 .001732 5.984760 .099814 4.960457 .131867 4.674393 .099065 3.786409 .052952 3.835105 .073287
4 25 .168664 .003605 9.482440 .481612 8.933641 .695867 5.569560 .136824 4.594222 .114908 4.704338 .120049
8 25 .170116 .010630 38.774639 2.929838 39.504302 2.943845 7.559260 .356803 7.001512 .293891 6.990447 .177735
16 25 .374624 .005916 133.929543 6.846394 131.127790 5.379244 15.861247 .289409 14.998872 .444247 15.139693 .459735
32 25 .554755 .009746 192.333073 2.915259 195.374915 2.759814 29.624431 1.128448 27.950116 1.005101 28.064857 .792308
64 25 .757261 .067963 398.696017 5.321569 403.791713 4.989879 59.857586 2.566512 56.676278 3.205109 57.101837 3.185124
128 25 .966985 .203872 793.801375 14.615934 810.862145 11.835797 103.309139 10.761212 97.196690 9.808248 97.341723 9.527021

rsasign

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 52.072032 .034727 53.096485 .064498 51.567506 .053516 52.761000 .077149 52.473937 .042579 52.038470 .037496
2 25 52.576509 .074746 54.618883 .138722 53.117343 .165305 54.379146 .124895 53.735839 .135085 53.390168 .094989
4 25 56.249852 .165710 57.712304 .107074 56.040619 .161099 57.291873 .195202 57.141855 .273888 56.681121 .200624
8 25 69.871237 .373763 71.416665 .312931 69.159732 .204303 70.649237 .243277 70.459718 .449339 70.037259 .413546
16 25 171.489606 .607485 173.782754 .544493 171.488977 .668358 172.199719 1.421840 173.060567 .525379 170.510946 .522732
32 25 353.346846 1.220425 357.490262 1.137787 356.644730 3.399130 354.932946 4.334750 355.185568 1.156634 351.273883 1.471175
64 25 728.217643 3.363914 733.832691 3.786581 725.159309 3.286129 725.859455 3.078634 728.690514 3.672688 717.196760 2.402672
128 25 1564.451231 329.104589 2928.475022 305.822140 2886.097943 429.172882 1466.716630 5.316933 1467.064722 7.111176 1464.497981 20.487229

x509storeissuer

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 1.418313 .025592 5.153891 .070943 4.756051 .064327 4.490811 .072924 4.314737 .047010 1.924706 .029664
2 25 1.533814 .025475 6.350383 .059908 5.520220 .074161 5.295421 .048363 5.189319 .068220 2.287719 .026888
4 25 2.792790 .434322 8.516049 .133944 6.743300 .262537 6.560753 .271265 6.238265 .260789 2.581553 .066158
8 25 21.388053 1.718233 20.755956 .361081 21.668410 .658573 21.005314 .598438 20.719357 .693156 22.691967 1.216308
16 25 65.000380 1.987626 58.600686 .557762 58.216137 .804538 57.643253 .753124 56.494387 .684251 76.171868 2.134684
32 25 86.232925 1.556644 113.150458 2.129982 117.384758 2.160429 118.062787 1.974048 116.410335 2.243751 169.573888 3.087502
64 25 169.256187 3.026709 223.832215 4.180510 235.248499 4.726523 457.929493 19.196528 459.470872 9.474678 434.030098 10.551619
128 25 338.089760 5.228401 440.227681 4.980684 456.374184 4.277338 1151.137171 167.014257 1233.343823 156.224038 1091.334605 99.485725

providerdoall

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 N/A N/A .397352 .001000 .222353 0 .185347 .001414 .186317 .001000 .185776 .001000
2 25 N/A N/A 2.266956 .194350 2.300204 .251143 .909102 .032449 .912412 .031096 .905856 .026925
4 25 N/A N/A 12.691650 .377254 11.017188 .513990 2.008624 .065030 1.983941 .061781 2.023012 .052239
8 25 N/A N/A 28.095028 .848301 23.962916 1.087304 3.937422 .085708 3.932174 .108660 3.999855 .100895
16 25 N/A N/A 81.912615 2.090020 70.394739 2.309880 7.782039 .194450 7.720191 .257332 7.812597 .259277
32 25 N/A N/A 104.679257 1.804686 102.539883 1.632781 11.752930 .270190 11.800308 .324581 11.820481 .408622
64 25 N/A N/A 225.684998 2.591775 206.405306 3.053436 18.997837 .496093 19.310291 .611840 19.368496 .550719
128 25 N/A N/A 444.658772 5.286029 392.169022 8.913227 28.168811 1.739538 28.894106 2.009129 29.026450 1.965804

rwlocks-rlock

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 0 0 0 0 0 0
2 25 .660613 .060274 .656402 .065398 .668898 .049729 .674224 .066241 .692743 .068051 .664541 .055163
4 25 .532943 .063545 .589061 .091929 .579252 .080925 .565727 .067985 .555577 .069685 .544874 .050931
8 25 .743060 .016643 .766077 .023622 .775504 .023664 .761221 .021236 .753073 .021189 .746673 .018867
16 25 .828263 .017029 .839037 .013928 .846559 .016093 .846911 .016248 .840118 .011958 .833096 .018275
32 25 1.124529 .017146 1.137272 .020976 1.142095 .023323 1.146723 .017233 1.140130 .022627 1.136547 .016093
64 25 .929311 .018734 .940349 .012922 .942565 .017406 .943510 .013453 .941902 .016217 .935378 .016431
128 25 .919524 .015000 .927089 .017720 .932586 .017233 .930633 .016492 .924304 .021071 .925704 .009899

rwlocks-wlock

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 .014040 0 .014041 0 .014047 0 .014074 0 .014069 0 .014047 0
2 25 .677098 .062896 .711645 .067483 .687017 .065253 .675839 .063253 .692364 .075173 .672628 .069964
4 25 .603371 .064953 .591551 .063371 .645439 .081565 .605968 .054332 .617849 .058266 .606614 .064660
8 25 .811601 .019773 .847536 .023237 .832781 .018220 .827320 .017175 .830026 .013000 .815800 .018973
16 25 .904939 .012961 .911413 .012767 .916830 .011401 .919525 .012409 .915089 .013964 .904793 .011618
32 25 1.137173 .019339 1.148147 .018867 1.149940 .018841 1.146326 .021071 1.146637 .019824 1.140011 .021354
64 25 .946439 .010246 .950194 .009591 .950251 .012529 .954787 .011445 .951138 .011747 .948503 .008888
128 25 .935426 .006855 .943971 .009746 .946289 .016309 .944630 .011661 .941323 .010723 .940307 .006557

pkeyread-dh-der

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 1901.263740 52.883023 1994.140048 48.282235 1902.865848 42.648841 1916.656608 54.975826 1916.597732 55.141262 1918.324452 54.862255
2 25 1884.611932 42.535414 2053.971412 42.319773 1942.029700 44.099148 1912.472964 41.980175 1913.884072 46.017404 1915.369972 42.336191
4 25 1884.180780 40.342577 2098.668320 37.316878 1904.937604 31.180532 1923.764236 50.841538 1904.742556 46.699187 1913.926656 48.553565
8 25 1904.344532 36.861185 2267.638320 33.204099 1959.464576 85.599773 1938.242188 39.381104 1932.896212 39.503537 1940.670488 70.583360
16 25 3568.681548 3.340248 4277.032400 53.801178 3675.310176 5.016602 3645.377380 5.319006 3647.044596 13.671157 3649.139288 4.598312
32 25 6294.442655 257.444540 7702.231461 101.889656 6812.401593 166.954088 6716.098821 259.533770 6726.079692 191.681603 6585.090555 273.918846
64 25 12783.818184 337.305615 14825.300095 561.135962 13527.305533 404.929178 12265.501624 982.498403 11537.507105 1113.419654 12388.833865 749.716332
128 25 22941.332314 2519.364876 27782.749145 4268.077401 26462.899125 2641.498054 20462.679991 4073.354134 19930.396602 3711.733229 18713.825897 3096.918478

pkeyread-dhx-der

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 369.258012 .298045 483.371372 .710396 397.230960 .505236 380.236376 .470647 381.568392 .464286 383.238164 .432742
2 25 371.028980 .376643 619.027668 20.111687 407.080248 2.332972 387.335500 1.179205 386.567080 .933695 389.133744 .701318
4 25 369.733456 .355049 955.625832 23.327278 407.898196 .907945 385.259940 .573422 386.070492 .655268 388.141360 .680155
8 25 369.754676 .349641 1851.448584 32.851689 422.580756 3.643542 392.387580 .550359 393.654284 .688881 395.582312 .518532
16 25 708.356208 .521815 3500.684924 71.372362 825.340812 3.264245 783.761772 2.941442 787.067384 2.905386 785.960728 4.481813
32 25 1095.657220 21.710095 6891.049245 133.976301 1501.472643 20.806350 1288.731741 72.681842 1321.373853 79.583637 1295.102871 82.671074
64 25 2002.806329 145.102538 13454.133618 361.329002 2815.253089 43.038772 2125.477639 122.406813 2083.854820 46.208566 2068.540322 42.383407
128 25 3625.966586 414.624955 26284.548389 883.552886 5522.549101 318.214210 3703.099129 141.017875 3680.974798 31.617645 3695.538516 38.441300

pkeyread-dsa-der

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 370.326024 .430950 616.126916 1.085676 424.073852 .597209 389.372672 .352333 390.964784 .451018 392.612644 .391070
2 25 371.915324 .480987 957.245456 28.033256 447.678424 8.012432 397.143416 1.293147 396.571840 1.018065 400.534960 1.175909
4 25 371.221712 .362699 1803.421448 45.855632 459.830088 6.737200 395.144772 .508408 396.253568 .542522 398.514096 .399360
8 25 374.350120 15.534304 3885.371064 87.948617 531.987344 8.008936 405.949876 10.562247 407.418284 9.764122 406.853092 3.346566
16 25 711.522920 .405619 7583.407456 156.863016 990.397604 12.282550 805.644480 3.642481 808.829324 2.395705 807.037384 4.829123
32 25 1192.083554 48.369786 14777.153706 379.087872 1917.879452 23.222468 1429.546501 53.021235 1445.457008 37.484054 1434.056210 52.601633
64 25 2091.861106 155.820818 29426.546827 855.859751 3685.491524 39.122496 2521.559267 283.629129 2318.878606 161.837519 2344.002858 205.083929
128 25 3883.841483 436.053837 56311.511712 2214.147165 7000.596716 136.674308 3905.201056 311.788441 3826.742357 81.372519 3796.128995 51.880609

pkeyread-ec-der

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 21.417412 .141088 166.950144 1.829532 57.035452 .283234 36.183784 .205766 35.977884 .220952 36.444840 .225789
2 25 21.779308 .145533 398.626236 12.883749 70.792848 2.811405 38.839212 .374482 38.401476 .275052 39.161128 .397741
4 25 22.027180 .080392 1128.072704 26.443117 105.566608 2.682672 42.494608 .651120 42.105796 .517133 42.559452 .348699
8 25 22.566640 .086319 2365.530532 52.400749 174.010216 4.533771 52.143444 .669734 51.937284 .566820 52.248212 .605092
16 25 47.954008 .500602 4681.713204 118.370655 359.729852 9.261439 129.086152 4.567793 130.192904 4.180331 130.660332 4.636009
32 25 102.981865 2.623733 9045.645734 248.406649 716.778526 23.043258 210.769105 6.956833 213.001992 9.880302 212.629357 10.109981
64 25 184.751098 4.946243 17612.157551 489.467637 1329.794442 26.052795 383.941361 14.980832 386.595258 25.385169 380.195366 12.851431
128 25 270.512765 23.964122 34682.661301 1028.585443 2443.111459 95.234665 703.759671 28.087384 724.531586 34.643134 726.924011 28.123763

pkeyread-rsa-der

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 4.967012 .042011 184.438092 .916277 52.829708 .236114 20.378496 .130548 20.203372 .159169 20.764896 .103387
2 25 5.512640 .042261 505.077984 8.634190 88.044736 7.709088 23.576096 .452395 23.424208 .869123 24.039236 .393610
4 25 9.282520 .570230 1482.397404 37.866990 202.893304 8.144344 28.177304 .346050 27.841004 .352139 28.358264 .388091
8 25 45.288224 2.937192 3051.327532 61.013314 406.656332 10.092212 42.774620 .802504 43.040840 .821989 43.014364 .713181
16 25 122.365588 4.844289 6010.338672 146.121737 770.266536 35.411134 117.664500 5.702145 120.675908 3.217784 117.219796 4.993619
32 25 184.060830 3.000145 11636.298929 243.699598 1504.430970 48.679379 198.491589 10.773667 198.951449 11.301467 197.339772 9.381689
64 25 356.789637 6.124364 23194.991011 528.409532 2845.840031 78.213916 366.263519 15.865751 366.255664 15.479195 363.072691 16.932390
128 25 642.639501 15.493141 44909.487994 2492.401957 5358.921617 191.691813 701.375300 24.123013 696.827721 19.271336 708.487476 31.003689

pkeyread-x25519-der

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 50.802568 .094984 149.783564 .512874 75.607640 .190021 59.071572 .140167 59.372588 .129383 59.516048 .117826
2 25 51.123624 .167913 279.233676 17.676125 83.545784 1.545858 61.487320 .361910 61.291192 .316344 62.143472 .488172
4 25 50.896964 .072208 772.448212 19.200676 106.916584 2.369069 63.655584 .309127 64.139920 .379686 64.390540 .388582
8 25 50.996116 .060991 1663.222804 31.382679 164.120948 3.827562 71.802804 .280781 72.354944 .439167 72.563356 .340279
16 25 96.794944 .111579 3247.505244 76.219531 333.452168 7.677279 167.367416 2.548643 169.033016 3.142958 169.170632 1.973175
32 25 145.091992 .840082 6271.320279 147.164191 664.121170 21.116475 268.693083 8.435362 266.462563 8.152747 268.442855 7.814934
64 25 205.870971 7.415300 12083.422519 216.507356 1261.266301 32.198581 474.697380 13.172166 472.393519 15.173631 468.706755 17.782249
128 25 317.897832 36.072973 23563.407041 1000.996619 2297.030700 59.599714 862.089287 25.031279 880.435075 26.724481 874.337618 28.539788

pkeyread-dh-pem

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 1918.368460 52.690656 2552.089744 50.009103 2007.237828 49.345649 1937.703688 51.510703 1931.313344 51.994599 1959.748248 51.746612
2 25 1909.485316 48.147554 3143.960344 208.253038 2043.672340 48.215744 1952.926776 44.116561 1939.411116 39.615354 1955.377472 50.101480
4 25 1904.619368 43.418726 5125.558536 125.447335 2046.660912 44.121090 1941.449096 40.177973 1942.925864 41.575318 1949.485584 46.980889
8 25 1931.740068 78.442184 10114.557560 164.347407 2085.793472 55.095091 1944.874704 24.329407 1972.196888 51.868724 1958.922612 36.648280
16 25 3583.478760 4.668355 19561.138944 314.508293 3893.184224 7.242042 3708.151304 5.669628 3707.857628 4.794010 3706.149200 6.109692
32 25 6047.946573 318.013521 39081.904584 730.825883 7167.270471 147.882840 7134.348961 113.121020 7150.236337 105.500598 7176.409133 111.959081
64 25 11745.671222 1398.851762 77514.601174 1402.445939 14264.226150 520.366788 13432.793252 352.421005 13488.574335 435.564372 13440.632101 471.086674
128 25 18993.921499 3527.814737 139458.910071 7529.321331 28450.796969 2756.967072 23779.175941 2720.389292 24820.267424 1542.843159 24246.568200 2306.313177

pkeyread-dhx-pem

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 376.775484 .340398 992.296952 1.938494 483.894760 .794788 404.147484 .719476 405.834344 .598847 407.240100 .542066
2 25 378.904816 .524579 1808.706360 61.879523 562.604432 14.721737 412.380092 1.026747 412.744772 1.042203 416.163672 1.137886
4 25 377.689332 .282081 4743.534360 107.601957 604.360216 12.941754 412.291568 .793846 413.046556 .476391 414.539196 .664789
8 25 377.725140 .471452 10122.578828 157.678003 814.550872 15.511340 420.530776 .675914 421.578928 .532195 422.915104 1.108467
16 25 724.005520 .937764 19957.184968 402.218886 1537.028608 48.733274 828.752084 4.213093 833.851688 3.787179 832.091176 3.658447
32 25 901.293666 113.085462 38842.822092 707.389433 3041.426549 85.681576 1481.956785 32.348496 1503.751102 29.887558 1499.371749 33.939357
64 25 1663.277328 356.844093 77671.300688 1870.169441 5601.464590 145.108474 2698.797416 240.549364 2685.883459 247.655169 2693.386930 243.312993
128 25 2294.965435 800.837842 138231.640870 6984.717446 11050.303500 347.756718 4337.593370 595.313724 4379.483065 580.429650 4523.542132 654.637012

pkeyread-dsa-pem

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 377.587444 .335329 1006.475864 4.364188 495.770048 1.114885 415.903428 .627712 418.018284 2.060148 419.139328 .606087
2 25 379.954600 .872716 1877.133568 98.881129 575.027356 18.647849 425.445108 1.597201 427.017420 1.316005 429.263088 1.481776
4 25 377.935604 .304986 4821.911072 89.379899 617.446364 10.226015 424.367056 .775874 426.147504 .818549 428.340808 .543879
8 25 377.862252 .301487 10102.773416 203.866602 833.542592 18.148335 433.146908 .780828 435.529808 .976937 436.688064 .815926
16 25 723.847704 .633547 19985.042340 442.861542 1570.752976 42.603143 853.449996 4.721747 858.559960 2.999312 857.319192 2.718315
32 25 928.186249 134.667347 38895.179325 911.635422 3059.351293 67.522849 1535.866960 29.879895 1526.741305 37.702343 1535.364061 42.640410
64 25 1468.913471 325.658208 77298.258586 2416.173747 5853.703379 113.533680 2892.450063 208.196082 2743.973296 285.252827 2723.107949 295.505201
128 25 2327.636554 687.444603 142747.623413 7837.774734 11068.861780 588.864035 4494.726950 392.393778 4719.290130 639.368949 4436.808718 454.660030

pkeyread-ec-pem

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 23.696772 .108517 644.340516 7.324025 130.093656 .458555 51.745568 .399234 51.486504 .309967 51.990280 .259104
2 25 24.293940 .188796 1720.698908 45.717179 226.179788 15.606800 58.947880 .685956 58.057148 .724118 58.714532 .717665
4 25 24.596552 .124851 4952.730652 123.646495 387.505480 10.060634 63.553156 .516255 63.244772 .948760 63.281708 .439138
8 25 42.925604 2.918431 10018.604416 196.657345 749.167312 18.799560 77.043368 .676730 77.421112 1.316022 76.726912 .758385
16 25 158.218748 5.123092 19983.403084 474.330657 1414.926996 51.295188 178.353484 2.422906 177.250892 2.246406 177.527976 2.678668
32 25 272.771513 3.420966 39240.630339 670.314487 2709.334532 76.673697 286.695491 12.345235 284.327460 7.867775 286.281889 8.732007
64 25 505.876246 8.808862 78058.716815 1869.321314 5159.878523 194.723645 520.435796 23.374833 519.367977 17.749076 524.381269 17.449717
128 25 878.605106 29.915031 140025.787080 7058.124292 10010.281693 618.832774 1082.700082 63.082019 1076.320055 51.377181 1075.250130 41.856075

pkeyread-rsa-pem

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 18.681340 .192231 642.743088 3.600813 131.938896 .410726 54.963132 .403346 55.307248 .418051 55.926228 .410168
2 25 19.125140 .096052 1719.130408 19.786911 212.804504 13.794013 62.113880 .700735 62.325980 .575159 62.985520 .673808
4 25 19.335316 .087544 5000.254976 91.507686 392.857032 12.126180 68.191424 .569693 68.607044 .552348 69.110244 .565469
8 25 41.042416 2.265324 10086.569488 175.121387 759.983964 20.712960 85.099984 2.164368 85.483372 .998819 86.105640 2.056762
16 25 154.865444 8.005602 20248.222652 457.299113 1464.636036 54.556795 195.018016 5.568764 196.034916 5.864519 194.149504 5.573177
32 25 272.418095 3.751978 38971.383957 743.001599 2772.767639 77.302958 303.785223 7.960576 308.603626 10.626654 305.529608 9.163396
64 25 507.714339 9.741281 77727.736628 1921.945804 5256.966050 160.565214 549.471118 20.241556 555.840195 17.927806 555.370135 18.147967
128 25 910.679818 26.342368 145726.537254 8014.073141 10284.924481 506.769610 1205.615051 50.431180 1181.133916 48.994448 1182.849826 45.923760

pkeyread-x25519-pem

thread count number of iterations openssl 1.1.1 per operation avg usec 1.1.1 std dev openssl 3.0 per operation avg usec 3.0 std dev openssl 3.1 per operation avg usec 3.1 std dev openssl 3.2 per operation avg usec 3.2 std dev openssl 3.3 per operation avg usec 3.3 std dev openssl master per operation avg usec master std dev
1 25 52.255252 .115403 658.835964 13.163106 147.692472 .286942 70.083840 .778131 70.295176 .339258 70.352164 .129182
2 25 52.711964 .129564 1710.672608 28.507810 223.304096 17.591765 76.615732 1.028355 75.300320 .724539 76.361204 1.004053
4 25 52.467760 .071812 4865.195596 102.933312 385.940468 10.459394 79.226508 .359897 79.227000 .464263 79.318660 .443649
8 25 52.488788 .107647 9983.243056 211.161801 736.856556 23.821887 89.131508 .509253 89.972992 .415362 89.542584 .577555
16 25 100.149824 .244560 20181.936420 372.787562 1416.653796 46.582184 196.233388 2.107909 197.444628 3.282530 196.483116 3.129172
32 25 170.441625 30.708400 38774.111553 746.608901 2723.361373 64.283829 313.064289 8.795509 313.853087 9.327671 316.387080 10.873353
64 25 315.548467 41.866452 75859.943805 2285.025841 5168.743407 127.816145 575.902360 17.676251 574.447615 18.834395 572.977710 17.981549
128 25 508.691855 80.699099 143655.484679 8354.750033 10115.242626 378.564482 1218.645403 50.429325 1234.192420 47.499669 1231.396044 52.244357
nhorman commented 4 months ago

thak you @vdukhovni , good results, though it appears we have some significant improvements to handle on bsd

vdukhovni commented 4 months ago

There was a bunch of variance in the timings across iterations. I wonder how accurate such measurements are on a GCP VM. But that's all we have for now. Unless someone wants to provide a bare-metal machine on which I can install FreeBSD, or a lightly loaded Xen-based hypervisor. Perhaps FreeBSD can also run under Linux qemu, haven't tried that.

t8m commented 4 months ago

I'd suggest creating a VM with FreeBSD on the work machine. We can fairly easily ensure that nothing else will be running on the machine when you run the tests in the VM. There is currently nothing running in that machine.

nhorman commented 4 months ago

KVM, VirtualBox and Parallels I believe all support runnig BSD