microsoft / CCF

Confidential Consortium Framework
https://microsoft.github.io/CCF/
Apache License 2.0
766 stars 207 forks source link

Test AMD pool #4138

Closed achamayou closed 1 year ago

achamayou commented 1 year ago

This is running the virtual perf tests on Standard D8ads v5 (AMD), rather than Standard D8ds v5 (Intel).

ccf-bot commented 1 year ago

add_amd_pool@48752 aka 20220817.13 vs main ewma over 20 builds from 48461 to 48748

Click to see table main | build_id | build_number | tpcc_sgx_cft^ | tpcc_sgx_cft_mem | ls_sgx_cft^ | ls_sgx_cft_mem | ls_jwt_sgx_cft^ | ls_jwt_sgx_cft_mem | ls_js_sgx_cft^ | ls_js_sgx_cft_mem | ls_v8_sgx_cft^ | ls_v8_sgx_cft_mem | ls_full_js_sgx_cft^ | ls_full_js_sgx_cft_mem | ls_full_v8_sgx_cft^ | ls_full_v8_sgx_cft_mem | ls_js_jwt_sgx_cft^ | ls_js_jwt_sgx_cft_mem | hist_sgx_cft^ | RB put (/s)^ | CHAMP put (/s)^ | RB get (/s)^ | CHAMP get (/s)^ | tpcc_virtual_cft^ | tpcc_virtual_cft_mem | ls_virtual_cft^ | ls_virtual_cft_mem | ls_jwt_virtual_cft^ | ls_jwt_virtual_cft_mem | ls_js_virtual_cft^ | ls_js_virtual_cft_mem | ls_v8_virtual_cft^ | ls_v8_virtual_cft_mem | ls_full_js_virtual_cft^ | ls_full_js_virtual_cft_mem | ls_full_v8_virtual_cft^ | ls_full_v8_virtual_cft_mem | ls_js_jwt_virtual_cft^ | ls_js_jwt_virtual_cft_mem | |-----------:|:---------------|----------------:|-------------------:|--------------:|-----------------:|------------------:|---------------------:|-----------------:|--------------------:|-----------------:|--------------------:|----------------------:|-------------------------:|----------------------:|-------------------------:|---------------------:|------------------------:|----------------:|---------------:|------------------:|---------------:|------------------:|--------------------:|-----------------------:|------------------:|---------------------:|----------------------:|-------------------------:|---------------------:|------------------------:|---------------------:|------------------------:|--------------------------:|-----------------------------:|--------------------------:|-----------------------------:|-------------------------:|----------------------------:| | 48461 | 20220809.7 | 6585.9 | 8.3497e+07 | 20158 | 1.63882e+07 | 5669.79 | 1.53396e+07 | 2557.5 | 1.00967e+07 | 1626.24 | 1.645e+08 | 2121.12 | 9.31027e+06 | 1443.42 | 9.84392e+07 | 1986.42 | 9.04813e+06 | 18271.3 | 886722 | 1.41396e+06 | 9.41163e+06 | 3.59292e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48466 | 20220809.9 | 6444.69 | 8.37592e+07 | 20005.2 | 1.56017e+07 | 5605.49 | 1.56017e+07 | 2541.33 | 1.00967e+07 | 1618.96 | 1.66859e+08 | 2115.35 | 9.31027e+06 | 1450.97 | 9.81771e+07 | 2014.27 | 9.04813e+06 | 20835.2 | 901011 | 1.37201e+06 | 9.22938e+06 | 3.58669e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48469 | 20220810.1 | 6186.62 | 8.42835e+07 | 20033.2 | 1.58639e+07 | 5604.55 | 1.53396e+07 | 2556.71 | 9.83456e+06 | 1587.94 | 1.64762e+08 | 2082.75 | 9.04813e+06 | 1421.15 | 9.84392e+07 | 1944.56 | 9.04813e+06 | 22527.5 | 906189 | 1.38172e+06 | 9.21684e+06 | 3.58669e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48486 | 20220811.1 | 6270.83 | 8.40213e+07 | 19935.8 | 1.58639e+07 | 5612.96 | 1.53396e+07 | 2499.35 | 1.2456e+07 | 1583.15 | 1.66859e+08 | 2112.67 | 9.31027e+06 | 1405.59 | 9.81771e+07 | 1923.87 | 9.04813e+06 | 23657.6 | 917679 | 1.38602e+06 | 9.28794e+06 | 3.56788e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48499 | 20220811.7 | 6318.24 | 8.45456e+07 | 20081.4 | 1.66503e+07 | 5615.16 | 1.53396e+07 | 2595.81 | 1.00967e+07 | 1589.3 | 1.66072e+08 | 2084.45 | 9.31027e+06 | 1416.86 | 9.84392e+07 | 1942.12 | 1.11453e+07 | 17960.4 | 888152 | 1.37708e+06 | 9.23767e+06 | 3.56788e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48519 | 20220812.3 | 6254.67 | 8.29727e+07 | 20234.9 | 1.69124e+07 | 5607.59 | 1.56017e+07 | 2489.25 | 1.00967e+07 | 1591.82 | 1.66597e+08 | 2123.82 | 9.04813e+06 | 1429.55 | 9.81771e+07 | 1935.56 | 9.04813e+06 | 20089.9 | 898322 | 1.37302e+06 | 9.23771e+06 | 3.58042e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48526 | 20220812.7 | 6074.64 | 8.42835e+07 | 19544.3 | 1.66503e+07 | 5648.38 | 1.50774e+07 | 2609.43 | 1.00967e+07 | 1612.39 | 1.645e+08 | 2111.9 | 9.57242e+06 | 1440.93 | 9.66042e+07 | 2018.87 | 8.78598e+06 | 18707.2 | 921975 | 1.33881e+06 | 9.33021e+06 | 3.47113e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48562 | 20220815.2 | 6242.99 | 8.42835e+07 | 19715.5 | 1.63882e+07 | 5635.6 | 1.53396e+07 | 2482.55 | 1.32424e+07 | 1574.14 | 1.66597e+08 | 2066.59 | 9.04813e+06 | 1406.98 | 9.81771e+07 | 1916.87 | 9.04813e+06 | 19707.5 | 909447 | 1.35619e+06 | 9.20028e+06 | 3.56168e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48572 | 20220815.8 | 6341.7 | 8.48077e+07 | 19763.8 | 1.66503e+07 | 5496.3 | 1.53396e+07 | 2501.6 | 9.83456e+06 | 1570.93 | 1.66597e+08 | 2107.98 | 9.31027e+06 | 1423.48 | 9.87014e+07 | 1919.72 | 8.78598e+06 | 17907.1 | 901165 | 1.3418e+06 | 9.10214e+06 | 3.59292e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48583 | 20220815.13 | 6332.98 | 8.40213e+07 | 19911.4 | 1.66503e+07 | 5538.12 | 1.53396e+07 | 2546.68 | 9.83456e+06 | 1586.74 | 1.645e+08 | 2108.78 | 9.04813e+06 | 1406.45 | 9.81771e+07 | 1926.97 | 9.04813e+06 | 19969.9 | 871522 | 1.37035e+06 | 9.28794e+06 | 3.56174e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48592 | 20220815.17 | 6485.44 | 8.48077e+07 | 20376.3 | 1.66503e+07 | 5673.41 | 1.53396e+07 | 2594.85 | 1.00967e+07 | 1618.96 | 1.66597e+08 | 2112.77 | 9.04813e+06 | 1425.72 | 9.81771e+07 | 1855.64 | 1.14074e+07 | 18035.6 | 905909 | 1.37467e+06 | 9.32596e+06 | 3.57411e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48597 | 20220815.19 | 6322.75 | 8.37592e+07 | 20129 | 1.56017e+07 | 5646.1 | 1.56017e+07 | 2604.46 | 9.83456e+06 | 1581.47 | 1.66597e+08 | 2119.41 | 9.04813e+06 | 1407.74 | 9.79149e+07 | 1919.54 | 9.04813e+06 | 21175.9 | 908606 | 1.38631e+06 | 9.27116e+06 | 3.59298e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48608 | 20220815.24 | 6185.84 | 8.3497e+07 | 19745.5 | 1.63882e+07 | 5630.7 | 1.53396e+07 | 2495.22 | 1.00967e+07 | 1581.38 | 1.66597e+08 | 2126.35 | 9.31027e+06 | 1400.49 | 9.73907e+07 | 1911.7 | 9.04813e+06 | 19982.3 | 890280 | 1.39008e+06 | 9.35587e+06 | 3.59298e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48635 | 20220816.3 | 6284.39 | 8.37592e+07 | 20503.9 | 1.69124e+07 | 5613.67 | 1.53396e+07 | 2536.88 | 1.00967e+07 | 1600.05 | 1.66859e+08 | 2114.81 | 9.04813e+06 | 1408.05 | 9.81771e+07 | 1923.09 | 8.78598e+06 | 20592.2 | 908239 | 1.36952e+06 | 9.21273e+06 | 3.58663e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48642 | 20220816.7 | 6260.86 | 8.45456e+07 | 19653.2 | 1.63882e+07 | 5677.32 | 1.53396e+07 | 2524.16 | 1.00967e+07 | 1612.89 | 1.67121e+08 | 2117.49 | 9.31027e+06 | 1401.11 | 9.84392e+07 | 1922.37 | 9.04813e+06 | 18369.1 | 872322 | 1.38343e+06 | 9.3475e+06 | 3.5618e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48672 | 20220816.16 | 6333.22 | 8.45456e+07 | 20111.1 | 1.74367e+07 | 5631.29 | 1.56017e+07 | 2536.69 | 1.00967e+07 | 1577.62 | 1.66597e+08 | 2075.38 | 9.31027e+06 | 1397.24 | 9.81771e+07 | 1931.89 | 9.04813e+06 | 22381.3 | 906591 | 1.36989e+06 | 9.40304e+06 | 3.65714e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48683 | 20220816.20 | 6239.71 | 8.3497e+07 | 20020.9 | 1.6126e+07 | 5592.7 | 1.56017e+07 | 2541.69 | 1.03588e+07 | 1551.19 | 1.66597e+08 | 2157.57 | 9.31027e+06 | 1404.89 | 9.79149e+07 | 1927.48 | 8.78598e+06 | 18144.3 | 912041 | 1.3478e+06 | 9.29215e+06 | 3.55556e+07 | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | nan | | 48698 | 20220816.25 | 6140.94 | 8.42835e+07 | 19716.8 | 1.63882e+07 | 5626.93 | 1.53396e+07 | 2427.11 | 1.00967e+07 | 1566.11 | 1.66597e+08 | 2118.77 | 9.31027e+06 | 1386.8 | 9.79149e+07 | 1933.12 | 9.04813e+06 | 25043.1 | 876971 | 1.37875e+06 | 9.24601e+06 | 3.58669e+07 | 11079.7 | 0 | 41713 | 0 | 10360 | 0 | 4469.21 | 0 | 2766.55 | 0 | 3534.85 | 0 | 2531.53 | 0 | 3341.36 | 0 | | 48723 | 20220817.3 | 6214.19 | 8.32349e+07 | 19633.1 | 1.74367e+07 | 5619.72 | 1.50774e+07 | 2489.91 | 1.00967e+07 | 1563.46 | 1.66859e+08 | 2111.37 | 9.31027e+06 | 1394.59 | 9.84392e+07 | 1926.84 | 9.04813e+06 | 26239.4 | 901443 | 1.34347e+06 | 9.09814e+06 | 3.54325e+07 | 11359.3 | 0 | 43757.8 | 0 | 10712.3 | 0 | 4405.46 | 0 | 2799.92 | 0 | 3551.2 | 0 | 2479.12 | 0 | 3393.52 | 0 | | 48748 | 20220817.12 | 6287.18 | 8.45456e+07 | 19721.8 | 1.58639e+07 | 5636.57 | 1.53396e+07 | 2491.98 | 1.00967e+07 | 1564.43 | 1.66597e+08 | 2117.22 | 9.31027e+06 | 1416.06 | 9.81771e+07 | 1938.53 | 9.04813e+06 | 22437.1 | 906752 | 1.37403e+06 | 9.22103e+06 | 3.56794e+07 | 11343.3 | 0 | 43725.9 | 0 | 10106.5 | 0 | 4650.08 | 0 | 2757.07 | 0 | 3522.44 | 0 | 2426.54 | 0 | 3683.47 | 0 | add_amd_pool | build_id | build_number | tpcc_virtual_cft^ | tpcc_virtual_cft_mem | tpcc_sgx_cft^ | tpcc_sgx_cft_mem | ls_virtual_cft^ | ls_virtual_cft_mem | ls_jwt_virtual_cft^ | ls_jwt_virtual_cft_mem | ls_js_virtual_cft^ | ls_js_virtual_cft_mem | ls_sgx_cft^ | ls_sgx_cft_mem | ls_v8_virtual_cft^ | ls_v8_virtual_cft_mem | ls_jwt_sgx_cft^ | ls_jwt_sgx_cft_mem | ls_full_js_virtual_cft^ | ls_full_js_virtual_cft_mem | ls_js_sgx_cft^ | ls_js_sgx_cft_mem | ls_full_v8_virtual_cft^ | ls_full_v8_virtual_cft_mem | ls_v8_sgx_cft^ | ls_v8_sgx_cft_mem | ls_js_jwt_virtual_cft^ | ls_js_jwt_virtual_cft_mem | ls_full_js_sgx_cft^ | ls_full_js_sgx_cft_mem | hist_sgx_cft^ | ls_full_v8_sgx_cft^ | ls_full_v8_sgx_cft_mem | ls_js_jwt_sgx_cft^ | ls_js_jwt_sgx_cft_mem | RB put (/s)^ | CHAMP put (/s)^ | RB get (/s)^ | CHAMP get (/s)^ | |-----------:|:---------------|--------------------:|-----------------------:|----------------:|-------------------:|------------------:|---------------------:|----------------------:|-------------------------:|---------------------:|------------------------:|--------------:|-----------------:|---------------------:|------------------------:|------------------:|---------------------:|--------------------------:|-----------------------------:|-----------------:|--------------------:|--------------------------:|-----------------------------:|-----------------:|--------------------:|-------------------------:|----------------------------:|----------------------:|-------------------------:|----------------:|----------------------:|-------------------------:|---------------------:|------------------------:|---------------:|------------------:|---------------:|------------------:| | 48725 | 20220817.4 | 10847.8 | 0 | 6412.84 | 8.32349e+07 | 40483.2 | 0 | 9023 | 0 | 4308.84 | 0 | 19933.5 | 1.6126e+07 | 2583.61 | 0 | 5581.03 | 1.56017e+07 | 3733.76 | 0 | 2543.13 | 1.00967e+07 | 2308.06 | 0 | 1611.83 | 1.64762e+08 | 3388.6 | 0 | 2109.59 | 9.31027e+06 | 23831.9 | 1409.72 | 9.81771e+07 | 1921.6 | 1.14074e+07 | 899977 | 1.34772e+06 | 9.53885e+06 | 3.58669e+07 | | 48731 | 20220817.6 | 11388.7 | 0 | 5835.46 | 8.42835e+07 | 40812.5 | 0 | 9048.24 | 0 | 4586.95 | 0 | 19982.5 | 1.63882e+07 | 2582.56 | 0 | 5573.93 | 1.56017e+07 | 3598.5 | 0 | 2488.37 | 1.00967e+07 | 2304.89 | 0 | 1574.68 | 1.6581e+08 | 3223.51 | 0 | 2072.48 | 9.04813e+06 | 24214.4 | 1408.47 | 9.81771e+07 | 1922.48 | 8.78598e+06 | 887075 | 1.36233e+06 | 9.22518e+06 | 3.58669e+07 | | 48739 | 20220817.9 | 11093.9 | 0 | 6436.7 | 8.37592e+07 | 40506.5 | 0 | 9042.38 | 0 | 4324.46 | 0 | 20075.7 | 1.58639e+07 | 2564.54 | 0 | 5655.03 | 1.53396e+07 | 3701.81 | 0 | 2555.37 | 1.00967e+07 | 2249.87 | 0 | 1578.23 | 1.66597e+08 | 3262.41 | 0 | 2121.73 | 9.31027e+06 | 25209.1 | 1421.93 | 9.87014e+07 | 1976.66 | 9.04813e+06 | 908561 | 1.37017e+06 | 9.42901e+06 | 3.63766e+07 | | 48745 | 20220817.11 | 11306.7 | 0 | 6125.29 | 8.37592e+07 | 41685.5 | 0 | 9063.33 | 0 | 4380.28 | 0 | 19848.1 | 1.58639e+07 | 2573.41 | 0 | 5508.7 | 1.56017e+07 | 3787.36 | 0 | 2482.33 | 9.83456e+06 | 2305.16 | 0 | 1560.04 | 1.645e+08 | 3383.7 | 0 | 2068.95 | 9.31027e+06 | 22289.7 | 1385.11 | 9.84392e+07 | 1923.06 | 8.78598e+06 | 902755 | 1.37338e+06 | 9.24601e+06 | 3.58663e+07 | | 48752 | 20220817.13 | 11082 | 0 | 7160.54 | 8.40213e+07 | 42304.4 | 0 | 8976.24 | 0 | 4759.62 | 0 | 19849.8 | 1.63882e+07 | 2586.2 | 0 | 5627.91 | 1.53396e+07 | 3739.21 | 0 | 2492.85 | 9.83456e+06 | 2309.47 | 0 | 1596.49 | 1.66597e+08 | 3236.68 | 0 | 2088.01 | 9.31027e+06 | 29241.1 | 1397.09 | 9.81771e+07 | 1923.16 | 9.04813e+06 | 906726 | 1.37968e+06 | 9.28807e+06 | 3.58669e+07 |

images

achamayou commented 1 year ago

/azp run

azure-pipelines[bot] commented 1 year ago
Azure Pipelines successfully started running 4 pipeline(s).
achamayou commented 1 year ago

Switch from D4ads to D8ads

/azp run

achamayou commented 1 year ago

/azp run

azure-pipelines[bot] commented 1 year ago
Azure Pipelines successfully started running 4 pipeline(s).
achamayou commented 1 year ago

/azp run

azure-pipelines[bot] commented 1 year ago
Azure Pipelines successfully started running 4 pipeline(s).
achamayou commented 1 year ago

/azp run

azure-pipelines[bot] commented 1 year ago
Azure Pipelines successfully started running 4 pipeline(s).
achamayou commented 1 year ago

/azp run

azure-pipelines[bot] commented 1 year ago
Azure Pipelines successfully started running 4 pipeline(s).