microsoft / CCF

Confidential Consortium Framework
https://microsoft.github.io/CCF/
Apache License 2.0
764 stars 205 forks source link

Update StatsFile.tla #6099

Closed lemmy closed 2 months ago

ccf-bot commented 2 months ago

mku-stats@83262 aka 20240327.9 vs main ewma over 20 builds from 82808 to 83237

Click to see table main | build_id | build_number | pi_basic_mt_sgx_cft^ | pi_basic_mt_sgx_cft_mem | Commit latency factor | tpcc_sgx_cft^ | tpcc_sgx_cft_mem | tpcc_virtual_cft^ | pi_basic_mt_virtual_cft^ | ls_virtual_cft^ | ls_sgx_cft^ | ls_sgx_cft_mem | pi_ls_virtual_cft^ | pi_ls_sgx_cft^ | pi_ls_sgx_cft_mem | pi_basic_virtual_cft^ | pi_basic_sgx_cft^ | pi_basic_sgx_cft_mem | pi_basic_js_virtual_cft^ | ls_jwt_virtual_cft^ | pi_ls_jwt_virtual_cft^ | ls_js_virtual_cft^ | ls_full_js_virtual_cft^ | pi_basic_js_sgx_cft^ | pi_basic_js_sgx_cft_mem | ls_js_jwt_virtual_cft^ | ls_jwt_sgx_cft^ | ls_jwt_sgx_cft_mem | pi_ls_jwt_sgx_cft^ | pi_ls_jwt_sgx_cft_mem | ls_js_sgx_cft^ | ls_js_sgx_cft_mem | ls_full_js_sgx_cft^ | ls_full_js_sgx_cft_mem | hist_sgx_cft^ | ls_js_jwt_sgx_cft^ | ls_js_jwt_sgx_cft_mem | KV ser (/s)^ | KV deser (/s)^ | KV snap ser (/s)^ | KV snap deser (/s)^ | RB put (/s)^ | CHAMP put (/s)^ | RB get (/s)^ | CHAMP get (/s)^ | tlc_sim_traces | tlc_sim_levelmean | |-----------:|:---------------|-----------------------:|--------------------------:|------------------------:|----------------:|-------------------:|--------------------:|---------------------------:|------------------:|--------------:|-----------------:|---------------------:|-----------------:|--------------------:|------------------------:|--------------------:|-----------------------:|---------------------------:|----------------------:|-------------------------:|---------------------:|--------------------------:|-----------------------:|--------------------------:|-------------------------:|------------------:|---------------------:|---------------------:|------------------------:|-----------------:|--------------------:|----------------------:|-------------------------:|----------------:|---------------------:|------------------------:|---------------:|-----------------:|--------------------:|----------------------:|---------------:|------------------:|---------------:|------------------:|-----------------:|--------------------:| | 82808 | 20240318.28 | 27678.5 | 2.51822e+07 | 0.805582 | 5626.63 | 8.59996e+07 | 17152.8 | 70163.6 | 53231.6 | 13970.8 | 1.88908e+07 | 55482.5 | 14039 | 1.05021e+07 | 61663.6 | 15521.4 | 1.46964e+07 | 4405.7 | 20568.4 | 21548.5 | 17531.8 | 17515.4 | 1373.9 | 1.25993e+07 | 11563.2 | 6868.02 | 1.88908e+07 | 6931.4 | 6.30784e+06 | 5803.98 | 1.67936e+07 | 5442.74 | 1.67936e+07 | 45393.1 | 3990.95 | 1.67936e+07 | 1.04646e+06 | 1.16809e+06 | 7919.02 | 1398.65 | 832135 | 1.17718e+06 | 8.09813e+06 | 3.14226e+07 | 31220 | 382 | | 82814 | 20240319.1 | 28079.1 | 2.30851e+07 | 0.835128 | 5601.4 | 8.59996e+07 | 17277.2 | 70706.4 | 52833.5 | 13946.2 | 1.88908e+07 | 57165.7 | 14017.3 | 1.05021e+07 | 62292 | 15577.4 | 1.46964e+07 | 4430.8 | 21262.1 | 21811.2 | 17511.8 | 17293.3 | 1359.8 | 1.25993e+07 | 11732.8 | 6850.25 | 1.88908e+07 | 7140.2 | 6.30784e+06 | 5754.81 | 1.67936e+07 | 5447.98 | 1.67936e+07 | 48561.4 | 3989.09 | 1.67936e+07 | 1.03413e+06 | 1.14025e+06 | 7801.37 | 1405.27 | 830705 | 1.17741e+06 | 8.14402e+06 | 3.1109e+07 | 32462 | 369 | | 82835 | 20240319.8 | 28062.1 | 2.51822e+07 | 0.837813 | 5510.28 | 8.59996e+07 | 17227.7 | 69590.2 | 53576 | 13804.3 | 1.88908e+07 | 56250.9 | 13908.2 | 1.05021e+07 | 62196 | 15320.3 | 1.46964e+07 | 4431.4 | 20786.7 | 21712.2 | 17538.6 | 17544 | 1348.4 | 1.25993e+07 | 11613.7 | 6848.14 | 1.88908e+07 | 6889.5 | 6.30784e+06 | 5778.13 | 1.67936e+07 | 5474.58 | 1.67936e+07 | 44852.3 | 3957.99 | 1.67936e+07 | 1.03907e+06 | 1.16741e+06 | 8028.68 | 1384.91 | 801178 | 1.18205e+06 | 8.1315e+06 | 3.11322e+07 | 31218 | 366 | | 82842 | 20240320.1 | 28088.6 | 2.30851e+07 | 0.795937 | 5578.48 | 8.59996e+07 | 17161.1 | 82750.6 | 50737.4 | 13967.6 | 1.88908e+07 | 55481.9 | 13984.1 | 1.05021e+07 | 61410.4 | 15560.5 | 1.25993e+07 | 4408.2 | 20721.6 | 20939.8 | 17393.6 | 16990.9 | 1370.3 | 1.05021e+07 | 11706.9 | 6805.41 | 1.88908e+07 | 7042.4 | 6.30784e+06 | 5775.41 | 1.67936e+07 | 5467.65 | 1.67936e+07 | 47065.1 | 3879.66 | 1.67936e+07 | 1.05186e+06 | 1.16104e+06 | 8151.56 | 1404.1 | 839027 | 1.17528e+06 | 8.15056e+06 | 3.06587e+07 | 30174 | 382 | | 82864 | 20240320.9 | 27810.6 | 2.30851e+07 | 0.821651 | 5512.38 | 8.59996e+07 | 17219.5 | 84734.7 | 53302.2 | 13879.7 | 1.88908e+07 | 55326.6 | 14042 | 1.05021e+07 | 62207 | 15479.2 | 1.46964e+07 | 4407.7 | 17196.8 | 21736.3 | 17512.2 | 17459.7 | 1359.2 | 1.25993e+07 | 11693.7 | 6849.78 | 1.67936e+07 | 7018.8 | 6.30784e+06 | 5765.35 | 1.67936e+07 | 5480.38 | 1.67936e+07 | 41778.3 | 3990.49 | 1.67936e+07 | 1.04701e+06 | 1.13109e+06 | 7937.05 | 1404.32 | 833112 | 1.18197e+06 | 8.15387e+06 | 3.07457e+07 | 31738 | 377 | | 82906 | 20240321.2 | 27754.2 | 2.30851e+07 | 0.801621 | 5533.71 | 8.59996e+07 | 17172.3 | 87877.2 | 52970.8 | 13799.2 | 1.88908e+07 | 40672.6 | 13962 | 1.05021e+07 | 60757.5 | 15288.3 | 1.46964e+07 | 4392.6 | 20462.7 | 20745.2 | 17430.2 | 17175.9 | 1355.5 | 1.25993e+07 | 11543 | 6799.37 | 1.67936e+07 | 6906.2 | 6.30784e+06 | 5790.33 | 1.67936e+07 | 5465.42 | 1.67936e+07 | 42157.6 | 3983.52 | 1.67936e+07 | 1.05977e+06 | 1.17412e+06 | 7531.67 | 1400.02 | 836529 | 1.18229e+06 | 8.15368e+06 | 3.25902e+07 | 29270 | 386 | | 82925 | 20240321.7 | 27420.1 | 2.30851e+07 | 0.807056 | 5646.99 | 8.59996e+07 | 17368.7 | 79485.1 | 53475.8 | 13895 | 1.88908e+07 | 56637 | 14012.6 | 1.05021e+07 | 62746 | 15451.8 | 1.46964e+07 | 4439.9 | 21040.8 | 21736.3 | 17694.8 | 17398 | 1376.3 | 1.25993e+07 | 11628.1 | 6896.06 | 1.88908e+07 | 7094.7 | 6.30784e+06 | 5751.92 | 1.67936e+07 | 5715.65 | 1.67936e+07 | 45300.9 | 3995.22 | 1.67936e+07 | 1.05086e+06 | 1.14718e+06 | 8069.03 | 1407.16 | 831410 | 1.17717e+06 | 8.13044e+06 | 3.0809e+07 | 32455 | 379 | | 82996 | 20240322.3 | 27423.4 | 2.30851e+07 | 0.803997 | 5569.26 | 8.59996e+07 | 17355.5 | 79428.1 | 53050.4 | 13890.2 | 1.88908e+07 | 56308.8 | 14049.6 | 1.05021e+07 | 62950.9 | 15467.8 | 1.46964e+07 | 4446 | 20891.9 | 21857.9 | 17952 | 17419.6 | 1372.1 | 1.25993e+07 | 11656.7 | 6884.86 | 1.88908e+07 | 7030.1 | 6.30784e+06 | 5801.3 | 1.67936e+07 | 5456.3 | 1.67936e+07 | 43140.2 | 3990.73 | 1.67936e+07 | 1.04493e+06 | 1.11832e+06 | 8234.47 | 1400.61 | 835988 | 1.17669e+06 | 8.1458e+06 | 3.07868e+07 | 31479 | 377 | | 83004 | 20240322.5 | 27756.3 | 2.30851e+07 | 0.808055 | 5565.83 | 8.59996e+07 | 17299.9 | 89907 | 52868.8 | 13932.7 | 1.88908e+07 | 55992.6 | 13952 | 1.05021e+07 | 62180.5 | 15426.3 | 1.46964e+07 | 4432.5 | 20709.2 | 21069 | 17629.6 | 17616.8 | 1361.3 | 1.25993e+07 | 11600.9 | 6830.62 | 1.88908e+07 | 6879.1 | 6.30784e+06 | 5801.54 | 1.67936e+07 | 5464.86 | 1.67936e+07 | 42890.9 | 3984.08 | 1.67936e+07 | 1.0618e+06 | 1.05664e+06 | 8153.94 | 1399.29 | 835816 | 1.1854e+06 | 8.16642e+06 | 3.10656e+07 | 30745 | 366 | | 83028 | 20240322.11 | 27692 | 2.30851e+07 | 0.786739 | 5528.39 | 8.59996e+07 | 17295.9 | 67943.8 | 53368.8 | 13900.8 | 1.88908e+07 | 56110.7 | 13977.4 | 1.05021e+07 | 62452.1 | 15498.5 | 1.46964e+07 | 4426.2 | 21072 | 21721.7 | 17573.9 | 17149 | 1363.7 | 1.25993e+07 | 11633.8 | 6797.9 | 1.88908e+07 | 6885.5 | 6.30784e+06 | 5756.57 | 1.67936e+07 | 5440.95 | 1.67936e+07 | 45247.5 | 3952.9 | 1.67936e+07 | 1.01989e+06 | 1.16131e+06 | 7870.69 | 1403.37 | 826657 | 1.18227e+06 | 8.17001e+06 | 3.10609e+07 | 29497 | 374 | | 83075 | 20240325.9 | 27592.1 | 2.51822e+07 | 0.777781 | 5598.84 | 8.59996e+07 | 17111.8 | 92049.2 | 50328.8 | 13848.8 | 1.88908e+07 | 54004.7 | 13996.7 | 1.05021e+07 | 59968.3 | 15392.6 | 1.46964e+07 | 4279.8 | 17295.7 | 21003.1 | 17407.6 | 17504.3 | 1356.8 | 1.25993e+07 | 11543.9 | 6850.45 | 1.88908e+07 | 6933.6 | 6.30784e+06 | 5771.89 | 1.67936e+07 | 5426.77 | 1.67936e+07 | 44061.4 | 3782.41 | 1.67936e+07 | 1.01698e+06 | 1.14469e+06 | 7576.94 | 1399.04 | 834313 | 1.18306e+06 | 8.15381e+06 | 3.15952e+07 | 30222 | 374 | | 83097 | 20240325.17 | 27737.4 | 2.30851e+07 | 0.811724 | 5551.44 | 8.59996e+07 | 17148.4 | 79563.9 | 52877.7 | 13866 | 1.88908e+07 | 56718.3 | 13969.6 | 1.05021e+07 | 62257.9 | 15283.2 | 1.25993e+07 | 4459.3 | 21024.6 | 20727.5 | 17652.1 | 17131.4 | 1359.4 | 1.05021e+07 | 11757.9 | 6803.62 | 1.88908e+07 | 6892.7 | 6.30784e+06 | 5791.32 | 1.67936e+07 | 5465.92 | 1.67936e+07 | 40610.5 | 3972.37 | 1.67936e+07 | 1.05831e+06 | 1.1084e+06 | 7883.06 | 1398.86 | 841684 | 1.17933e+06 | 8.12434e+06 | 3.08415e+07 | 29938 | 377 | | 83108 | 20240325.20 | 27653.5 | 2.51822e+07 | 0.816276 | 5004.39 | 8.59996e+07 | 17273.3 | 76019.9 | 53403.3 | 13796.4 | 1.88908e+07 | 57407.9 | 13646.8 | 1.05021e+07 | 62082.9 | 14919.6 | 1.46964e+07 | 4470.1 | 21064.6 | 21071.3 | 17750.5 | 17316.2 | 1356.4 | 1.25993e+07 | 11737.3 | 6715.53 | 1.88908e+07 | 6823.7 | 6.30784e+06 | 5513.68 | 1.67936e+07 | 5485.08 | 1.67936e+07 | 43047 | 3838.74 | 1.67936e+07 | 1.01667e+06 | 1.17925e+06 | 7419.23 | 1385.31 | 839891 | 1.18654e+06 | 8.15416e+06 | 3.23544e+07 | 31523 | 385 | | 83126 | 20240325.25 | 27807.5 | 2.51822e+07 | 0.822261 | 5510.05 | 8.59996e+07 | 17339.6 | 75704.7 | 53128.6 | 13821.2 | 1.88908e+07 | 56578 | 13906 | 1.05021e+07 | 61178.5 | 15175.2 | 1.46964e+07 | 4405.7 | 20673 | 21759.5 | 17593.2 | 17552.9 | 1369.4 | 1.25993e+07 | 11803.5 | 6786.31 | 1.88908e+07 | 6998.3 | 6.30784e+06 | 5793.2 | 1.67936e+07 | 5441.74 | 1.67936e+07 | 44709.3 | 3990.44 | 1.67936e+07 | 1.02617e+06 | 1.16986e+06 | 7822.5 | 1402.59 | 828441 | 1.17895e+06 | 8.14146e+06 | 3.06771e+07 | 31345 | 377 | | 83135 | 20240326.3 | 27562.6 | 2.51822e+07 | 0.807021 | 5604.57 | 8.59996e+07 | 17387.7 | 68065.1 | 53118.8 | 13953.9 | 1.88908e+07 | 56485.7 | 14040.3 | 1.05021e+07 | 62135.6 | 15484.7 | 1.46964e+07 | 4475.7 | 20800.9 | 21086.8 | 17740.8 | 17202.2 | 1377.6 | 1.05021e+07 | 11743.1 | 6818.62 | 1.88908e+07 | 7019.5 | 6.30784e+06 | 5803.7 | 1.67936e+07 | 5474.38 | 1.67936e+07 | 39803.3 | 3971.4 | 1.67936e+07 | 1.06225e+06 | 1.11136e+06 | 8134.52 | 1398.76 | 836262 | 1.18343e+06 | 8.15504e+06 | 3.08267e+07 | 32521 | 381 | | 83145 | 20240326.6 | 27819.1 | 2.30851e+07 | 0.818053 | 5542.68 | 8.59996e+07 | 17364.7 | 84123.6 | 53100.8 | 13980 | 1.88908e+07 | 57093.3 | 13946 | 1.05021e+07 | 61505.5 | 15420.4 | 1.46964e+07 | 4458 | 21220.5 | 21785.5 | 17392.6 | 17245.8 | 1370.9 | 1.25993e+07 | 11592.3 | 6825.64 | 1.88908e+07 | 6977.6 | 6.30784e+06 | 5766.33 | 1.67936e+07 | 5466.25 | 1.67936e+07 | 43404.8 | 3983.93 | 1.67936e+07 | 1.04362e+06 | 1.20106e+06 | 8158.85 | 1405.66 | 830580 | 1.18191e+06 | 8.14e+06 | 3.08257e+07 | 32948 | 386 | | 83161 | 20240326.10 | 27469.5 | 2.51822e+07 | 0.800191 | 5624.66 | 8.59996e+07 | 17118.5 | 72771 | 50053.7 | 13984.8 | 1.88908e+07 | 55306.1 | 13965.2 | 1.05021e+07 | 58491.6 | 15438.1 | 1.46964e+07 | 4390.9 | 20680 | 21083.3 | 17338 | 17595.4 | 1359.3 | 1.25993e+07 | 10381.2 | 6816.39 | 1.88908e+07 | 6890.9 | 6.30784e+06 | 5811.54 | 1.67936e+07 | 5436.84 | 1.67936e+07 | 44328.3 | 3986.87 | 1.67936e+07 | 1.00685e+06 | 1.14666e+06 | 8073.19 | 1400.87 | 825189 | 1.17774e+06 | 8.14917e+06 | 3.08675e+07 | 32746 | 373 | | 83176 | 20240326.15 | 26788.9 | 2.51822e+07 | 0.80644 | 5623.61 | 8.59996e+07 | 17353.9 | 77379.2 | 52708.7 | 13983 | 1.88908e+07 | 55809.8 | 13998.6 | 1.05021e+07 | 60335.2 | 15342.1 | 1.46964e+07 | 4409.6 | 20970.2 | 21573.1 | 17500.2 | 17488.8 | 1355 | 1.25993e+07 | 11668.6 | 6791.92 | 1.88908e+07 | 6909.2 | 6.30784e+06 | 5801.77 | 1.67936e+07 | 5441.88 | 1.67936e+07 | 45258.5 | 3980.3 | 1.67936e+07 | 1.02041e+06 | 1.1443e+06 | 7901.72 | 1402.31 | 830151 | 1.18376e+06 | 8.15306e+06 | 3.08717e+07 | 30798 | 377 | | 83199 | 20240326.22 | 27809.5 | 2.51822e+07 | 0.803466 | 5497.03 | 8.59996e+07 | 17377.9 | 73578.8 | 52933.2 | 13883.2 | 1.67936e+07 | 54977.4 | 13882.3 | 1.05021e+07 | 60660.2 | 15335.1 | 1.25993e+07 | 4420.9 | 21158 | 22072.6 | 17485.9 | 16999.3 | 1340.5 | 1.25993e+07 | 11526.7 | 6896.2 | 1.88908e+07 | 6787.3 | 6.30784e+06 | 5762.56 | 1.67936e+07 | 5421.69 | 1.67936e+07 | 45287.7 | 3980.18 | 1.67936e+07 | 1.02249e+06 | 1.15835e+06 | 8023.63 | 1401.56 | 832515 | 1.17816e+06 | 8.17261e+06 | 3.0797e+07 | 31222 | 380 | | 83237 | 20240327.2 | 27828.2 | 2.30851e+07 | 0.790118 | 5604.75 | 8.59996e+07 | 17172.5 | 69153.3 | 52876.5 | 13991.6 | 1.88908e+07 | 55942.2 | 13952 | 1.05021e+07 | 62508.3 | 15388.6 | 1.46964e+07 | 4442.9 | 21009.9 | 21714.6 | 17551 | 17257.1 | 1353.9 | 1.25993e+07 | 11678.8 | 6719.02 | 1.67936e+07 | 6884.1 | 6.30784e+06 | 5796.84 | 1.67936e+07 | 5457.87 | 1.67936e+07 | 44158.8 | 3993.74 | 1.67936e+07 | 1.02082e+06 | 1.17343e+06 | 7628.84 | 1399.07 | 832195 | 1.17065e+06 | 8.12634e+06 | 3.07748e+07 | 31638 | 375 | mku-stats | build_id | build_number | pi_basic_mt_virtual_cft^ | Commit latency factor | tpcc_virtual_cft^ | ls_virtual_cft^ | pi_ls_virtual_cft^ | pi_basic_virtual_cft^ | pi_basic_js_virtual_cft^ | ls_jwt_virtual_cft^ | pi_ls_jwt_virtual_cft^ | ls_js_virtual_cft^ | ls_full_js_virtual_cft^ | ls_js_jwt_virtual_cft^ | hist_sgx_cft^ | tpcc_sgx_cft^ | tpcc_sgx_cft_mem | pi_basic_mt_sgx_cft^ | pi_basic_mt_sgx_cft_mem | ls_sgx_cft^ | ls_sgx_cft_mem | pi_ls_sgx_cft^ | pi_ls_sgx_cft_mem | pi_basic_sgx_cft^ | pi_basic_sgx_cft_mem | pi_basic_js_sgx_cft^ | pi_basic_js_sgx_cft_mem | ls_jwt_sgx_cft^ | ls_jwt_sgx_cft_mem | pi_ls_jwt_sgx_cft^ | pi_ls_jwt_sgx_cft_mem | ls_js_sgx_cft^ | ls_js_sgx_cft_mem | ls_full_js_sgx_cft^ | ls_full_js_sgx_cft_mem | ls_js_jwt_sgx_cft^ | ls_js_jwt_sgx_cft_mem | KV ser (/s)^ | KV deser (/s)^ | KV snap ser (/s)^ | KV snap deser (/s)^ | RB put (/s)^ | CHAMP put (/s)^ | RB get (/s)^ | CHAMP get (/s)^ | tlc_sim_traces | tlc_sim_levelmean | |-----------:|:---------------|---------------------------:|------------------------:|--------------------:|------------------:|---------------------:|------------------------:|---------------------------:|----------------------:|-------------------------:|---------------------:|--------------------------:|-------------------------:|----------------:|----------------:|-------------------:|-----------------------:|--------------------------:|--------------:|-----------------:|-----------------:|--------------------:|--------------------:|-----------------------:|-----------------------:|--------------------------:|------------------:|---------------------:|---------------------:|------------------------:|-----------------:|--------------------:|----------------------:|-------------------------:|---------------------:|------------------------:|---------------:|-----------------:|--------------------:|----------------------:|---------------:|------------------:|---------------:|------------------:|-----------------:|--------------------:| | 83262 | 20240327.9 | 90187.2 | 0.788648 | 17270 | 53011.1 | 56641.5 | 62507.7 | 4499.9 | 21081.5 | 21650.2 | 17553.2 | 17497.9 | 11765.8 | 43193 | 5553.09 | 8.59996e+07 | 27880 | 2.51822e+07 | 13871.6 | 1.88908e+07 | 13901.4 | 1.05021e+07 | 15363 | 1.25993e+07 | 1372.7 | 1.25993e+07 | 6820.91 | 1.88908e+07 | 6903.6 | 6.30784e+06 | 5773.41 | 1.67936e+07 | 5488.37 | 1.67936e+07 | 3993.62 | 1.67936e+07 | 1.0014e+06 | 1.15848e+06 | 7770.63 | 1399 | 840134 | 1.18195e+06 | 8.15433e+06 | 3.07789e+07 | 32079 | 374 |

images