Daily reliability experiments

[achamayou]

/azp run

[achamayou]

/azp run

[achamayou]

/azp run

[achamayou]

/azp run

[achamayou]

/azp run

[achamayou]

/azp run

[ccf-bot]

daily_reliability@33894 aka 20211006.14 vs main ewma over 20 builds from 33556 to 33879

Click to see table

| build_id | build_number | tpcc_sgx_cft^ | tpcc_sgx_cft_mem | tpcc_sgx_bft^ | tpcc_sgx_bft_mem | ls_sgx_cft^ | ls_sgx_cft_mem | ls_jwt_sgx_cft^ | ls_jwt_sgx_cft_mem | ls_js_sgx_cft^ | ls_js_sgx_cft_mem | ls_full_js_sgx_cft^ | ls_full_js_sgx_cft_mem | ls_js_jwt_sgx_cft^ | ls_js_jwt_sgx_cft_mem | CHAMP put (/s)^ | CHAMP get (/s)^ | Historical query (/s)^ | |-----------:|:---------------|----------------:|-------------------:|----------------:|-------------------:|--------------:|-----------------:|------------------:|---------------------:|-----------------:|--------------------:|----------------------:|-------------------------:|---------------------:|------------------------:|------------------:|------------------:|-------------------------:| | 33556 | 20210930.12 | 6343.73 | 9.34585e+07 | 2026.17 | 1.61878e+08 | 23494 | 1.84853e+07 | 4529.14 | 1.56017e+07 | 2790.84 | 1.2456e+07 | 2680.92 | 1.37667e+07 | 1824.25 | 8.2617e+06 | 1.4531e+06 | 3.50085e+07 | nan | | 33585 | 20211001.1 | 6790.56 | 9.16235e+07 | 1986.75 | 1.52965e+08 | 24322.5 | 1.7961e+07 | 4368 | 1.58639e+07 | 2780.5 | 1.4291e+07 | 2582.07 | 1.4291e+07 | 1824.07 | 8.2617e+06 | 1.47794e+06 | 3.54933e+07 | nan | | 33617 | 20211001.11 | 6617.49 | 9.08371e+07 | 2098.95 | 1.53227e+08 | 24638.7 | 1.87475e+07 | 4347.72 | 1.56017e+07 | 2770.74 | 1.48153e+07 | 2644.06 | 1.4291e+07 | 1830.52 | 8.2617e+06 | 1.48072e+06 | 3.63766e+07 | nan | | 33629 | 20211001.14 | 6726.37 | 9.18856e+07 | 1938.29 | 1.73937e+08 | 24493.8 | 1.82232e+07 | 4393.12 | 1.58639e+07 | 2753.63 | 1.4291e+07 | 2641.67 | 1.50774e+07 | 1827.08 | 8.52384e+06 | 1.47486e+06 | 3.63766e+07 | nan | | 33651 | 20211001.20 | 6569.54 | 9.24099e+07 | 2033.54 | 1.52703e+08 | 24688.5 | 1.7961e+07 | 4354.01 | 1.58639e+07 | 2750.44 | 1.21939e+07 | 2651.15 | 1.37667e+07 | 1846.17 | 7.73741e+06 | 1.4454e+06 | 3.57417e+07 | nan | | 33669 | 20211004.1 | 6810.55 | 9.13613e+07 | 2008.62 | 1.62402e+08 | 24698.4 | 1.84853e+07 | 4378.6 | 1.58639e+07 | 2755.27 | 1.48153e+07 | 2639.16 | 1.0621e+07 | 1844.59 | 8.52384e+06 | 1.4773e+06 | 3.58036e+07 | nan | | 33677 | 20211004.4 | 6628.34 | 8.97885e+07 | 2113.29 | 1.4379e+08 | 24671 | 1.82232e+07 | 4368.51 | 1.56017e+07 | 2752.76 | 1.03588e+07 | 2650.93 | 1.4291e+07 | 1837.47 | 8.2617e+06 | 1.46233e+06 | 3.56174e+07 | nan | | 33715 | 20211004.14 | 6649.96 | 9.10992e+07 | 1902.2 | 1.48509e+08 | 24420.6 | 1.84853e+07 | 4426.44 | 1.56017e+07 | 2719.51 | 1.03588e+07 | 2704.95 | 1.50774e+07 | 1836.97 | 8.52384e+06 | 1.48126e+06 | 3.56788e+07 | nan | | 33719 | 20211004.15 | 6878.85 | 9.10992e+07 | 1801.04 | 1.63975e+08 | 24438.7 | 1.82232e+07 | 4331.17 | 1.58639e+07 | 2751.85 | 1.03588e+07 | 2602.68 | 1.08831e+07 | 1796.84 | 8.2617e+06 | 1.49227e+06 | 3.58042e+07 | nan | | 33724 | 20211004.17 | 6564.67 | 9.18856e+07 | 1874.15 | 1.76296e+08 | 24825.3 | 1.7961e+07 | 4408.15 | 1.63882e+07 | 2753.4 | 1.50774e+07 | 2613.04 | 1.4291e+07 | 1841.12 | 8.2617e+06 | 1.38508e+06 | 3.63114e+07 | nan | | 33726 | 20211004.18 | 6620.37 | 9.21478e+07 | 2040.8 | 1.52179e+08 | 24168.6 | 1.84853e+07 | 4420.32 | 1.56017e+07 | 2796.07 | 1.00967e+07 | 2601.17 | 1.45532e+07 | 1831.48 | 8.2617e+06 | 1.4642e+06 | 3.66362e+07 | nan | | 33733 | 20211005.1 | 6372.55 | 9.08371e+07 | 2055.06 | 1.46936e+08 | 24055.4 | 1.7961e+07 | 4386.69 | 1.58639e+07 | 2793.32 | 1.48153e+07 | 2635.9 | 1.48153e+07 | 1833.13 | 8.2617e+06 | 1.45155e+06 | 3.64406e+07 | nan | | 33801 | 20211005.20 | 6757.24 | 9.16235e+07 | 2056.16 | 1.84947e+08 | 23586.7 | 1.82232e+07 | 4379.64 | 1.56017e+07 | 2744.98 | 1.45532e+07 | 2647.81 | 1.53396e+07 | 1824.47 | 8.52384e+06 | 1.45548e+06 | 3.58669e+07 | 7723.88 | | 33828 | 20211005.28 | 6616.47 | 9.21478e+07 | 2134.71 | 1.48771e+08 | 24685 | 1.84853e+07 | 4397.62 | 1.56017e+07 | 2747.05 | 1.45532e+07 | 2655.43 | 1.48153e+07 | 1838.74 | 1.03588e+07 | 1.48104e+06 | 3.65708e+07 | 8419.74 | | 33846 | 20211005.33 | 6764.41 | 9.21478e+07 | 2057.61 | 1.49557e+08 | 24652.1 | 1.92717e+07 | 4682.93 | 1.58639e+07 | 2774.57 | 1.03588e+07 | 2635.92 | 1.00967e+07 | 1823.89 | 8.2617e+06 | 1.4683e+06 | 3.58036e+07 | 8483.54 | | 33853 | 20211006.1 | 6724.34 | 9.13613e+07 | 1971.22 | 1.52179e+08 | 23813.9 | 1.84853e+07 | 4564.88 | 1.56017e+07 | 2774.71 | 1.50774e+07 | 2620.99 | 1.08831e+07 | 1815.45 | 8.52384e+06 | 1.45465e+06 | 3.58669e+07 | 8567.16 | | 33868 | 20211006.6 | 6324.38 | 9.16235e+07 | 2018.73 | 1.5113e+08 | 24389.9 | 1.84853e+07 | 4590.95 | 1.56017e+07 | 2703.88 | 1.27181e+07 | 2630.89 | 1.53396e+07 | 1827.27 | 1.03588e+07 | 1.44888e+06 | 3.59298e+07 | 7730.87 | | 33876 | 20211006.7 | 6503.48 | 9.18856e+07 | 2035.66 | 1.50082e+08 | 24348.1 | 1.84853e+07 | 4587.58 | 1.56017e+07 | 2801.24 | 1.03588e+07 | 2675.02 | 1.08831e+07 | 1845.32 | 8.2617e+06 | 1.45671e+06 | 3.51884e+07 | 8612.83 | | 33878 | 20211006.8 | 6627.39 | 9.16235e+07 | 2143.78 | 1.61878e+08 | 24714.3 | 1.9796e+07 | 4542.04 | 1.58639e+07 | 2713.41 | 1.45532e+07 | 2640.49 | 1.08831e+07 | 1844.03 | 7.73741e+06 | 1.45237e+06 | 3.58669e+07 | 8702.62 | | 33879 | 20211006.9 | 6770.99 | 9.18856e+07 | 1951.38 | 1.75772e+08 | 24731.7 | 1.76989e+07 | 4509.17 | 1.56017e+07 | 2744.7 | 1.48153e+07 | 2639.81 | 1.08831e+07 | 1834.94 | 8.2617e+06 | 1.47539e+06 | 3.59298e+07 | 8364.45 |

[azure-pipelines[bot]]

Comment was made before the most recent commit for PR 3054 in repo microsoft/CCF

[achamayou]

/azp run

[azure-pipelines[bot]]

Comment was made before the most recent commit for PR 3054 in repo microsoft/CCF

[azure-pipelines[bot]]

Comment was made before the most recent commit for PR 3054 in repo microsoft/CCF

[azure-pipelines[bot]]

Comment was made before the most recent commit for PR 3054 in repo microsoft/CCF

[azure-pipelines[bot]]

Pull request is closed

[azure-pipelines[bot]]

Pull request is closed