zilliztech / starling

Other
41 stars 13 forks source link

Change Data Type from int8 to uint8 in UT #16

Closed PwzXxm closed 1 year ago

PwzXxm commented 1 year ago

Signed-off-by: Patrick Weizhi Xu weizhi.xu@zilliz.com

github-actions[bot] commented 1 year ago

Results on ubuntu-20.04 and uint8 dataset int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 469.91 33987.10 67195.00 17.79 9.71 25 25 26 86.11 12 2 426.96 37422.10 67357.00 19.59 10.44 25 25 27 89.30 14 2 390.43 40938.48 95459.00 21.42 15.13 25 25 27 91.66 16 2 355.79 44882.86 100668.00 23.28 19.91 25 25 28 93.38

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 533.62 29919.76 66015.00 15.69 8.35 28 28 30 86.14 12 2 477.55 33442.68 67094.00 17.48 9.36 28 28 31 89.31 14 2 433.01 36885.94 67701.00 19.32 8.92 28 28 31 91.67 16 2 395.02 40471.66 93774.00 21.18 12.41 28 28 32 93.34

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 778.45 20457.24 94583.00 10.75 0.00 29 29 39 95.02 12 2 726.11 21937.92 63652.00 11.53 0.00 29 29 40 96.27 14 2 679.28 23456.86 102895.00 12.31 0.00 29 29 40 97.23 16 2 638.75 24856.37 92385.00 13.07 0.00 29 29 41 97.88

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE1000_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1047.10 15196.99 62567.00 8.00 0.00 25 34 36 94.65 12 2 953.19 16697.08 92400.00 8.76 0.00 25 34 41 96.05 14 2 883.71 18016.50 76613.00 9.50 0.00 25 34 45 97.08 16 2 819.24 19443.30 94076.00 10.23 0.00 25 34 50 97.77

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 840.03 18960.88 96392.00 9.98 0.00 28 28 38 94.98 12 2 778.26 20471.60 95146.00 10.76 0.00 28 28 39 96.30 14 2 722.67 21975.96 91496.00 11.55 0.00 28 28 39 97.23 16 2 679.18 23464.74 84110.00 12.33 0.00 28 28 40 97.91

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 783.48 20337.99 65148.00 10.69 0.00 25 26 35 95.03 12 2 729.28 21846.97 71552.00 11.46 0.00 25 26 36 96.29 14 2 684.08 23295.06 100159.00 12.24 0.00 25 26 37 97.25 16 2 644.35 24738.95 98785.00 13.01 0.00 25 26 37 97.92

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 750.34 21235.17 61531.00 11.19 0.00 25 25 35 90.98 12 2 681.52 23381.08 96105.00 12.25 0.00 25 25 36 93.08 14 2 628.89 25349.37 94158.00 13.31 0.00 25 25 37 94.74 16 2 582.69 27369.49 100675.00 14.38 0.00 25 25 37 95.91

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 714.63 22294.26 91796.00 11.72 0.00 25 25 34 90.99 12 2 653.32 24395.13 116032.00 12.78 0.00 25 25 34 93.17 14 2 605.38 26338.71 73329.00 13.83 0.00 25 25 35 94.76 16 2 561.56 28397.34 98661.00 14.88 0.00 25 25 35 95.91

github-actions[bot] commented 1 year ago

Results on ubuntu-20.04 and float dataset float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 481.67 33187.93 90362.00 17.33 7.53 49 49 50 85.73 12 2 432.35 36892.26 187446.00 19.14 8.69 49 49 51 89.00 14 2 399.53 40004.29 93685.00 20.96 10.24 49 49 51 91.35 16 2 363.22 43984.19 107095.00 22.82 12.06 49 49 52 93.14

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 534.18 29883.47 87442.00 15.67 7.83 38 39 40 85.58 12 2 477.39 33390.73 88146.00 17.47 9.73 38 39 41 88.87 14 2 432.52 36889.75 97954.00 19.29 11.23 38 39 41 91.25 16 2 393.34 40537.78 105798.00 21.13 14.35 38 39 42 93.12

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 631.14 25241.46 182733.00 11.23 0.00 46 46 52 94.46 12 2 660.18 24143.47 133299.00 12.06 0.00 46 46 52 95.89 14 2 629.72 25322.58 141713.00 12.89 0.00 46 46 53 96.92 16 2 606.80 26271.65 103501.00 13.72 0.00 46 46 53 97.67

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE1000_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1057.74 15054.38 106569.00 7.83 0.00 43 51 56 94.14 12 2 951.69 16733.35 90010.00 8.64 0.00 43 51 61 95.66 14 2 879.36 18114.68 145259.00 9.44 0.00 43 51 69 96.68 16 2 792.23 20116.05 140647.00 10.21 0.00 43 51 75 97.46

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 790.56 20160.04 90689.00 10.39 0.00 39 39 45 94.36 12 2 732.54 21754.69 123487.00 11.23 0.00 39 39 47 95.79 14 2 673.87 23644.79 145768.00 12.06 0.00 39 39 47 96.82 16 2 640.84 24791.76 128814.00 12.90 0.00 39 39 48 97.62

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 753.61 21147.98 92189.00 10.99 0.00 38 39 46 94.42 12 2 692.96 22999.95 161712.00 11.81 0.00 38 39 47 95.89 14 2 652.64 24426.10 216694.00 12.65 0.00 38 39 48 96.91 16 2 605.70 26326.33 205241.00 13.48 0.00 38 39 48 97.66

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 718.63 22088.64 154079.00 11.47 0.00 39 39 47 90.16 12 2 649.61 24530.80 190517.00 12.54 0.00 39 39 47 92.37 14 2 609.34 26156.93 105972.00 13.64 0.00 39 39 47 94.12 16 2 563.02 28319.66 157264.00 14.74 0.00 39 39 48 95.43

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 719.66 22144.35 96747.00 11.61 0.00 41 41 49 90.26 12 2 644.00 24742.65 105133.00 12.70 0.00 41 41 49 92.51 14 2 598.17 26649.21 157613.00 13.81 0.00 41 41 49 94.18 16 2 552.83 28847.24 161346.00 14.91 0.00 41 41 50 95.46