Closed PwzXxm closed 1 year ago
Results on ubuntu-20.04 and uint8 dataset int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 470.78 33965.08 63547.00 17.78 2.86 29 29 30 86.02 12 2 425.84 37543.26 88343.00 19.58 3.84 29 29 30 89.26 14 2 390.37 40916.63 99225.00 21.41 4.66 29 29 31 91.62 16 2 359.40 44457.52 105786.00 23.27 4.86 29 29 31 93.35
int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 544.35 29341.57 62719.00 15.38 2.06 28 28 30 86.15 12 2 486.00 32823.81 63322.00 17.18 4.12 28 28 31 89.42 14 2 440.38 36311.79 78547.00 19.01 2.95 28 28 31 91.68 16 2 401.45 39831.98 63961.00 20.87 3.67 28 28 32 93.40
int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 778.12 20487.15 70450.00 10.76 0.00 30 30 40 95.05 12 2 724.59 22000.12 62231.00 11.55 0.00 30 30 40 96.30 14 2 667.91 23858.59 233607.00 12.32 0.00 30 30 40 97.22 16 2 640.41 24901.92 62746.00 13.09 0.00 30 30 41 97.89
int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE1000_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1041.76 15291.43 61879.00 8.03 0.00 25 34 34 94.53 12 2 955.46 16679.30 60477.00 8.78 0.00 25 34 34 95.95 14 2 874.38 18138.21 60164.00 9.53 0.00 25 34 35 96.98 16 2 816.72 19518.03 61480.00 10.27 0.00 25 34 35 97.69
int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 845.69 18775.99 96588.00 9.86 0.00 25 25 36 95.02 12 2 788.10 20226.97 62655.00 10.66 0.00 25 25 36 96.26 14 2 732.45 21765.55 63060.00 11.44 0.00 25 25 37 97.20 16 2 683.72 23321.43 89270.00 12.22 0.00 25 25 39 97.88
int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 781.91 20350.57 77420.00 10.71 0.00 25 26 36 94.97 12 2 730.10 21839.15 61345.00 11.48 0.00 25 26 37 96.20 14 2 683.96 23314.59 88323.00 12.27 0.00 25 26 38 97.16 16 2 642.22 24832.50 76036.00 13.04 0.00 25 26 38 97.85
int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 758.36 21015.38 61324.00 11.06 0.00 25 25 35 90.75 12 2 689.40 23088.59 90859.00 12.10 0.00 25 25 36 92.96 14 2 635.04 25114.01 62261.00 13.17 0.00 25 25 37 94.55 16 2 588.83 27093.09 91377.00 14.23 0.00 25 25 37 95.75
int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 709.68 22461.83 109690.00 11.74 0.00 29 29 40 90.76 12 2 654.12 24378.04 99385.00 12.79 0.00 29 29 40 92.90 14 2 603.73 26401.35 93262.00 13.85 0.00 29 29 40 94.57 16 2 561.63 28410.36 95465.00 14.88 0.00 29 29 41 95.75
Results on ubuntu-20.04 and float dataset float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 482.61 33074.90 146997.00 17.30 8.93 38 38 39 86.24 12 2 438.07 36481.72 106853.00 19.09 11.64 38 38 40 89.35 14 2 399.67 39989.69 107713.00 20.92 12.71 38 38 40 91.63 16 2 367.21 43493.20 106925.00 22.76 14.58 38 38 41 93.34
float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 528.68 30237.25 103569.00 15.86 7.96 41 42 43 86.17 12 2 473.23 33750.99 105595.00 17.66 10.15 41 42 44 89.31 14 2 429.42 37206.30 105540.00 19.49 12.20 41 42 44 91.67 16 2 391.91 40787.86 107573.00 21.34 13.08 41 42 45 93.38
float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 743.24 21447.49 95267.00 11.26 0.00 41 41 49 94.70 12 2 692.68 23012.14 104767.00 12.08 0.00 41 41 50 96.13 14 2 644.27 24745.51 143785.00 12.92 0.00 41 41 50 97.06 16 2 608.48 26204.41 107007.00 13.74 0.00 41 41 51 97.75
float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE1000_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1068.35 14908.16 118293.00 7.79 0.00 42 49 50 94.41 12 2 965.41 16503.43 153256.00 8.57 0.00 42 49 50 95.88 14 2 879.14 18124.08 121166.00 9.36 0.00 42 49 50 96.85 16 2 822.23 19374.32 102365.00 10.15 0.00 42 49 51 97.56
float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 793.44 20093.71 102676.00 10.55 0.00 43 43 50 94.63 12 2 729.52 21837.84 142704.00 11.36 0.00 43 43 50 96.01 14 2 685.03 23268.30 110215.00 12.20 0.00 43 43 51 96.92 16 2 641.51 24837.64 108560.00 13.03 0.00 43 43 52 97.62
float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 759.31 20990.66 104093.00 11.00 0.00 42 42 49 94.71 12 2 702.37 22695.25 143200.00 11.81 0.00 42 42 50 96.07 14 2 660.65 24123.54 106754.00 12.65 0.00 42 42 51 97.03 16 2 619.83 25725.04 106548.00 13.49 0.00 42 42 51 97.70
float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 719.01 22163.99 102998.00 11.63 0.00 39 39 47 90.30 12 2 659.41 24174.34 96521.00 12.70 0.00 39 39 48 92.57 14 2 607.50 26242.67 105109.00 13.80 0.00 39 39 48 94.28 16 2 560.19 28414.20 102838.00 14.89 0.00 39 39 49 95.56
float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 716.25 22172.58 104504.00 11.66 0.00 41 41 48 90.60 12 2 647.16 24626.52 198717.00 12.74 0.00 41 41 49 92.73 14 2 605.30 26337.43 107026.00 13.84 0.00 41 41 50 94.39 16 2 559.62 28498.58 105643.00 14.94 0.00 41 41 50 95.59
Signed-off-by: Patrick Weizhi Xu weizhi.xu@zilliz.com