Algin Page Search Reuse Range Search Strategy

[PwzXxm]

Signed-off-by: Patrick Weizhi Xu weizhi.xu@zilliz.com

[github-actions[bot]]

Results on ubuntu-20.04 and float dataset float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 483.31 33055.17 73488.00 17.32 2.95 39 39 40 86.30 12 2 432.68 36947.06 93929.00 19.11 3.47 39 39 41 89.39 14 2 399.57 40002.77 83516.00 20.95 4.35 39 39 43 91.68 16 2 367.07 43532.66 106706.00 22.80 7.59 39 39 43 93.41

float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 512.78 31180.90 63471.00 16.31 2.46 38 39 40 86.15 12 2 462.35 34572.90 64262.00 18.10 3.04 38 39 41 89.35 14 2 419.50 38079.17 83896.00 19.93 3.88 38 39 41 91.65 16 2 384.22 41599.02 96501.00 21.79 4.27 38 39 42 93.37

float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 734.61 21617.88 62711.00 11.37 0.00 39 39 47 94.81 12 2 685.49 23263.73 91771.00 12.21 0.00 39 39 47 96.18 14 2 642.38 24831.64 87908.00 13.02 0.00 39 39 48 97.06 16 2 603.45 26433.38 92106.00 13.85 0.00 39 39 48 97.75

float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE1000_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1064.55 14969.33 60894.00 7.83 0.00 38 47 47 94.48 12 2 966.72 16489.23 62460.00 8.64 0.00 38 47 48 95.96 14 2 887.76 17960.95 74151.00 9.43 0.00 38 47 48 96.91 16 2 821.58 19407.21 62224.00 10.21 0.00 38 47 48 97.61

float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 775.12 20569.81 63309.00 10.81 0.00 43 44 51 94.62 12 2 718.52 22194.49 156861.00 11.65 0.00 43 44 52 96.05 14 2 670.71 23753.79 64031.00 12.47 0.00 43 44 52 96.99 16 2 628.76 25354.94 64509.00 13.30 0.00 43 44 53 97.72

float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 759.48 20996.76 89698.00 11.06 0.00 39 39 46 94.75 12 2 700.48 22710.88 63162.00 11.90 0.00 39 39 46 96.12 14 2 658.56 24204.82 63402.00 12.71 0.00 39 39 47 96.99 16 2 618.95 25773.23 89791.00 13.55 0.00 39 39 47 97.73

float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 715.21 22287.70 63361.00 11.72 0.00 41 41 49 90.72 12 2 653.50 24398.14 63855.00 12.79 0.00 41 41 49 92.91 14 2 602.84 26422.61 90769.00 13.87 0.00 41 41 49 94.52 16 2 560.35 28467.09 66170.00 14.96 0.00 41 41 50 95.68

float_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 719.99 22136.89 62637.00 11.65 0.00 40 40 47 90.69 12 2 657.22 24260.70 89845.00 12.74 0.00 40 40 48 92.90 14 2 604.06 26397.21 90285.00 13.82 0.00 40 40 48 94.49 16 2 560.05 28480.01 91435.00 14.93 0.00 40 40 49 95.74

[github-actions[bot]]

Results on ubuntu-20.04 and uint8 dataset int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 468.88 34085.50 93459.00 17.87 19.62 25 25 27 86.25 12 2 424.54 37581.29 105192.00 19.68 23.63 25 25 27 89.50 14 2 388.64 41100.97 105436.00 21.51 25.48 25 25 28 91.94 16 2 357.46 44609.89 109038.00 23.37 29.39 25 25 29 93.67

int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 535.02 29845.54 96062.00 15.64 15.97 25 25 28 86.18 12 2 479.84 33294.44 96717.00 17.44 20.11 25 25 29 89.40 14 2 434.11 36790.80 100900.00 19.26 19.73 25 25 29 91.82 16 2 395.76 40382.57 105274.00 21.12 23.18 25 25 30 93.62

int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 753.04 21056.99 86765.00 11.07 0.00 28 28 38 94.96 12 2 707.72 22487.76 90783.00 11.85 0.00 28 28 42 96.25 14 2 661.35 24062.82 103559.00 12.63 0.00 28 28 43 97.21 16 2 609.50 26120.47 176219.00 13.41 0.00 28 28 43 97.85

int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE1000_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1059.09 15004.86 95632.00 7.91 0.00 25 34 36 94.71 12 2 964.93 16474.49 63707.00 8.67 0.00 25 34 36 96.09 14 2 882.11 17973.67 90500.00 9.42 0.00 25 34 37 97.10 16 2 795.99 19987.46 182000.00 10.16 0.00 25 34 37 97.78

int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 813.51 19493.11 182626.00 10.09 0.00 25 25 36 94.93 12 2 761.55 20892.83 175117.00 10.88 0.00 25 25 37 96.24 14 2 712.58 22255.90 93620.00 11.66 0.00 25 25 37 97.19 16 2 666.10 23820.06 119201.00 12.45 0.00 25 25 37 97.86

int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 774.22 20552.85 101373.00 10.76 0.00 25 25 36 94.92 12 2 723.20 21975.91 103407.00 11.54 0.00 25 25 37 96.27 14 2 673.07 23646.88 101939.00 12.32 0.00 25 25 37 97.22 16 2 627.49 25354.49 142479.00 13.11 0.00 25 25 37 97.88

int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 732.47 21728.96 176181.00 11.18 0.00 28 28 38 90.87 12 2 683.83 23284.73 97396.00 12.22 0.00 28 28 38 93.00 14 2 624.89 25467.81 102732.00 13.28 0.00 28 28 39 94.62 16 2 581.24 27397.73 106932.00 14.33 0.00 28 28 39 95.88

int_10k_M1_R16_L32_B0.00003/search/search_SQ0_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 696.27 22786.63 165397.00 11.77 0.00 26 26 35 91.07 12 2 646.40 24530.55 104038.00 12.82 0.00 26 26 39 93.12 14 2 604.30 26361.25 101713.00 13.85 0.00 26 26 40 94.69 16 2 550.40 28962.19 182478.00 14.91 0.00 26 26 40 95.92