zilliztech / starling

Other
41 stars 13 forks source link

Add Memory Statistics and Fix Warnings #14

Closed PwzXxm closed 1 year ago

PwzXxm commented 1 year ago

Signed-off-by: Patrick Weizhi Xu weizhi.xu@zilliz.com

github-actions[bot] commented 1 year ago

Results on ubuntu-20.04 and uint8 dataset int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 471.94 33874.66 64366.00 17.73 2.80 28 28 30 30.98 12 2 427.24 37423.34 64053.00 19.57 4.19 28 28 30 31.00 14 2 390.51 40906.20 64549.00 21.42 3.95 28 28 30 31.00 16 2 359.83 44424.69 95264.00 23.28 4.28 28 28 31 31.00

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 528.77 30240.10 63201.00 15.69 2.19 25 25 26 30.98 12 2 477.89 33454.16 63468.00 17.54 3.00 25 25 27 30.99 14 2 431.07 37066.58 64000.00 19.40 4.16 25 25 27 30.99 16 2 393.47 40624.05 64355.00 21.27 4.42 25 25 28 30.99

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1071.21 14897.47 61586.00 7.84 0.00 28 28 35 31.00 12 2 1002.59 15915.56 62765.00 8.35 0.00 28 28 35 31.00 14 2 940.73 16961.96 62235.00 8.89 0.00 28 28 36 31.00 16 2 891.44 17883.77 62092.00 9.40 0.00 28 28 36 31.00

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE1000_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1887.39 8442.61 59870.00 4.37 0.00 24 33 35 31.00 12 2 1717.78 9276.85 59840.00 4.89 0.00 24 33 40 31.00 14 2 1548.01 10299.71 60239.00 5.43 0.00 24 33 44 31.00 16 2 1403.47 11361.50 60407.00 5.95 0.00 24 33 50 31.00

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1207.39 13212.92 62998.00 6.95 0.00 28 28 34 31.00 12 2 1114.29 14321.28 62050.00 7.53 0.00 28 28 35 31.00 14 2 1031.35 15476.10 62050.00 8.13 0.00 28 28 35 31.00 16 2 970.53 16443.71 62292.00 8.63 0.00 28 28 35 31.00

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1108.39 14395.65 62632.00 7.57 0.00 25 25 31 31.00 12 2 1036.41 15396.57 61788.00 8.11 0.00 25 25 32 31.00 14 2 964.77 16497.01 61739.00 8.66 0.00 25 25 32 31.00 16 2 914.04 17452.90 62281.00 9.18 0.00 25 25 33 31.00

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1119.75 14246.97 61976.00 7.50 0.00 24 24 31 30.99 12 2 1026.57 15455.94 91391.00 8.09 0.00 24 24 32 30.99 14 2 962.95 16568.60 108741.00 8.68 0.00 24 24 32 30.99 16 2 911.83 17503.75 61817.00 9.22 0.00 24 24 33 30.99

int_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1153.64 13822.79 61155.00 7.30 0.00 25 25 31 31.00 12 2 1060.77 15036.49 69153.00 7.89 0.00 25 25 32 31.00 14 2 981.33 16258.39 100519.00 8.51 0.00 25 25 32 31.00 16 2 919.18 17358.64 61734.00 9.10 0.00 25 25 33 31.00

github-actions[bot] commented 1 year ago

Results on ubuntu-20.04 and float dataset float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 483.20 33031.11 96549.00 17.31 15.04 38 38 40 86.01 12 2 437.11 36465.17 95847.00 19.10 17.92 38 38 40 89.23 14 2 400.21 39942.46 94809.00 20.93 17.91 38 38 41 91.60 16 2 367.46 43504.34 99610.00 22.78 19.85 38 38 41 93.33

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS0_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 526.78 30295.65 67305.00 15.88 8.91 46 46 47 86.04 12 2 474.29 33695.27 96590.00 17.67 10.29 46 46 48 89.23 14 2 428.65 37295.20 95729.00 19.50 12.92 46 46 48 91.55 16 2 391.25 40860.59 96311.00 21.34 15.18 46 46 49 93.34

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 733.29 21720.13 64955.00 11.42 0.00 39 39 46 94.50 12 2 684.11 23278.61 93968.00 12.24 0.00 39 39 47 95.97 14 2 640.35 24871.61 94356.00 13.07 0.00 39 39 47 96.93 16 2 602.82 26436.86 93256.00 13.90 0.00 39 39 47 97.66

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE1000_BW2_T16_MEML0_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 1070.93 14858.22 75347.00 7.80 0.00 38 46 51 94.21 12 2 973.63 16345.60 63320.00 8.60 0.00 38 46 57 95.75 14 2 887.94 17884.18 92170.00 9.41 0.00 38 46 64 96.80 16 2 821.68 19382.30 66837.00 10.18 0.00 38 46 70 97.60

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 790.90 20044.10 64626.00 10.53 0.00 38 38 45 94.47 12 2 734.58 21653.23 99080.00 11.37 0.00 38 38 47 95.93 14 2 686.72 23192.10 93523.00 12.20 0.00 38 38 48 96.90 16 2 640.26 24844.51 91949.00 13.04 0.00 38 38 49 97.71

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{0}_GP_LOCK_NUMS0_GP_CUT4096.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 752.16 21175.10 67624.00 11.15 0.00 39 40 47 94.55 12 2 696.44 22796.91 92986.00 11.97 0.00 39 40 47 95.96 14 2 654.35 24342.81 94166.00 12.80 0.00 39 40 48 96.95 16 2 615.36 25887.18 96068.00 13.62 0.00 39 40 48 97.69

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ0_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 706.46 22435.03 92887.00 11.79 0.00 38 38 45 90.38 12 2 652.84 24392.26 93397.00 12.86 0.00 38 38 46 92.67 14 2 599.84 26554.42 94765.00 13.95 0.00 38 38 47 94.19 16 2 553.72 28680.90 93715.00 15.05 0.00 38 38 48 95.49

float_10k_M1_R16_L32_B0.00003/search/search_K5_CACHE0_BW2_T16_MEML5_MEMK3_MEM_USE_FREQ1_PS1_USE_RATIO1.0_GP_USE_FREQ{1}_GP_LOCK_NUMS100_GP_CUT3.log L Beamwidth QPS Mean Latency 99.9 Latency Mean IOs CPU (s) B4 Load In-Mem After Load Cache Peak Mem(MB) Recall@5 10 2 717.08 22205.26 89365.00 11.67 0.00 39 39 48 90.37 12 2 656.20 24264.69 92545.00 12.76 0.00 39 39 49 92.64 14 2 604.51 26355.99 92304.00 13.85 0.00 39 39 50 94.23 16 2 560.00 28446.20 95488.00 14.95 0.00 39 39 50 95.51