ysh329 / deep-learning-operator

implementation, benchmark, optimization
GNU Lesser General Public License v3.0
1 stars 1 forks source link

neon gemv_trans_mx1 #1

Open ysh329 opened 5 years ago

ysh329 commented 5 years ago

新旧版gemv性能比较

新版多线程计算正确的代码性能差相比旧代码,差2~4倍。二者在执行test_gemm_accuracy之前,都在命令行执行export OMP_NUM_THREADS=1命令。下面分别是新旧代码的gemv性能数据。

新版gemv_trans_mx1性能结果 m, n, k, time_min, time_max, time_avg, gflops 1, 1, 1000, 0.000976562, 0.0180664, 0.0069987, 0.285767 1, 1, 2000, 0.00292969, 0.00488281, 0.00366211, 1.09227 1, 1, 3000, 0.00415039, 0.00585938, 0.00496419, 1.20866 1, 1, 4000, 0.00292969, 0.00805664, 0.00537109, 1.48945 1, 1, 5000, 0.00390625, 0.00708008, 0.00537109, 1.86182 1, 1, 6000, 0.00610352, 0.0090332, 0.00732422, 1.6384 1, 1, 7000, 0.00488281, 0.00805664, 0.00602214, 2.32476 1, 1, 8000, 0.00683594, 0.0109863, 0.0086263, 1.85479 1, 1, 9000, 0.0078125, 0.0131836, 0.00968424, 1.85869 1, 1, 10000, 0.0090332, 0.0100098, 0.00968424, 2.06521 1, 1, 11000, 0.00683594, 0.0119629, 0.0086263, 2.55034 1, 1, 12000, 0.0078125, 0.0090332, 0.00830078, 2.89129 1, 1, 13000, 0.0119629, 0.0180664, 0.0139974, 1.85749 1, 1, 14000, 0.0129395, 0.013916, 0.013265, 2.11082 1, 1, 15000, 0.0219727, 0.0280762, 0.0240072, 1.24963 1, 1, 16000, 0.0231934, 0.0249023, 0.0240072, 1.33294 1, 1, 17000, 0.0148926, 0.0219727, 0.017334, 1.96146 1, 1, 18000, 0.0109863, 0.0187988, 0.0136719, 2.63314 1, 1, 19000, 0.0168457, 0.0251465, 0.019694, 1.92952 1, 1, 20000, 0.0119629, 0.0209961, 0.0153809, 2.60063 1, 1, 21000, 0.0178223, 0.0270996, 0.0213216, 1.96983 1, 1, 22000, 0.019043, 0.027832, 0.0219727, 2.00249 1, 1, 23000, 0.0200195, 0.0290527, 0.0233561, 1.96951 1, 1, 24000, 0.0209961, 0.0300293, 0.0240072, 1.9994 1, 1, 25000, 0.0219727, 0.032959, 0.0256348, 1.95048 1, 1, 26000, 0.0148926, 0.0268555, 0.0192871, 2.6961 1, 1, 27000, 0.0229492, 0.0339355, 0.0270182, 1.99865 1, 1, 28000, 0.0239258, 0.0361328, 0.0283203, 1.97738 1, 1, 29000, 0.0170898, 0.0290527, 0.0210775, 2.75175 1, 1, 30000, 0.0178223, 0.0297852, 0.0218913, 2.74082 1, 1000, 1000, 1.36597, 2.59595, 1.84098, 1.08638 1, 1000, 2000, 2.98096, 3.44604, 3.13737, 1.27495 1, 1000, 3000, 4.61206, 5.28491, 4.87598, 1.23052 1, 1000, 4000, 6.21899, 6.99609, 6.54598, 1.22212 1, 1000, 5000, 8.05518, 9.01709, 8.41536, 1.1883 1, 1000, 6000, 9.72778, 10.8132, 10.0896, 1.18934 1, 1000, 7000, 11.2771, 13.0601, 11.9233, 1.17417 1, 1000, 8000, 13.252, 14.7739, 13.7769, 1.16136 1, 1000, 9000, 14.958, 16.6501, 15.534, 1.15875 1, 1000, 10000, 16.604, 18.584, 17.3297, 1.15409 1, 1000, 11000, 18.498, 20.5029, 19.1803, 1.14701 1, 1000, 12000, 20.1631, 22.4651, 20.9513, 1.14551 1, 1000, 13000, 22.0249, 24.563, 22.8979, 1.13547 1, 1000, 14000, 23.866, 26.5552, 24.8257, 1.12786 1, 1000, 15000, 25.575, 28.45, 26.595, 1.12803 1, 1000, 16000, 27.3672, 30.4968, 28.4579, 1.12447 1, 1000, 17000, 28.8689, 31.0601, 29.645, 1.1469 1, 1000, 18000, 29.4348, 32.6052, 30.4941, 1.18056 1, 1000, 19000, 31.083, 34.4648, 32.2323, 1.17894 1, 1000, 20000, 32.7981, 36.356, 34.018, 1.17585 1, 1000, 21000, 34.4211, 38.167, 35.899, 1.16995 1, 1000, 22000, 36.1069, 40.001, 37.4347, 1.17538 1, 1000, 23000, 37.7861, 41.8489, 39.1517, 1.17492 1, 1000, 24000, 39.4402, 43.7039, 40.8633, 1.17465 1, 1000, 25000, 41.1121, 45.562, 42.609, 1.17346 1, 1000, 26000, 42.7642, 47.374, 44.315, 1.17342 1, 1000, 27000, 44.9011, 49.2148, 46.864, 1.15227 1, 1000, 28000, 48.186, 53.314, 49.9093, 1.12203 1, 1000, 29000, 49.8979, 55.1431, 51.6684, 1.12254 1, 1000, 30000, 51.614, 57.426, 53.571, 1.12001 1, 2000, 1000, 2.8291, 3.31299, 2.99064, 1.33751 1, 2000, 2000, 6.02783, 6.89502, 6.34798, 1.26024 1, 2000, 3000, 9.80981, 11.0078, 10.2246, 1.17364 1, 2000, 4000, 13.9001, 15.5459, 14.4613, 1.1064 1, 2000, 5000, 17.7361, 19.8708, 18.5023, 1.08095 1, 2000, 6000, 21.4519, 24.071, 22.3944, 1.0717 1, 2000, 7000, 25.4661, 28.4409, 26.4863, 1.05715 1, 2000, 8000, 29.5491, 32.7339, 30.6217, 1.04501 1, 2000, 9000, 33.561, 37.2358, 34.7893, 1.0348 1, 2000, 10000, 37.3579, 41.5349, 38.7716, 1.03168 1, 2000, 11000, 40.925, 46.1428, 42.715, 1.03008 1, 2000, 12000, 44.6541, 49.426, 46.252, 1.03779 1, 2000, 13000, 49.7849, 56.3909, 51.9942, 1.00011 1, 2000, 14000, 52.5508, 59.0229, 55.3669, 1.01143 1, 2000, 15000, 55.8408, 62.7939, 58.2397, 1.03023 1, 2000, 16000, 60.1831, 67.4849, 62.6926, 1.02085 1, 2000, 17000, 63.9001, 70.8979, 66.265, 1.02618 1, 2000, 18000, 64.9509, 75.0859, 69.234, 1.03995 1, 2000, 19000, 70.5459, 76.731, 72.9486, 1.04183 1, 2000, 20000, 74.4219, 83.571, 77.5587, 1.03148 1, 2000, 21000, 77.063, 87.5381, 81.2133, 1.03431 1, 2000, 22000, 80.2661, 89.1611, 84.148, 1.04578 1, 2000, 23000, 86.7451, 96.207, 89.9354, 1.02296 1, 2000, 24000, 90.5889, 100.6, 93.9909, 1.02138 1, 2000, 25000, 92.7561, 105.079, 97.4737, 1.02592 1, 2000, 26000, 94.947, 107.867, 100.311, 1.03678 1, 2000, 27000, 100.198, 113.794, 105.204, 1.02658 1, 2000, 28000, 106.16, 120.918, 112.132, 0.998826 1, 2000, 29000, 111.32, 121.931, 115.133, 1.00753 1, 2000, 30000, 114.087, 126.066, 119.593, 1.0034 1, 3000, 1000, 2.62012, 3.33301, 2.86401, 2.09496 1, 3000, 2000, 7.34692, 8.84692, 7.85734, 1.52723 1, 3000, 3000, 13.9128, 16.0371, 14.6234, 1.23091 1, 3000, 4000, 20.8289, 23.644, 21.8087, 1.10048 1, 3000, 5000, 27.4001, 30.7778, 28.5266, 1.05165 1, 3000, 6000, 33.512, 37.6328, 34.9013, 1.03148 1, 3000, 7000, 39.769, 44.447, 41.331, 1.01619 1, 3000, 8000, 45.7942, 51.2212, 47.6187, 1.00801 1, 3000, 9000, 51.75, 57.8052, 53.8017, 1.00369 1, 3000, 10000, 57.6201, 65.0051, 60.1784, 0.997036 1, 3000, 11000, 63.6321, 71.092, 66.1794, 0.99729 1, 3000, 12000, 69.051, 77.3262, 71.9354, 1.0009 1, 3000, 13000, 75.394, 84.426, 78.432, 0.994491 1, 3000, 14000, 81.302, 91.301, 84.7654, 0.990971 1, 3000, 15000, 87.3879, 97.7529, 90.8507, 0.990637 1, 3000, 16000, 93.2021, 104.679, 97.0617, 0.989062 1, 3000, 17000, 99.0999, 111.092, 103.148, 0.988874 1, 3000, 18000, 104.424, 116.882, 108.634, 0.994167 1, 3000, 19000, 110.425, 123.345, 114.735, 0.993594 1, 3000, 20000, 116.838, 130.634, 121.591, 0.986916 1, 3000, 21000, 122.546, 138.436, 127.872, 0.985358 1, 3000, 22000, 128.273, 144.247, 133.614, 0.98792 1, 3000, 23000, 135.175, 152.079, 140.905, 0.979383 1, 3000, 24000, 141.105, 158.805, 147.483, 0.976383 1, 3000, 25000, 148.743, 166.052, 155.031, 0.967548 1, 3000, 26000, 155.831, 175.356, 162.667, 0.959013 1, 3000, 27000, 166.215, 186.532, 173.248, 0.935074 1, 3000, 28000, 165.583, 196.295, 176.038, 0.954337 1, 3000, 29000, 171.581, 191.864, 178.41, 0.975281 1, 3000, 30000, 176.902, 197.948, 184.977, 0.973092 1, 4000, 1000, 5.54419, 6.39502, 5.84302, 1.36916 1, 4000, 2000, 13.386, 15.1169, 13.9779, 1.14466 1, 4000, 3000, 23.5471, 26.1411, 24.4181, 0.982879 1, 4000, 4000, 33.283, 36.79, 34.479, 0.928101 1, 4000, 5000, 42.9841, 47.0881, 44.3691, 0.901529 1, 4000, 6000, 52.2861, 57.207, 53.927, 0.890092 1, 4000, 7000, 61.269, 67.094, 63.2454, 0.88544 1, 4000, 8000, 70.291, 76.9619, 72.551, 0.882138 1, 4000, 9000, 78.356, 87.105, 81.3193, 0.885398 1, 4000, 10000, 86.22, 104.168, 93.5773, 0.854908 1, 4000, 11000, 95.0239, 105.098, 99.1617, 0.887439 1, 4000, 12000, 105.498, 116.339, 109.117, 0.879789 1, 4000, 13000, 114.008, 125.012, 117.784, 0.882973 1, 4000, 14000, 120.014, 133.462, 125.259, 0.894145 1, 4000, 15000, 131.567, 147.111, 136.954, 0.876209 1, 4000, 16000, 136.817, 169.662, 153.964, 0.831361 1, 4000, 17000, 143.134, 157.235, 147.884, 0.91964 1, 4000, 18000, 153.488, 167.682, 158.376, 0.909229 1, 4000, 19000, 160.767, 176.334, 166.071, 0.915269 1, 4000, 20000, 170.526, 185.007, 176.025, 0.90896 1, 4000, 21000, 186.127, 197.174, 191.007, 0.87955 1, 4000, 22000, 190.374, 328.474, 245.542, 0.716783 1, 4000, 23000, 197.383, 213.851, 204.042, 0.901774 1, 4000, 24000, 204.391, 225.424, 211.704, 0.906928 1, 4000, 25000, 213.137, 232.374, 219.603, 0.910736 1, 4000, 26000, 221.66, 241.714, 228.378, 0.910772 1, 4000, 27000, 230.305, 251.154, 237.617, 0.909025 1, 4000, 28000, 239.858, 269.019, 250.47, 0.89432 1, 4000, 29000, 247.604, 270.091, 255.602, 0.907662 1, 4000, 30000, 256.533, 281.299, 264.798, 0.906351 1, 5000, 1000, 6.78491, 7.82495, 7.15796, 1.39705 1, 5000, 2000, 16.7729, 19.2759, 17.6303, 1.13441 1, 5000, 3000, 28.8479, 32.6621, 30.1317, 0.99563 1, 5000, 4000, 40.28, 45.0969, 41.89, 0.954882 1, 5000, 5000, 51.251, 57.1682, 53.2344, 0.939243 1, 5000, 6000, 62.4309, 69.5061, 64.9347, 0.924006 1, 5000, 7000, 74.0381, 85.835, 78.0833, 0.896478 1, 5000, 8000, 84.0051, 94.1521, 87.444, 0.914871 1, 5000, 9000, 94.3391, 105.617, 98.1767, 0.916715 1, 5000, 10000, 104.978, 117.003, 108.987, 0.917544 1, 5000, 11000, 115.457, 128.587, 120.155, 0.915486 1, 5000, 12000, 126.028, 140.679, 130.917, 0.916614 1, 5000, 13000, 136.56, 152.743, 141.975, 0.915654 1, 5000, 14000, 147.602, 165.002, 153.43, 0.91247 1, 5000, 15000, 159.152, 177.136, 165.385, 0.906975 1, 5000, 16000, 169.929, 190.327, 176.899, 0.904471 1, 5000, 17000, 180.561, 201.295, 187.544, 0.906456 1, 5000, 18000, 191.578, 213.234, 198.81, 0.905389 1, 5000, 19000, 202.478, 225.273, 210.14, 0.904159 1, 5000, 20000, 214.26, 237.007, 222.885, 0.897322 1, 5000, 21000, 224.333, 252.071, 234.254, 0.896463 1, 5000, 22000, 235, 261.156, 243.751, 0.902562 1, 5000, 23000, 246.011, 273.188, 255.081, 0.901675 1, 5000, 24000, 257.706, 287.907, 271.864, 0.882794 1, 5000, 25000, 268.323, 307.973, 282.422, 0.885199 1, 5000, 26000, 279.52, 318.463, 292.531, 0.888793 1, 5000, 27000, 289.168, 321.386, 299.964, 0.900108 1, 5000, 28000, 304.177, 346.074, 321.072, 0.872078 1, 5000, 29000, 317.767, 369.176, 334.923, 0.865871 1, 5000, 30000, 328.403, 380.022, 345.756, 0.867663 1, 6000, 1000, 8.07104, 9.30786, 8.51196, 1.40978 1, 6000, 2000, 21.3262, 24.1179, 22.2723, 1.07757 1, 6000, 3000, 36.0439, 40.658, 37.6016, 0.957405 1, 6000, 4000, 49.886, 55.3159, 51.7537, 0.927471 1, 6000, 5000, 62.9661, 70.3269, 65.4469, 0.916773 1, 6000, 6000, 75.646, 84.2441, 78.545, 0.916672 1, 6000, 7000, 89.2681, 99.0811, 92.5593, 0.907526 1, 6000, 8000, 102.2, 113.375, 105.949, 0.906094 1, 6000, 9000, 115.08, 127.814, 119.351, 0.904892 1, 6000, 10000, 128.085, 142.236, 132.817, 0.903501 1, 6000, 11000, 140.9, 156.735, 146.2, 0.902871 1, 6000, 12000, 154.405, 171.737, 160.199, 0.898882 1, 6000, 13000, 169.748, 187.714, 176.027, 0.88623 1, 6000, 14000, 181.511, 207.412, 190.204, 0.883261 1, 6000, 15000, 195.185, 216.135, 202.437, 0.889167 1, 6000, 16000, 208.611, 230.879, 216.036, 0.888742 1, 6000, 17000, 222.015, 245.574, 230.036, 0.886819 1, 6000, 18000, 238.853, 263.127, 247.333, 0.873318 1, 6000, 19000, 255.238, 275.262, 267.342, 0.852841 1, 6000, 20000, 271.71, 354.553, 300.593, 0.798423 1, 6000, 21000, 300.874, 364.75, 342.186, 0.736442 1, 6000, 22000, 321.245, 420.912, 366.837, 0.719665 1, 6000, 23000, 301.683, 341.114, 314.925, 0.8764 1, 6000, 24000, 353.342, 628.757, 468.706, 0.614457 1, 6000, 25000, 332.993, 596.75, 427.849, 0.701182 1, 6000, 26000, 344.134, 384.181, 366.743, 0.850731 1, 6000, 27000, 391.114, 465.288, 416.029, 0.778792 1, 6000, 28000, 404.956, 457.95, 423.194, 0.793963 1, 6000, 29000, 436.792, 546.023, 481.552, 0.722663 1, 6000, 30000, 651.909, 661.088, 655.393, 0.549288 1, 7000, 1000, 9.79492, 11.3711, 10.366, 1.35057 1, 7000, 2000, 26.584, 30.5989, 27.966, 1.00122 1, 7000, 3000, 43.1741, 50.2271, 45.836, 0.91631 1, 7000, 4000, 60.436, 68.8081, 63.4403, 0.882719 1, 7000, 5000, 76.3311, 87.0068, 80.0263, 0.874713 1, 7000, 6000, 89.8721, 105.196, 95.821, 0.876634 1, 7000, 7000, 108.444, 122.67, 113.211, 0.865643 1, 7000, 8000, 125.075, 142.489, 131.003, 0.85494 1, 7000, 9000, 141.325, 159.847, 147.543, 0.85399 1, 7000, 10000, 157.724, 178.381, 164.774, 0.849647 1, 7000, 11000, 176.181, 197.269, 183.467, 0.839388 1, 7000, 12000, 194.364, 217.079, 203.645, 0.824965 1, 7000, 13000, 226.585, 261.862, 239.756, 0.759104 1, 7000, 14000, 234.637, 269.393, 246.569, 0.794908 1, 7000, 15000, 278.422, 319.445, 292.763, 0.717305 1, 7000, 16000, 291.788, 341.606, 308.689, 0.72565 1, 7000, 17000, 278.559, 319.544, 292.98, 0.812341 1, 7000, 18000, 310.407, 329.797, 318.061, 0.792302 1, 7000, 19000, 303.193, 391.891, 337.162, 0.788938 1, 7000, 20000, 351.454, 398.449, 373.352, 0.749963 1, 7000, 21000, 344.293, 583.915, 426.654, 0.689084 1, 7000, 22000, 341.401, 423.31, 368.904, 0.834905 1, 7000, 23000, 391.256, 438.382, 422.335, 0.762427 1, 7000, 24000, 622.162, 774.328, 699.49, 0.48035 1, 7000, 25000, 539.499, 742.741, 608.53, 0.575157 1, 7000, 26000, 813.918, 1109.1, 939.311, 0.387518 1, 7000, 27000, 543.229, 672.944, 587.121, 0.64382 1, 7000, 28000, 670.939, 1194.5, 933.934, 0.41973 1, 7000, 29000, 867.638, 1343.7, 1138.1, 0.356734 1, 7000, 30000, 681.648, 1361.7, 912.13, 0.46046 1, 8000, 1000, 10.7629, 12.3828, 11.3353, 1.41152 1, 8000, 2000, 29.3149, 32.7109, 30.4633, 1.05044 1, 8000, 3000, 50.6431, 54.21, 51.8437, 0.92586 1, 8000, 4000, 67.865, 75.5659, 70.8183, 0.903721 1, 8000, 5000, 86.708, 95.0459, 90.4067, 0.884891 1, 8000, 6000, 108.126, 117.081, 111.154, 0.863669 1, 8000, 7000, 125.674, 139.301, 130.236, 0.859977 1, 8000, 8000, 143.583, 158.156, 148.883, 0.859738 1, 8000, 9000, 156.862, 171.695, 161.808, 0.889944 1, 8000, 10000, 175.216, 191.572, 180.748, 0.885212 1, 8000, 11000, 194.394, 211.588, 200.257, 0.878872 1, 8000, 12000, 215.123, 233.117, 221.386, 0.867264 1, 8000, 13000, 230.43, 253.175, 238.068, 0.873699 1, 8000, 14000, 248.72, 271.392, 256.297, 0.873987 1, 8000, 15000, 266.673, 290.338, 274.641, 0.873869 1, 8000, 16000, 288.27, 313.902, 298.215, 0.85844 1, 8000, 17000, 302.978, 329.151, 311.813, 0.872319 1, 8000, 18000, 326.704, 357.378, 336.935, 0.854764 1, 8000, 19000, 375.108, 383.992, 379.885, 0.800242 1, 8000, 20000, 428.305, 463.857, 441.513, 0.724781 1, 8000, 21000, 443.313, 481.728, 463.583, 0.724789 1, 8000, 22000, 478.132, 530.894, 496.383, 0.70913 1, 8000, 23000, 531.179, 569.318, 550.877, 0.668026 1, 8000, 24000, 580.939, 633.202, 598.392, 0.64172 1, 8000, 25000, 636.935, 691.712, 667.24, 0.599484 1, 8000, 26000, 694.268, 738.045, 718.971, 0.578604 1, 8000, 27000, 803.141, 862.755, 823.124, 0.52483 1, 8000, 28000, 859.531, 963.022, 894.23, 0.50099 1, 8000, 29000, 925.045, 1080.07, 982.285, 0.472368 1, 8000, 30000, 1726.53, 1915.83, 1827.4, 0.262668 1, 9000, 1000, 12.6309, 14.7141, 13.3373, 1.3496 1, 9000, 2000, 35.085, 40.3892, 36.876, 0.976245 1, 9000, 3000, 58.22, 67.1108, 61.2643, 0.881427 1, 9000, 4000, 80.0398, 90.8792, 83.7209, 0.86 1, 9000, 5000, 100.266, 117.777, 106.832, 0.842445 1, 9000, 6000, 119.776, 141.3, 127.086, 0.84982 1, 9000, 7000, 136.356, 160.357, 145.335, 0.866961 1, 9000, 8000, 156.727, 178.231, 163.964, 0.878243 1, 9000, 9000, 177.453, 200.264, 185.093, 0.875237 1, 9000, 10000, 199.152, 223.926, 207.436, 0.867736 1, 9000, 11000, 220.178, 246.636, 229.9, 0.861245 1, 9000, 12000, 254.868, 275.428, 262.715, 0.822183 1, 9000, 13000, 261.306, 292.452, 271.75, 0.861086 1, 9000, 14000, 282.066, 314.338, 294.581, 0.855453 1, 9000, 15000, 309.609, 336.575, 318.608, 0.847437 1, 9000, 16000, 323.957, 368.476, 338.825, 0.849997 1, 9000, 17000, 345.228, 387.384, 359.322, 0.851604 1, 9000, 18000, 429.436, 545.696, 476.048, 0.680603 1, 9000, 19000, 453.322, 570.197, 493.534, 0.692961 1, 9000, 20000, 757.333, 893.792, 816.165, 0.441087 1, 9000, 21000, 757.484, 1125.21, 914.571, 0.413309 1, 9000, 22000, 803.537, 995.584, 913.078, 0.433698 1, 9000, 23000, 1168.32, 2559.09, 1765.66, 0.234473 1, 9000, 24000, 1160.75, 1662.47, 1332.49, 0.324206 1, 9000, 25000, 741.493, 1074.57, 870.945, 0.51668 1, 9000, 26000, 977.593, 981.543, 978.912, 0.478082 1, 9000, 27000, 1017.19, 1076.04, 1049.8, 0.462944 1, 9000, 28000, 1097.29, 1185.59, 1140.16, 0.442045 1, 9000, 29000, 1215.96, 1382.42, 1284.94, 0.406245 1, 9000, 30000, 1373.08, 1587.23, 1462.55, 0.369217 1, 10000, 1000, 13.885, 16.2661, 14.6954, 1.36097 1, 10000, 2000, 36.3931, 41.397, 38.0857, 1.05026 1, 10000, 3000, 61.2991, 68.803, 63.827, 0.940041 1, 10000, 4000, 84.585, 94.6531, 87.9747, 0.909352 1, 10000, 5000, 107.299, 120.967, 112.121, 0.891896 1, 10000, 6000, 129.607, 145.003, 134.742, 0.890591 1, 10000, 7000, 151.973, 170.115, 158.749, 0.881896 1, 10000, 8000, 176.812, 198.483, 184.069, 0.869239 1, 10000, 9000, 199.641, 223.06, 207.721, 0.866545 1, 10000, 10000, 223.773, 248.423, 232.001, 0.862067 1, 10000, 11000, 246.901, 276.569, 258.047, 0.852558 1, 10000, 12000, 273.17, 300.015, 282.756, 0.848789 1, 10000, 13000, 292.834, 327.06, 305.273, 0.851698 1, 10000, 14000, 315.898, 348.673, 327.38, 0.855275 1, 10000, 15000, 360.129, 393.362, 372.909, 0.804485 1, 10000, 16000, 401.099, 441.026, 414.732, 0.771583 1, 10000, 17000, 437.647, 483.135, 453.737, 0.749333 1, 10000, 18000, 475.1, 532.89, 494.966, 0.727322 1, 10000, 19000, 500.582, 588.828, 535.433, 0.709706 1, 10000, 20000, 510.411, 613.52, 546.333, 0.732154 1, 10000, 21000, 592.603, 651.227, 619.085, 0.678421 1, 10000, 22000, 647.339, 735.906, 677.219, 0.649716 1, 10000, 23000, 725.862, 840.636, 778.762, 0.590681 1, 10000, 24000, 872.798, 951.913, 911.795, 0.526434 1, 10000, 25000, 1018.76, 1094.14, 1060.35, 0.471541 1, 10000, 26000, 1081.71, 1204.18, 1134.34, 0.458415 1, 10000, 27000, 1169.73, 1310.19, 1224.07, 0.441151 1, 10000, 28000, 1400.75, 1521.11, 1444.98, 0.387549 1, 10000, 29000, 1496.27, 1596.63, 1558.42, 0.372172 1, 10000, 30000, 1652.41, 1869.55, 1794.59, 0.334339 1, 11000, 1000, 15.4641, 18.4319, 16.4677, 1.33595 1, 11000, 2000, 41.032, 47.2529, 43.116, 1.0205 1, 11000, 3000, 67.8711, 77.387, 71.059, 0.928806 1, 11000, 4000, 93.7852, 106.47, 98.0944, 0.897095 1, 11000, 5000, 118.732, 135.231, 124.333, 0.884718 1, 11000, 6000, 142.809, 170.308, 152.295, 0.866739 1, 11000, 7000, 168.756, 191.808, 176.822, 0.870931 1, 11000, 8000, 194.583, 219.87, 203.03, 0.866865 1, 11000, 9000, 220.336, 247.736, 229.484, 0.862805 1, 11000, 10000, 249.197, 276.127, 258.213, 0.85201 1, 11000, 11000, 270.871, 308.885, 285.031, 0.849031 1, 11000, 12000, 298.078, 332.841, 309.693, 0.852456 1, 11000, 13000, 323.404, 360.944, 338.247, 0.845536 1, 11000, 14000, 366.347, 418.712, 383.857, 0.802382 1, 11000, 15000, 390.509, 438.144, 406.493, 0.811823 1, 11000, 16000, 466.563, 519.267, 486.995, 0.722801 1, 11000, 17000, 487.379, 544.712, 507.042, 0.737612 1, 11000, 18000, 524.49, 589.674, 549.988, 0.720015 1, 11000, 19000, 565.724, 640.083, 591.235, 0.706994 1, 11000, 20000, 586.268, 692.6, 622.443, 0.706892 1, 11000, 21000, 681.573, 753.52, 706.788, 0.653661 1, 11000, 22000, 805.698, 894.405, 843.946, 0.573496 1, 11000, 23000, 932.823, 1039.37, 975.85, 0.518522 1, 11000, 24000, 975.769, 1111.88, 1031.47, 0.51189 1, 11000, 25000, 1114.29, 1232.98, 1166.28, 0.471587 1, 11000, 26000, 1284.66, 1410.46, 1339.92, 0.426891 1, 11000, 27000, 1419.23, 1577.07, 1477.94, 0.40191 1, 11000, 28000, 1556.17, 1716.22, 1622.79, 0.379593 1, 11000, 29000, 1700.4, 1902.92, 1784.86, 0.35745 1, 11000, 30000, 1825.12, 2032.69, 1916.11, 0.344448 1, 12000, 1000, 15.9919, 18.8489, 16.9849, 1.41302 1, 12000, 2000, 44.4539, 50.0681, 46.3287, 1.03607 1, 12000, 3000, 74.0281, 82.6379, 76.9264, 0.93596 1, 12000, 4000, 102.131, 113.341, 105.871, 0.906767 1, 12000, 5000, 129.069, 143.349, 133.863, 0.896436 1, 12000, 6000, 157.143, 174.291, 162.875, 0.884112 1, 12000, 7000, 189.324, 207.279, 195.577, 0.858995 1, 12000, 8000, 213.982, 240.695, 223.712, 0.858245 1, 12000, 9000, 241.514, 266.423, 249.826, 0.864603 1, 12000, 10000, 269.204, 298.542, 278.991, 0.860244 1, 12000, 11000, 302.676, 327.882, 311.142, 0.848486 1, 12000, 12000, 326.633, 358.017, 337.136, 0.854255 1, 12000, 13000, 355.562, 390.131, 367.22, 0.849628 1, 12000, 14000, 386.249, 430.548, 403.45, 0.832816 1, 12000, 15000, 445.548, 490.494, 461.313, 0.780382 1, 12000, 16000, 484.6, 523.427, 501.307, 0.765997 1, 12000, 17000, 562.13, 615.304, 580.067, 0.703367 1, 12000, 18000, 585.319, 661.332, 613.462, 0.704201 1, 12000, 19000, 640.793, 699.504, 665.425, 0.685276 1, 12000, 20000, 731.94, 808.255, 759.044, 0.632374 1, 12000, 21000, 850.461, 951.547, 886.242, 0.568693 1, 12000, 22000, 896.845, 997.81, 932.242, 0.566376 1, 12000, 23000, 1039.53, 1146.41, 1078.95, 0.511608 1, 12000, 24000, 1180.11, 1324.62, 1229.21, 0.468594 1, 12000, 25000, 1299.87, 1420.19, 1352.72, 0.44355 1, 12000, 26000, 1441.07, 1531.73, 1484.14, 0.420446 1, 12000, 27000, 1551.87, 1700.38, 1616.49, 0.400868 1, 12000, 28000, 1664.67, 1764.62, 1709.36, 0.393129 1, 12000, 29000, 1803.09, 1924.54, 1856.59, 0.374881 1, 12000, 30000, 1962.29, 2128.98, 2037.36, 0.353399 1, 13000, 1000, 12.7251, 16.5359, 14.0183, 1.85472 1, 13000, 2000, 41.812, 49.459, 44.401, 1.17114 1, 13000, 3000, 72.749, 84.3872, 76.6514, 1.01759 1, 13000, 4000, 101.422, 117.463, 106.834, 0.97347 1, 13000, 5000, 127.959, 147.852, 134.606, 0.965784 1, 13000, 6000, 156.979, 180.086, 164.703, 0.947162 1, 13000, 7000, 185.219, 211.046, 193.894, 0.938655 1, 13000, 8000, 213.311, 242.126, 223.015, 0.932671 1, 13000, 9000, 244.825, 280.372, 257.03, 0.910399 1, 13000, 10000, 268.575, 307.211, 281.484, 0.923677 1, 13000, 11000, 296.836, 334.411, 310.659, 0.920625 1, 13000, 12000, 333.958, 366.124, 344.847, 0.904748 1, 13000, 13000, 353.199, 403.169, 369.964, 0.913602 1, 13000, 14000, 384.994, 433.132, 401.05, 0.907618 1, 13000, 15000, 414.327, 482.418, 440.445, 0.885467 1, 13000, 16000, 486.778, 557.12, 510.405, 0.81504 1, 13000, 17000, 553.471, 646.399, 588.003, 0.751697 1, 13000, 18000, 593.295, 683.524, 632.309, 0.740144 1, 13000, 19000, 690.971, 787.284, 724.669, 0.681691 1, 13000, 20000, 800.761, 911.575, 838.644, 0.620049 1, 13000, 21000, 877.271, 975.12, 917.22, 0.595277 1, 13000, 22000, 1025.35, 1122.46, 1065.09, 0.537046 1, 13000, 23000, 1104.65, 1228.71, 1158.69, 0.516102 1, 13000, 24000, 1202.71, 1369.31, 1263.54, 0.493851 1, 13000, 25000, 1303.16, 1445.32, 1358.92, 0.47832 1, 13000, 26000, 1354.61, 1490.4, 1412.45, 0.478599 1, 13000, 27000, 1516.7, 1710.22, 1604.44, 0.437537 1, 13000, 28000, 1655.65, 1788.44, 1701.24, 0.427923 1, 13000, 29000, 1735.56, 1927.02, 1814.66, 0.415504 1, 13000, 30000, 1935.41, 2214.12, 2048.79, 0.380712 1, 14000, 1000, 18.9089, 22.386, 20.0783, 1.39454 1, 14000, 2000, 52.4312, 60.3718, 55.3403, 1.01192 1, 14000, 3000, 87.6169, 99.2141, 91.4827, 0.918207 1, 14000, 4000, 120.07, 135.891, 125.528, 0.892231 1, 14000, 5000, 152.485, 171.933, 159.02, 0.880395 1, 14000, 6000, 186.461, 208.726, 193.894, 0.866453 1, 14000, 7000, 220.204, 245.292, 229.942, 0.852388 1, 14000, 8000, 255.87, 281.553, 266.034, 0.841998 1, 14000, 9000, 285.74, 324.997, 299.092, 0.842549 1, 14000, 10000, 318.459, 353.4, 330.199, 0.847973 1, 14000, 11000, 352.887, 390.472, 369.322, 0.83396 1, 14000, 12000, 384.897, 434.678, 402.063, 0.835691 1, 14000, 13000, 418.731, 465.806, 434.528, 0.837691 1, 14000, 14000, 454.498, 519.141, 479.364, 0.81775 1, 14000, 15000, 489.911, 544.447, 508.145, 0.826536 1, 14000, 16000, 524.814, 616.077, 558.679, 0.801892 1, 14000, 17000, 607.059, 685.344, 643.016, 0.740262 1, 14000, 18000, 721.981, 808.474, 751.916, 0.670287 1, 14000, 19000, 760.483, 855.004, 793.942, 0.670074 1, 14000, 20000, 871.593, 965.162, 911.83, 0.61415 1, 14000, 21000, 1029.81, 1131.25, 1079.2, 0.544849 1, 14000, 22000, 1098.66, 1215.01, 1143.04, 0.538916 1, 14000, 23000, 1148.03, 1303.22, 1202.76, 0.535434 1, 14000, 24000, 1245.6, 1399.43, 1308.91, 0.513405 1, 14000, 25000, 1376.12, 1511, 1434.2, 0.488078 1, 14000, 26000, 1471.7, 1687.72, 1558.69, 0.467059 1, 14000, 27000, 1559.23, 1719.22, 1628.15, 0.464331 1, 14000, 28000, 1782.22, 2007.69, 1881.55, 0.416678 1, 14000, 29000, 1970.27, 2197.22, 2061.96, 0.393799 1, 14000, 30000, 2181.56, 2395.61, 2262.68, 0.371241 1, 15000, 1000, 20.645, 24.8589, 22.0593, 1.35997 1, 15000, 2000, 54.9348, 64.1731, 58.0286, 1.03397 1, 15000, 3000, 92.6689, 107.244, 97.5496, 0.922608 1, 15000, 4000, 128.411, 147.227, 134.692, 0.890922 1, 15000, 5000, 164.3, 188.452, 173.245, 0.865828 1, 15000, 6000, 201.136, 227.917, 210.065, 0.856879 1, 15000, 7000, 237.292, 267.329, 248.823, 0.843972 1, 15000, 8000, 272.472, 317.162, 288.56, 0.831717 1, 15000, 9000, 307.632, 345.478, 320.3, 0.84296 1, 15000, 10000, 343.777, 385.342, 358.148, 0.837642 1, 15000, 11000, 378.701, 437.72, 400.904, 0.82314 1, 15000, 12000, 415.048, 464.564, 431.564, 0.834175 1, 15000, 13000, 457.553, 506.123, 477.596, 0.81659 1, 15000, 14000, 487.309, 547.465, 508.357, 0.826192 1, 15000, 15000, 529.598, 605.672, 561.552, 0.801351 1, 15000, 16000, 566.023, 647.941, 593.542, 0.808704 1, 15000, 17000, 677.32, 821.09, 725.501, 0.702962 1, 15000, 18000, 770.715, 868.885, 806.241, 0.669775 1, 15000, 19000, 857.086, 950.829, 888.653, 0.64142 1, 15000, 20000, 946.803, 1051.61, 985.907, 0.608577 1, 15000, 21000, 1048.01, 1168.11, 1088.62, 0.578717 1, 15000, 22000, 1129.88, 1271.34, 1187.9, 0.555601 1, 15000, 23000, 1219.48, 1380.12, 1281.31, 0.538512 1, 15000, 24000, 1296.42, 1487.25, 1382.89, 0.520648 1, 15000, 25000, 1387.85, 1549.12, 1456.52, 0.514927 1, 15000, 26000, 1503.07, 1766.41, 1610.76, 0.484245 1, 15000, 27000, 1714.09, 1868.53, 1771.59, 0.457218 1, 15000, 28000, 1904.15, 2077.23, 1968.52, 0.426716 1, 15000, 29000, 2132.58, 2328.99, 2200.45, 0.395374 1, 15000, 30000, 2340.8, 2645.12, 2458.66, 0.366053 1, 16000, 1000, 21.4121, 24.7021, 22.5124, 1.42144 1, 16000, 2000, 58.908, 65.3311, 61.0911, 1.04762 1, 16000, 3000, 99.2231, 108.895, 102.477, 0.936795 1, 16000, 4000, 138.168, 149.878, 142.097, 0.900794 1, 16000, 5000, 177.524, 206.761, 188.096, 0.850629 1, 16000, 6000, 215.81, 234.671, 222.105, 0.864457 1, 16000, 7000, 254.002, 276.173, 261.439, 0.856797 1, 16000, 8000, 291.699, 317.982, 301.215, 0.849891 1, 16000, 9000, 329.852, 362.37, 342.199, 0.841615 1, 16000, 10000, 367.696, 398.014, 378.473, 0.845503 1, 16000, 11000, 406.529, 439.509, 418.957, 0.840183 1, 16000, 12000, 442.203, 482.34, 455.625, 0.842798 1, 16000, 13000, 482.004, 523.251, 498.485, 0.834529 1, 16000, 14000, 594.078, 652.003, 613.393, 0.730363 1, 16000, 15000, 683.082, 744.83, 708.038, 0.67793 1, 16000, 16000, 724.161, 781.642, 744.799, 0.687434 1, 16000, 17000, 776.429, 831.986, 795.442, 0.683897 1, 16000, 18000, 820.487, 908.937, 852.382, 0.675753 1, 16000, 19000, 908.674, 991.472, 938.543, 0.647813 1, 16000, 20000, 991.731, 1080.89, 1031.46, 0.620483 1, 16000, 21000, 1068.86, 1173.44, 1104.94, 0.60818 1, 16000, 22000, 1191.83, 1329.06, 1244.58, 0.565653 1, 16000, 23000, 1284.7, 1376.64, 1323.61, 0.556057 1, 16000, 24000, 1383.13, 1473.28, 1425.85, 0.538628 1, 16000, 25000, 1559.33, 1682.88, 1610.49, 0.496742 1, 16000, 26000, 1681.25, 1764.88, 1712.48, 0.485846 1, 16000, 27000, 1849.32, 1933.31, 1897.34, 0.455374 1, 16000, 28000, 2096.92, 2189.29, 2136.39, 0.419398 1, 16000, 29000, 2264.52, 2325.45, 2287.1, 0.405754 OOM mem_cost:1920248000B skipped 1, 17000, 1000, 19.428, 24.1309, 21.005, 1.61866 1, 17000, 2000, 62.9761, 73.8059, 66.6053, 1.02094 1, 17000, 3000, 106.197, 122.663, 111.706, 0.913112 1, 17000, 4000, 146.786, 169.154, 154.289, 0.881465 1, 17000, 5000, 189.227, 215.516, 198.97, 0.8544 1, 17000, 6000, 234.753, 266.404, 245.747, 0.830123 1, 17000, 7000, 271.477, 310.058, 284.369, 0.836941 1, 17000, 8000, 311.724, 350.093, 324.789, 0.837467 1, 17000, 9000, 362.315, 404.661, 376.489, 0.812773 1, 17000, 10000, 393.849, 441.698, 409.919, 0.829432 1, 17000, 11000, 434.664, 486.622, 455.875, 0.820401 1, 17000, 12000, 475.514, 545.011, 498.68, 0.818161 1, 17000, 13000, 521.448, 586.451, 548.715, 0.805518 1, 17000, 14000, 624.976, 712.37, 654.693, 0.727059 1, 17000, 15000, 737.703, 835.613, 777.792, 0.655702 1, 17000, 16000, 760.983, 910.195, 813.142, 0.66901 1, 17000, 17000, 875.633, 973.687, 917.251, 0.630144 1, 17000, 18000, 944.347, 1050.26, 986.618, 0.620301 1, 17000, 19000, 1023.54, 1136.86, 1066.34, 0.605809 1, 17000, 20000, 1107.27, 1223.77, 1150.72, 0.590934 1, 17000, 21000, 1189.92, 1318.13, 1240.84, 0.575415 1, 17000, 22000, 1265.06, 1435.13, 1325.47, 0.564329 1, 17000, 23000, 1410.58, 1569.3, 1466.69, 0.533173 1, 17000, 24000, 1515.82, 1666.1, 1568.28, 0.520314 1, 17000, 25000, 1579.74, 1767.32, 1669.34, 0.509182 1, 17000, 26000, 1796.12, 1995.78, 1864.9, 0.47402 1, 17000, 27000, 1895.17, 2143.03, 1996.32, 0.459847 OOM mem_cost:1904248000B skipped OOM mem_cost:1972252000B skipped OOM mem_cost:2040256000B skipped 1, 18000, 1000, 24.106, 28.7339, 25.6676, 1.40254 1, 18000, 2000, 67.064, 77.2979, 70.4912, 1.0214 1, 18000, 3000, 112.609, 127.755, 117.665, 0.91786 1, 18000, 4000, 156.88, 177.325, 164.115, 0.877435 1, 18000, 5000, 204.6, 230.147, 213.546, 0.842911 1, 18000, 6000, 246.289, 279.696, 257.698, 0.838189 1, 18000, 7000, 289.067, 325.638, 301.271, 0.836456 1, 18000, 8000, 334.315, 367.553, 347.618, 0.828496 1, 18000, 9000, 375.645, 423.707, 392.099, 0.826323 1, 18000, 10000, 419.826, 464.292, 434.796, 0.827974 1, 18000, 11000, 463.066, 521.539, 486.009, 0.8148 1, 18000, 12000, 506.256, 559.698, 524.241, 0.824049 1, 18000, 13000, 550.45, 625.338, 578.558, 0.808908 1, 18000, 14000, 639.779, 711.135, 670.977, 0.751143 1, 18000, 15000, 645.471, 715.061, 668.862, 0.807342 1, 18000, 16000, 715.752, 851.276, 764.223, 0.753706 1, 18000, 17000, 839.492, 941.747, 879.48, 0.695866 1, 18000, 18000, 913.948, 1021.59, 951.373, 0.681121 1, 18000, 19000, 988.886, 1118.26, 1034.86, 0.660956 1, 18000, 20000, 1027.63, 1172.97, 1082.02, 0.665423 1, 18000, 21000, 1074.96, 1200.84, 1127.25, 0.67066 1, 18000, 22000, 1188.3, 1356.84, 1254.3, 0.631426 1, 18000, 23000, 1303.78, 1488.64, 1377.85, 0.600937 1, 18000, 24000, 1423.48, 1585.34, 1491.18, 0.579407 1, 18000, 25000, 1580.02, 1837.81, 1683.44, 0.534619 1, 18000, 26000, 1746.96, 1972.21, 1837.25, 0.509457 OOM mem_cost:1944252000B skipped OOM mem_cost:2016256000B skipped OOM mem_cost:2088260000B skipped OOM mem_cost:-2134703296B skipped 1, 19000, 1000, 16.4141, 21.4771, 18.1194, 2.0972 1, 19000, 2000, 62.3301, 74.5291, 67.05, 1.13348 1, 19000, 3000, 109.441, 128.346, 115.757, 0.984822 1, 19000, 4000, 154.514, 178.718, 162.611, 0.934748 1, 19000, 5000, 199.529, 227.748, 208.943, 0.909339 1, 19000, 6000, 247.104, 279.357, 257.923, 0.883986 1, 19000, 7000, 285.041, 328.585, 299.685, 0.887598 1, 19000, 8000, 327.854, 369.661, 341.819, 0.88936 1, 19000, 9000, 376.846, 417.589, 392.001, 0.872447 1, 19000, 10000, 413.1, 470.706, 432.449, 0.878716 1, 19000, 11000, 456.172, 513.25, 478.136, 0.874228 1, 19000, 12000, 500.207, 572.797, 524.976, 0.868612 1, 19000, 13000, 578.639, 654.741, 610.359, 0.809359 1, 19000, 14000, 660.901, 746.349, 689.629, 0.77143 1, 19000, 15000, 767.395, 879.366, 805.851, 0.707326 1, 19000, 16000, 805.992, 978.432, 867.671, 0.700726 1, 19000, 17000, 870.062, 1049.98, 936.598, 0.68973 1, 19000, 18000, 932.102, 1045.45, 972.727, 0.703178 1, 19000, 19000, 1052.6, 1179.12, 1100.59, 0.656011 1, 19000, 20000, 1114.1, 1249.23, 1164.58, 0.652595 1, 19000, 21000, 1226.34, 1395.08, 1283.05, 0.621953 1, 19000, 22000, 1344.1, 1519.22, 1412.96, 0.591665 1, 19000, 23000, 1438.8, 1607.99, 1507.59, 0.579734 1, 19000, 24000, 1564.52, 1786.04, 1641.87, 0.555465 OOM mem_cost:1900252000B skipped OOM mem_cost:1976256000B skipped OOM mem_cost:2052260000B skipped OOM mem_cost:2128264000B skipped OOM mem_cost:-2090699296B skipped OOM mem_cost:-2014695296B skipped 1, 20000, 1000, 27.749, 33.134, 29.5754, 1.35248 1, 20000, 2000, 73.5142, 84.0032, 77.0287, 1.03857 1, 20000, 3000, 124.621, 140.445, 129.913, 0.923695 1, 20000, 4000, 176.422, 196.32, 183.337, 0.87271 1, 20000, 5000, 230.322, 263.385, 241.903, 0.826777 1, 20000, 6000, 276.804, 309.246, 287.649, 0.83435 1, 20000, 7000, 324.492, 356.131, 335.12, 0.835522 1, 20000, 8000, 380.837, 411.367, 391.93, 0.816473 1, 20000, 9000, 422.907, 463.095, 436.888, 0.824011 1, 20000, 10000, 472.863, 515.189, 490.294, 0.815837 1, 20000, 11000, 519.636, 574.216, 538.039, 0.817785 1, 20000, 12000, 579.244, 622.682, 593.867, 0.808262 1, 20000, 13000, 677.218, 735.407, 696.645, 0.746435 1, 20000, 14000, 796.491, 885.358, 826.214, 0.677791 1, 20000, 15000, 812.398, 904.373, 845.233, 0.709863 1, 20000, 16000, 884.943, 975.291, 922.042, 0.694111 1, 20000, 17000, 982.998, 1077.75, 1015.19, 0.669826 1, 20000, 18000, 1060.16, 1192.32, 1109.61, 0.648875 1, 20000, 19000, 1085.84, 1233.27, 1138.48, 0.667558 1, 20000, 20000, 1209.09, 1379.32, 1270.11, 0.629868 1, 20000, 21000, 1273.92, 1406.82, 1325.81, 0.633574 1, 20000, 22000, 1395.31, 1534.34, 1449.34, 0.607174 1, 20000, 23000, 1494.19, 1671.4, 1565.1, 0.587823 OOM mem_cost:1920256000B skipped OOM mem_cost:2000260000B skipped OOM mem_cost:2080264000B skipped OOM mem_cost:-2134699296B skipped OOM mem_cost:-2054695296B skipped OOM mem_cost:-1974691296B skipped OOM mem_cost:-1894687296B skipped 1, 21000, 1000, 17.582, 23.719, 19.6477, 2.13765 1, 21000, 2000, 68.052, 81.9658, 72.7139, 1.15521 1, 21000, 3000, 120.347, 141.464, 127.438, 0.988719 1, 21000, 4000, 172.157, 198.089, 180.804, 0.929185 1, 21000, 5000, 221.524, 255.772, 234.04, 0.897284 1, 21000, 6000, 270.243, 309.209, 284.269, 0.886484 1, 21000, 7000, 316.219, 359.37, 330.711, 0.888995 1, 21000, 8000, 363.411, 408.698, 380.233, 0.883669 1, 21000, 9000, 410.529, 472.501, 432.834, 0.873313 1, 21000, 10000, 458.893, 515.31, 477.85, 0.878936 1, 21000, 11000, 506.596, 577.923, 532.975, 0.866832 1, 21000, 12000, 554.324, 621.253, 578.444, 0.871303 1, 21000, 13000, 604.658, 689.461, 633.186, 0.862306 1, 21000, 14000, 684.666, 772.068, 719.728, 0.816975 1, 21000, 15000, 728.211, 818.802, 765.019, 0.823509 1, 21000, 16000, 778.052, 906.776, 821.721, 0.817796 1, 21000, 17000, 868.072, 1040.82, 929.016, 0.768555 1, 21000, 18000, 932.506, 1102.57, 989.262, 0.764206 1, 21000, 19000, 1095.54, 1271.25, 1155.12, 0.690838 1, 21000, 20000, 1188.17, 1362.84, 1247.34, 0.673433 1, 21000, 21000, 1246.6, 1390.34, 1296.67, 0.680204 1, 21000, 22000, 1314.13, 1492.73, 1379.64, 0.66974 OOM mem_cost:1932260000B skipped OOM mem_cost:2016264000B skipped OOM mem_cost:2100268000B skipped OOM mem_cost:-2110695296B skipped OOM mem_cost:-2026691296B skipped OOM mem_cost:-1942687296B skipped OOM mem_cost:-1858683296B skipped OOM mem_cost:-1774679296B skipped 1, 22000, 1000, 29.0911, 35.0081, 31.1067, 1.41449 1, 22000, 2000, 83.2161, 96.4731, 87.6687, 1.00378 1, 22000, 3000, 140.122, 160.494, 146.92, 0.898447 1, 22000, 4000, 197.891, 223.388, 206.41, 0.852671 1, 22000, 5000, 253.782, 287.201, 264.967, 0.830293 1, 22000, 6000, 307.747, 341.287, 319.035, 0.827495 1, 22000, 7000, 362.778, 407.477, 379.696, 0.811176 1, 22000, 8000, 415.274, 458.956, 429.921, 0.818754 1, 22000, 9000, 478.833, 518.876, 493.308, 0.802744 1, 22000, 10000, 523.864, 579.293, 542.385, 0.811231 1, 22000, 11000, 581.093, 640.673, 604.228, 0.801022 1, 22000, 12000, 633.665, 698.11, 657.066, 0.803572 1, 22000, 13000, 691.915, 781.958, 722.282, 0.791934 1, 22000, 14000, 785.522, 884.263, 821.528, 0.749822 1, 22000, 15000, 812.243, 908.132, 848.654, 0.777702 1, 22000, 16000, 911.385, 1010.51, 946.233, 0.744003 1, 22000, 17000, 991.227, 1096.49, 1030.17, 0.726096 1, 22000, 18000, 1098.76, 1232.75, 1153.76, 0.686452 1, 22000, 19000, 1225.31, 1364.35, 1272.86, 0.656789 1, 22000, 20000, 1301.15, 1467.08, 1364.6, 0.644876 1, 22000, 21000, 1390.92, 1547.69, 1460.66, 0.632589 OOM mem_cost:1936264000B skipped OOM mem_cost:2024268000B skipped OOM mem_cost:2112272000B skipped OOM mem_cost:-2094691296B skipped OOM mem_cost:-2006687296B skipped OOM mem_cost:-1918683296B skipped OOM mem_cost:-1830679296B skipped OOM mem_cost:-1742675296B skipped OOM mem_cost:-1654671296B skipped 1, 23000, 1000, 19.1499, 25.7422, 21.3477, 2.1548 1, 23000, 2000, 74.5239, 90.3472, 79.8057, 1.1528 1, 23000, 3000, 131.862, 155.484, 139.758, 0.987418 1, 23000, 4000, 193.888, 218.311, 203.02, 0.906315 1, 23000, 5000, 243.425, 283.749, 257.056, 0.894748 1, 23000, 6000, 295.034, 333.848, 308.156, 0.895649 1, 23000, 7000, 347.956, 392.39, 364.884, 0.882471 1, 23000, 8000, 399.409, 459.604, 420.784, 0.874558 1, 23000, 9000, 451.504, 508.264, 470.623, 0.879685 1, 23000, 10000, 505.051, 577.19, 532.208, 0.864323 1, 23000, 11000, 569.892, 634.962, 591.638, 0.855253 1, 23000, 12000, 640.354, 732.978, 672.667, 0.820614 1, 23000, 13000, 783.867, 883.765, 820.191, 0.729099 1, 23000, 14000, 862.39, 964.273, 896.785, 0.718121 1, 23000, 15000, 928.139, 1040.17, 967.501, 0.713177 1, 23000, 16000, 996.112, 1125.48, 1042.27, 0.706154 1, 23000, 17000, 1060.12, 1198.61, 1107.7, 0.705965 1, 23000, 18000, 1098.61, 1242.72, 1152.77, 0.71827 1, 23000, 19000, 1179.55, 1371.06, 1243.58, 0.702812 1, 23000, 20000, 1255.38, 1443.71, 1327.22, 0.693177 OOM mem_cost:1932268000B skipped OOM mem_cost:2024272000B skipped OOM mem_cost:2116276000B skipped OOM mem_cost:-2086687296B skipped OOM mem_cost:-1994683296B skipped OOM mem_cost:-1902679296B skipped OOM mem_cost:-1810675296B skipped OOM mem_cost:-1718671296B skipped OOM mem_cost:-1626667296B skipped OOM mem_cost:-1534663296B skipped 1, 24000, 1000, 33.834, 39.7991, 35.8637, 1.3384 1, 24000, 2000, 89.7361, 101.514, 93.6951, 1.0246 1, 24000, 3000, 152.944, 170.189, 158.72, 0.907258 1, 24000, 4000, 218.983, 240.42, 226.153, 0.848983 1, 24000, 5000, 279.503, 310.415, 292.221, 0.821295 1, 24000, 6000, 339.169, 377.188, 352.901, 0.816092 1, 24000, 7000, 399.725, 433.673, 411.961, 0.815611 1, 24000, 8000, 463.383, 498.211, 476.079, 0.806588 1, 24000, 9000, 516.833, 561.647, 531.814, 0.812314 1, 24000, 10000, 578.201, 630.658, 598.126, 0.802507 1, 24000, 11000, 635.255, 690.382, 655.507, 0.805483 1, 24000, 12000, 694.162, 766.631, 718.427, 0.801751 1, 24000, 13000, 756.434, 848.238, 791.296, 0.788579 1, 24000, 14000, 849.736, 934.731, 884.631, 0.759638 1, 24000, 15000, 932.685, 1015.82, 961.917, 0.748506 1, 24000, 16000, 1009.55, 1100.11, 1040.84, 0.737867 1, 24000, 17000, 1096.64, 1214.82, 1148.11, 0.710732 1, 24000, 18000, 1250.51, 1389.32, 1299.29, 0.66498 1, 24000, 19000, 1388.42, 1540.46, 1442.23, 0.632354 OOM mem_cost:1920272000B skipped OOM mem_cost:2016276000B skipped OOM mem_cost:2112280000B skipped OOM mem_cost:-2086683296B skipped OOM mem_cost:-1990679296B skipped OOM mem_cost:-1894675296B skipped OOM mem_cost:-1798671296B skipped OOM mem_cost:-1702667296B skipped OOM mem_cost:-1606663296B skipped OOM mem_cost:-1510659296B skipped OOM mem_cost:-1414655296B skipped 1, 25000, 1000, 22.374, 30.1829, 25.012, 1.99904 1, 25000, 2000, 79.4919, 97.322, 85.4393, 1.17042 1, 25000, 3000, 145.27, 171.356, 153.991, 0.974085 1, 25000, 4000, 209.84, 240.564, 220.112, 0.908628 1, 25000, 5000, 269.359, 310.087, 286.535, 0.872494 1, 25000, 6000, 325.672, 374.4, 342.853, 0.875011 1, 25000, 7000, 383.257, 432.247, 399.759, 0.875527 1, 25000, 8000, 447.673, 496.584, 465.585, 0.859134 1, 25000, 9000, 498.165, 560.327, 519.941, 0.865483 1, 25000, 10000, 559.372, 628.259, 585.176, 0.854444 1, 25000, 11000, 614.213, 689.93, 641.677, 0.857129 1, 25000, 12000, 672.367, 770.561, 705.664, 0.850263 1, 25000, 13000, 736.378, 880.333, 789.116, 0.823707 1, 25000, 14000, 879.371, 1007.63, 930.542, 0.75225 1, 25000, 15000, 965.281, 1082.96, 1008.96, 0.743339 1, 25000, 16000, 1049.44, 1189.35, 1102.67, 0.725513 1, 25000, 17000, 1128.1, 1301.33, 1193.57, 0.712149 1, 25000, 18000, 1265.76, 1431.28, 1322.21, 0.680678 OOM mem_cost:1900276000B skipped OOM mem_cost:2000280000B skipped OOM mem_cost:2100284000B skipped OOM mem_cost:-2094679296B skipped OOM mem_cost:-1994675296B skipped OOM mem_cost:-1894671296B skipped OOM mem_cost:-1794667296B skipped OOM mem_cost:-1694663296B skipped OOM mem_cost:-1594659296B skipped OOM mem_cost:-1494655296B skipped OOM mem_cost:-1394651296B skipped OOM mem_cost:-1294647296B skipped 1, 26000, 1000, 35.063, 42.2979, 37.5206, 1.38591 1, 26000, 2000, 98.833, 115.913, 104.699, 0.993324 1, 26000, 3000, 169.342, 192.766, 177.15, 0.88061 1, 26000, 4000, 239.997, 272.812, 250.959, 0.828822 1, 26000, 5000, 305.747, 339.507, 317.03, 0.820113 1, 26000, 6000, 372.661, 420.874, 390.983, 0.797988 1, 26000, 7000, 435.26, 482.008, 450.954, 0.807178 1, 26000, 8000, 506.279, 555.899, 525.19, 0.792095 1, 26000, 9000, 578.463, 623.763, 594.031, 0.787838 1, 26000, 10000, 631.8, 708.207, 659.563, 0.788401 1, 26000, 11000, 705.53, 771.76, 728.537, 0.785135 1, 26000, 12000, 764.652, 843.35, 793.549, 0.786341 1, 26000, 13000, 848.308, 960.162, 887.537, 0.761658 1, 26000, 14000, 951.142, 1093, 998.812, 0.728866 1, 26000, 15000, 1040.35, 1186.84, 1092.46, 0.713988 1, 26000, 16000, 1163.27, 1326.82, 1225.89, 0.678692 1, 26000, 17000, 1320.52, 1478.68, 1374.15, 0.643305 1, 26000, 18000, 1414.99, 1588.76, 1476.13, 0.634092 OOM mem_cost:1976284000B skipped OOM mem_cost:2080288000B skipped OOM mem_cost:-2110675296B skipped OOM mem_cost:-2006671296B skipped OOM mem_cost:-1902667296B skipped OOM mem_cost:-1798663296B skipped OOM mem_cost:-1694659296B skipped OOM mem_cost:-1590655296B skipped OOM mem_cost:-1486651296B skipped OOM mem_cost:-1382647296B skipped OOM mem_cost:-1278643296B skipped OOM mem_cost:-1174639296B skipped 1, 27000, 1000, 22.271, 30.311, 24.996, 2.16034 1, 27000, 2000, 88.6592, 109.051, 95.4977, 1.13092 1, 27000, 3000, 161.308, 188.503, 170.385, 0.950788 1, 27000, 4000, 229.946, 267.288, 242.41, 0.891054 1, 27000, 5000, 293.422, 332.124, 306.427, 0.881123 1, 27000, 6000, 358.266, 413.125, 378.973, 0.854941 1, 27000, 7000, 418.913, 471.839, 437.709, 0.863587 1, 27000, 8000, 491.044, 541.083, 509.107, 0.848544 1, 27000, 9000, 544.069, 611.182, 566.909, 0.857281 1, 27000, 10000, 610.693, 689.326, 638.596, 0.845605 1, 27000, 11000, 672.609, 755.054, 704.536, 0.843109 1, 27000, 12000, 734.99, 837.533, 769.184, 0.842451 1, 27000, 13000, 799.385, 930.196, 843.251, 0.832493 1, 27000, 14000, 859.89, 995.968, 907.077, 0.833446 1, 27000, 15000, 941.169, 1089.85, 992.382, 0.816218 1, 27000, 16000, 1064.48, 1253.2, 1129.27, 0.765098 1, 27000, 17000, 1220.17, 1417.54, 1289.18, 0.712082 OOM mem_cost:1944288000B skipped OOM mem_cost:2052292000B skipped OOM mem_cost:-2134671296B skipped OOM mem_cost:-2026667296B skipped OOM mem_cost:-1918663296B skipped OOM mem_cost:-1810659296B skipped OOM mem_cost:-1702655296B skipped OOM mem_cost:-1594651296B skipped OOM mem_cost:-1486647296B skipped OOM mem_cost:-1378643296B skipped OOM mem_cost:-1270639296B skipped OOM mem_cost:-1162635296B skipped OOM mem_cost:-1054631296B skipped 1, 28000, 1000, 38.3701, 46.1279, 40.9617, 1.36713 1, 28000, 2000, 105.647, 122.482, 111.268, 1.00658 1, 28000, 3000, 184.984, 207.254, 192.424, 0.873072 1, 28000, 4000, 261.009, 293.137, 271.722, 0.824373 1, 28000, 5000, 333.247, 365.709, 346.266, 0.808627 1, 28000, 6000, 405.931, 449.398, 420.443, 0.799156 1, 28000, 7000, 473.826, 518.683, 489.058, 0.801541 1, 28000, 8000, 545.031, 607.103, 566.799, 0.790404 1, 28000, 9000, 615.935, 671.733, 637.119, 0.791061 1, 28000, 10000, 685.083, 754.369, 708.375, 0.790541 1, 28000, 11000, 755.427, 839.99, 784.739, 0.784975 1, 28000, 12000, 826.9, 914.289, 859.253, 0.782075 1, 28000, 13000, 898.875, 990.806, 933.092, 0.780202 1, 28000, 14000, 971.559, 1077.64, 1011.29, 0.77525 1, 28000, 15000, 1045.88, 1175.46, 1096.25, 0.766251 1, 28000, 16000, 1231.27, 1384.42, 1288.59, 0.695332 OOM mem_cost:1904292000B skipped OOM mem_cost:2016296000B skipped OOM mem_cost:2128300000B skipped OOM mem_cost:-2054663296B skipped OOM mem_cost:-1942659296B skipped OOM mem_cost:-1830655296B skipped OOM mem_cost:-1718651296B skipped OOM mem_cost:-1606647296B skipped OOM mem_cost:-1494643296B skipped OOM mem_cost:-1382639296B skipped OOM mem_cost:-1270635296B skipped OOM mem_cost:-1158631296B skipped OOM mem_cost:-1046627296B skipped OOM mem_cost:-934623296B skipped 1, 29000, 1000, 24.8979, 33.561, 27.7987, 2.08643 1, 29000, 2000, 95.2781, 116.802, 102.846, 1.1279 1, 29000, 3000, 179.003, 208.122, 189.522, 0.918099 1, 29000, 4000, 248.748, 289.536, 262.353, 0.884304 1, 29000, 5000, 317.478, 367.619, 334.318, 0.867437 1, 29000, 6000, 393.223, 435.404, 409.114, 0.850619 1, 29000, 7000, 453.044, 513.758, 473.415, 0.857598 1, 29000, 8000, 524.17, 584.802, 547.774, 0.847065 1, 29000, 9000, 589.188, 661.071, 613.645, 0.850654 1, 29000, 10000, 659.165, 742.374, 689.809, 0.840812 1, 29000, 11000, 728.718, 818.474, 762.835, 0.836353 1, 29000, 12000, 794.778, 906.521, 834.063, 0.83447 1, 29000, 13000, 878.594, 1019.48, 926.818, 0.813536 1, 29000, 14000, 951.039, 1127.03, 1012.97, 0.8016 1, 29000, 15000, 1120.75, 1330.58, 1196.18, 0.727313 1, 29000, 16000, 1205.09, 1392.59, 1269.93, 0.730748 OOM mem_cost:1972300000B skipped OOM mem_cost:2088304000B skipped OOM mem_cost:-2090659296B skipped OOM mem_cost:-1974655296B skipped OOM mem_cost:-1858651296B skipped OOM mem_cost:-1742647296B skipped OOM mem_cost:-1626643296B skipped OOM mem_cost:-1510639296B skipped OOM mem_cost:-1394635296B skipped OOM mem_cost:-1278631296B skipped OOM mem_cost:-1162627296B skipped OOM mem_cost:-1046623296B skipped OOM mem_cost:-930619296B skipped OOM mem_cost:-814615296B skipped 1, 30000, 1000, 41.4109, 50.4041, 44.435, 1.35029 1, 30000, 2000, 112.605, 132.558, 119.264, 1.00617 1, 30000, 3000, 201.082, 227.751, 210.029, 0.857023 1, 30000, 4000, 288.241, 319.522, 299.777, 0.800595 1, 30000, 5000, 360.67, 404.065, 375.239, 0.79949 1, 30000, 6000, 437.451, 483.209, 452.951, 0.794787 1, 30000, 7000, 518.701, 577.798, 539.298, 0.77879 1, 30000, 8000, 589.716, 649.576, 612.728, 0.783382 1, 30000, 9000, 665.974, 740.897, 691.469, 0.780946 1, 30000, 10000, 744.114, 829.007, 774.807, 0.774386 1, 30000, 11000, 824.434, 916.79, 858.418, 0.768856 1, 30000, 12000, 904.38, 1000.61, 936.866, 0.768519 1, 30000, 13000, 986.702, 1109.27, 1028.67, 0.758259 1, 30000, 14000, 1107.32, 1250.91, 1163.21, 0.72214 1, 30000, 15000, 1260.76, 1435.08, 1321.83, 0.680876 OOM mem_cost:1920304000B skipped OOM mem_cost:2040308000B skipped OOM mem_cost:-2134655296B skipped OOM mem_cost:-2014651296B skipped OOM mem_cost:-1894647296B skipped OOM mem_cost:-1774643296B skipped OOM mem_cost:-1654639296B skipped OOM mem_cost:-1534635296B skipped OOM mem_cost:-1414631296B skipped OOM mem_cost:-1294627296B skipped OOM mem_cost:-1174623296B skipped OOM mem_cost:-1054619296B skipped OOM mem_cost:-934615296B skipped OOM mem_cost:-814611296B skipped OOM mem_cost:-694607296B skipped compare results...
旧版gemv_trans_mx1性能结果 m, n, k, time_min, time_max, time_avg, gflops 1, 1, 1000, 0.000976562, 0.0219727, 0.00830078, 0.240941 1, 1, 2000, 0.00292969, 0.00390625, 0.00333659, 1.19883 1, 1, 3000, 0.00390625, 0.00512695, 0.00463867, 1.29347 1, 1, 4000, 0.00292969, 0.00610352, 0.00398763, 2.0062 1, 1, 5000, 0.00390625, 0.00708008, 0.00537109, 1.86182 1, 1, 6000, 0.00585938, 0.0078125, 0.0065918, 1.82044 1, 1, 7000, 0.00488281, 0.00805664, 0.00602214, 2.32476 1, 1, 8000, 0.00708008, 0.0109863, 0.0086263, 1.85479 1, 1, 9000, 0.0078125, 0.012207, 0.00935872, 1.92334 1, 1, 10000, 0.0090332, 0.0109863, 0.00968424, 2.06521 1, 1, 11000, 0.0100098, 0.013916, 0.0113118, 1.94486 1, 1, 12000, 0.0100098, 0.0109863, 0.0106608, 2.25124 1, 1, 13000, 0.00805664, 0.0131836, 0.0100098, 2.59746 1, 1, 14000, 0.00805664, 0.0100098, 0.00870768, 3.21555 1, 1, 15000, 0.0129395, 0.0187988, 0.014974, 2.00348 1, 1, 16000, 0.013916, 0.0151367, 0.0143229, 2.23418 1, 1, 17000, 0.013916, 0.0219727, 0.0170085, 1.999 1, 1, 18000, 0.0148926, 0.0219727, 0.0176595, 2.03856 1, 1, 19000, 0.0109863, 0.0187988, 0.0139974, 2.71479 1, 1, 20000, 0.0168457, 0.0251465, 0.0196126, 2.0395 1, 1, 21000, 0.0180664, 0.0258789, 0.0206706, 2.03187 1, 1, 22000, 0.0187988, 0.0270996, 0.0216471, 2.0326 1, 1, 23000, 0.0129395, 0.0229492, 0.0166829, 2.75731 1, 1, 24000, 0.0200195, 0.0300293, 0.0233561, 2.05514 1, 1, 25000, 0.013916, 0.0241699, 0.0177409, 2.81835 1, 1, 26000, 0.0148926, 0.0258789, 0.0186361, 2.79029 1, 1, 27000, 0.0148926, 0.0270996, 0.0193685, 2.78803 1, 1, 28000, 0.0158691, 0.0270996, 0.019694, 2.8435 1, 1, 29000, 0.0168457, 0.166016, 0.0703125, 0.824889 1, 1, 30000, 0.0168457, 0.0290527, 0.0209961, 2.85767 1, 1000, 1000, 0.785889, 0.979004, 0.851318, 2.3493 1, 1000, 2000, 1.58276, 1.93701, 1.70361, 2.34795 1, 1000, 3000, 2.38599, 2.948, 2.5743, 2.33073 1, 1000, 4000, 3.19604, 3.9751, 3.49438, 2.28939 1, 1000, 5000, 4.229, 5.22803, 4.59733, 2.17518 1, 1000, 6000, 5.03589, 6.11401, 5.4467, 2.20317 1, 1000, 7000, 5.90283, 7.21313, 6.34863, 2.2052 1, 1000, 8000, 6.66016, 8.23291, 7.2207, 2.21585 1, 1000, 9000, 7.23999, 8.92603, 7.81299, 2.30386 1, 1000, 10000, 8.01709, 9.83911, 8.62467, 2.31893 1, 1000, 11000, 8.85303, 10.814, 9.51636, 2.31181 1, 1000, 12000, 9.62402, 11.751, 10.3377, 2.32159 1, 1000, 13000, 10.3918, 12.7942, 11.233, 2.31461 1, 1000, 14000, 11.2158, 13.6938, 12.0543, 2.32283 1, 1000, 15000, 12.0151, 14.7649, 12.9497, 2.31665 1, 1000, 16000, 12.842, 15.668, 13.8101, 2.31715 1, 1000, 17000, 13.6499, 16.686, 14.6733, 2.31713 1, 1000, 18000, 14.4001, 17.6519, 15.512, 2.32079 1, 1000, 19000, 16.208, 18.7842, 17.0867, 2.22396 1, 1000, 20000, 16.791, 20.0969, 17.9727, 2.2256 1, 1000, 21000, 16.894, 20.6292, 18.163, 2.31239 1, 1000, 22000, 17.6592, 21.5088, 18.955, 2.32129 1, 1000, 23000, 18.4209, 22.5071, 19.7996, 2.32327 1, 1000, 24000, 19.2068, 23.4761, 20.6313, 2.32656 1, 1000, 25000, 20, 24.3621, 21.455, 2.33046 1, 1000, 26000, 20.751, 25.408, 22.3116, 2.33063 1, 1000, 27000, 21.6101, 26.293, 23.1737, 2.33023 1, 1000, 28000, 22.3879, 27.3931, 24.057, 2.3278 1, 1000, 29000, 23.165, 28.272, 24.8767, 2.3315 1, 1000, 30000, 24.043, 29.3311, 25.8067, 2.32498 1, 2000, 1000, 1.08813, 1.45605, 1.2474, 3.20668 1, 2000, 2000, 2.177, 2.89893, 2.41895, 3.30723 1, 2000, 3000, 3.27197, 4.3689, 3.65967, 3.27899 1, 2000, 4000, 4.34888, 5.7749, 4.84432, 3.30284 1, 2000, 5000, 5.44995, 7.28687, 6.0743, 3.29256 1, 2000, 6000, 6.52393, 8.76099, 7.28296, 3.29536 1, 2000, 7000, 7.66016, 10.2051, 8.51733, 3.28741 1, 2000, 8000, 8.74902, 11.574, 9.698, 3.29965 1, 2000, 9000, 9.82886, 13.0498, 10.9072, 3.30056 1, 2000, 10000, 10.9658, 14.4841, 12.15, 3.29219 1, 2000, 11000, 12.041, 15.9441, 13.3573, 3.29407 1, 2000, 12000, 13.1082, 17.354, 14.5361, 3.30213 1, 2000, 13000, 14.1641, 18.8579, 15.7563, 3.30026 1, 2000, 14000, 15.2681, 20.252, 16.9569, 3.30248 1, 2000, 15000, 16.3831, 21.728, 18.1773, 3.30082 1, 2000, 16000, 17.437, 23.282, 19.417, 3.29608 1, 2000, 17000, 18.51, 24.7339, 20.6217, 3.2975 1, 2000, 18000, 19.679, 26.168, 21.8427, 3.2963 1, 2000, 19000, 20.759, 27.543, 23.0229, 3.30105 1, 2000, 20000, 21.873, 29.0198, 24.257, 3.29802 1, 2000, 21000, 22.978, 30.4189, 25.4817, 3.29648 1, 2000, 22000, 24.0439, 31.884, 26.7036, 3.29543 1, 2000, 23000, 25.1689, 33.3191, 27.889, 3.29879 1, 2000, 24000, 26.1841, 34.811, 29.0757, 3.30173 1, 2000, 25000, 27.3049, 36.2739, 30.322, 3.29793 1, 2000, 26000, 28.394, 37.6689, 31.4877, 3.30288 1, 2000, 27000, 29.521, 39.1401, 32.7487, 3.29784 1, 2000, 28000, 30.6001, 40.6748, 33.963, 3.29771 1, 2000, 29000, 31.6919, 42.0161, 35.1487, 3.30027 1, 2000, 30000, 32.8149, 43.689, 36.4407, 3.29302 1, 3000, 1000, 1.48486, 2.05396, 1.67529, 3.58146 1, 3000, 2000, 2.96802, 4.09912, 3.34538, 3.58704 1, 3000, 3000, 4.45117, 6.14795, 5.04004, 3.5714 1, 3000, 4000, 5.93506, 8.20093, 6.70435, 3.57977 1, 3000, 5000, 7.41504, 10.2119, 8.3623, 3.58753 1, 3000, 6000, 8.90283, 12.2688, 10.0446, 3.58402 1, 3000, 7000, 10.4639, 14.3359, 11.9583, 3.5122 1, 3000, 8000, 11.9749, 16.4451, 13.4714, 3.56312 1, 3000, 9000, 13.4541, 18.5188, 15.184, 3.55637 1, 3000, 10000, 14.9561, 20.4219, 16.8003, 3.57137 1, 3000, 11000, 16.418, 22.4341, 18.443, 3.57859 1, 3000, 12000, 18.0271, 24.885, 20.3707, 3.53449 1, 3000, 13000, 19.459, 26.5591, 21.8357, 3.57213 1, 3000, 14000, 21, 28.667, 23.5627, 3.56496 1, 3000, 15000, 22.436, 30.77, 25.2397, 3.56582 1, 3000, 16000, 23.8989, 32.7681, 26.887, 3.5705 1, 3000, 17000, 25.4141, 34.8811, 28.5994, 3.56651 1, 3000, 18000, 26.8821, 36.7209, 30.1853, 3.5779 1, 3000, 19000, 28.292, 38.749, 31.811, 3.58366 1, 3000, 20000, 29.792, 40.7578, 33.4683, 3.58549 1, 3000, 21000, 31.3049, 42.8059, 35.1633, 3.58328 1, 3000, 22000, 32.793, 44.835, 36.8104, 3.58594 1, 3000, 23000, 34.2788, 47.0291, 38.5557, 3.57924 1, 3000, 24000, 35.783, 48.937, 40.1681, 3.58494 1, 3000, 25000, 37.2891, 50.9011, 41.8441, 3.58474 1, 3000, 26000, 38.804, 52.9221, 43.5221, 3.58439 1, 3000, 27000, 40.2588, 55.0261, 45.1993, 3.58413 1, 3000, 28000, 41.7461, 57.0391, 46.8547, 3.58555 1, 3000, 29000, 43.2888, 59.123, 48.6196, 3.5788 1, 3000, 30000, 44.696, 61.196, 50.231, 3.58345 1, 4000, 1000, 1.78589, 2.40698, 1.99292, 4.01421 1, 4000, 2000, 3.57202, 4.8501, 4.02238, 3.97774 1, 4000, 3000, 5.36084, 7.15503, 5.97331, 4.01787 1, 4000, 4000, 7.18506, 9.59595, 7.99902, 4.00049 1, 4000, 5000, 8.97998, 12.001, 10.002, 3.99922 1, 4000, 6000, 10.7568, 14.4031, 11.982, 4.006 1, 4000, 7000, 12.5459, 16.783, 13.9867, 4.00382 1, 4000, 8000, 14.3721, 19.2178, 16.0003, 3.99992 1, 4000, 9000, 16.1201, 21.6211, 17.986, 4.00311 1, 4000, 10000, 17.98, 23.9871, 19.9877, 4.00246 1, 4000, 11000, 19.751, 26.4099, 21.9783, 4.00395 1, 4000, 12000, 21.5349, 28.7271, 23.9413, 4.0098 1, 4000, 13000, 23.3579, 31.166, 26.002, 3.9997 1, 4000, 14000, 25.114, 33.5562, 27.9383, 4.00883 1, 4000, 15000, 26.915, 35.9941, 29.955, 4.00601 1, 4000, 16000, 29.2969, 38.45, 33.097, 3.86742 1, 4000, 17000, 30.8511, 41.0369, 34.2503, 3.97077 1, 4000, 18000, 32.761, 43.729, 36.4604, 3.94949 1, 4000, 19000, 34.5239, 45.8591, 38.3077, 3.96787 1, 4000, 20000, 36.3818, 48.699, 40.4956, 3.95105 1, 4000, 21000, 38.1899, 50.7629, 42.423, 3.96011 1, 4000, 22000, 39.718, 53.6008, 44.4453, 3.95992 1, 4000, 23000, 41.3091, 55.2041, 45.9513, 4.00424 1, 4000, 24000, 43.0879, 57.5332, 47.9267, 4.00612 1, 4000, 25000, 44.896, 60.0188, 49.9453, 4.00438 1, 4000, 26000, 46.6919, 62.6011, 51.9997, 4.00003 1, 4000, 27000, 48.459, 64.917, 53.9483, 4.00383 1, 4000, 28000, 50.2949, 67.1631, 55.9183, 4.00584 1, 4000, 29000, 52.1021, 69.5662, 57.937, 4.00435 1, 4000, 30000, 53.9241, 72.3152, 60.1477, 3.99018 1, 5000, 1000, 2.677, 3.66699, 3.01066, 3.32153 1, 5000, 2000, 5.35522, 7.29077, 6.01432, 3.3254 1, 5000, 3000, 8.10889, 10.8679, 9.04061, 3.31836 1, 5000, 4000, 10.7471, 14.3738, 11.9653, 3.34299 1, 5000, 5000, 13.449, 18.0388, 14.9945, 3.33455 1, 5000, 6000, 16.0979, 21.6741, 17.9997, 3.33339 1, 5000, 7000, 18.8301, 25.252, 20.978, 3.33682 1, 5000, 8000, 21.5229, 28.7729, 23.9456, 3.3409 1, 5000, 9000, 24.229, 32.4629, 26.976, 3.3363 1, 5000, 10000, 26.886, 36.061, 29.9613, 3.33763 1, 5000, 11000, 29.593, 39.6438, 32.9447, 3.33893 1, 5000, 12000, 32.2661, 43.176, 35.9241, 3.34038 1, 5000, 13000, 34.929, 46.7922, 38.8883, 3.3429 1, 5000, 14000, 37.605, 50.46, 41.9126, 3.34028 1, 5000, 15000, 41.4109, 56.6401, 46.8917, 3.19886 1, 5000, 16000, 43.583, 58.2671, 48.513, 3.29808 1, 5000, 17000, 46.47, 62.1389, 51.6977, 3.28835 1, 5000, 18000, 49.167, 65.7449, 54.703, 3.2905 1, 5000, 19000, 51.543, 69.5762, 57.6913, 3.29339 1, 5000, 20000, 53.834, 72.0962, 59.9254, 3.33748 1, 5000, 21000, 56.5559, 75.73, 62.952, 3.33588 1, 5000, 22000, 59.1548, 79.3572, 65.9056, 3.33811 1, 5000, 23000, 61.856, 82.791, 68.8383, 3.34116 1, 5000, 24000, 64.5588, 86.6492, 71.9506, 3.33562 1, 5000, 25000, 67.312, 90.1851, 74.9384, 3.33607 1, 5000, 26000, 70.075, 93.8289, 77.995, 3.33355 1, 5000, 27000, 72.803, 97.5481, 81.075, 3.33025 1, 5000, 28000, 75.6072, 102.105, 84.5467, 3.31178 1, 5000, 29000, 78.46, 105.806, 87.604, 3.31035 1, 5000, 30000, 85.3188, 114.777, 95.5509, 3.13969 1, 6000, 1000, 3.30786, 4.49487, 3.74731, 3.20229 1, 6000, 2000, 6.53418, 8.95703, 7.3724, 3.25539 1, 6000, 3000, 9.87109, 13.3718, 11.048, 3.2585 1, 6000, 4000, 13.1162, 17.584, 14.6523, 3.27593 1, 6000, 5000, 16.438, 22.1641, 18.363, 3.26743 1, 6000, 6000, 19.7419, 26.3159, 21.9379, 3.28199 1, 6000, 7000, 22.9849, 30.708, 25.5656, 3.28567 1, 6000, 8000, 26.324, 35.041, 29.2427, 3.28287 1, 6000, 9000, 29.47, 39.45, 32.7996, 3.29272 1, 6000, 10000, 32.7578, 43.615, 36.3956, 3.2971 1, 6000, 11000, 35.9399, 47.9712, 39.9747, 3.30209 1, 6000, 12000, 39.3491, 52.5959, 43.7697, 3.28995 1, 6000, 13000, 42.4719, 56.748, 47.2651, 3.30054 1, 6000, 14000, 45.9221, 61.0139, 50.962, 3.29657 1, 6000, 15000, 49.054, 65.4072, 54.517, 3.30172 1, 6000, 16000, 52.4192, 69.791, 58.2357, 3.29695 1, 6000, 17000, 55.5449, 74.126, 61.7513, 3.30357 1, 6000, 18000, 58.947, 78.7041, 65.5653, 3.29442 1, 6000, 19000, 62.0901, 83.115, 69.1393, 3.29769 1, 6000, 20000, 65.498, 87.4019, 72.8354, 3.2951 1, 6000, 21000, 68.7251, 91.9619, 76.4757, 3.29517 1, 6000, 22000, 72.1912, 96.312, 81.318, 3.24651 1, 6000, 23000, 78.645, 104.06, 87.1393, 3.16734 1, 6000, 24000, 81.8, 109.533, 91.249, 3.1562 1, 6000, 25000, 82.9939, 113.238, 93.4367, 3.21073 1, 6000, 26000, 85.957, 114.856, 95.5913, 3.2639 1, 6000, 27000, 89.1531, 119.511, 99.3581, 3.26093 1, 6000, 28000, 92.7659, 123.657, 103.074, 3.25979 1, 6000, 29000, 96.2241, 129.25, 107.745, 3.22984 1, 6000, 30000, 100.165, 137.351, 113.08, 3.1836 1, 7000, 1000, 3.36597, 4.80103, 3.89331, 3.59591 1, 7000, 2000, 6.72705, 9.56006, 7.69767, 3.63746 1, 7000, 3000, 10.134, 14.207, 11.4977, 3.6529 1, 7000, 4000, 13.501, 18.7742, 15.2651, 3.66851 1, 7000, 5000, 16.9021, 23.6069, 19.15, 3.65536 1, 7000, 6000, 20.2961, 28.0981, 22.9041, 3.66747 1, 7000, 7000, 23.6899, 32.7351, 26.7083, 3.66927 1, 7000, 8000, 27.021, 37.5459, 30.558, 3.66516 1, 7000, 9000, 30.4561, 42.2009, 34.3726, 3.66571 1, 7000, 10000, 34.2158, 47.0991, 38.7597, 3.612 1, 7000, 11000, 37.749, 52.5801, 42.754, 3.602 1, 7000, 12000, 41.46, 56.9441, 46.761, 3.59274 1, 7000, 13000, 44.4468, 61.9958, 50.4229, 3.60947 1, 7000, 14000, 48.0991, 66.573, 54.2624, 3.61208 1, 7000, 15000, 50.7361, 70.9019, 57.5167, 3.65111 1, 7000, 16000, 54.092, 74.8389, 61.0387, 3.66981 1, 7000, 17000, 57.575, 79.856, 65.0196, 3.66043 1, 7000, 18000, 60.957, 84.564, 68.833, 3.66103 1, 7000, 19000, 64.3638, 89.075, 72.6089, 3.66346 1, 7000, 20000, 67.9092, 94.1318, 76.6593, 3.65252 1, 7000, 21000, 71.4031, 99.342, 80.7204, 3.6422 1, 7000, 22000, 75.071, 104.289, 84.813, 3.63152 1, 7000, 23000, 78.5071, 108.933, 88.6673, 3.63155 1, 7000, 24000, 81.9341, 113.678, 92.568, 3.62976 1, 7000, 25000, 90.5889, 120.982, 100.937, 3.46752 1, 7000, 26000, 93.2312, 128.248, 105.13, 3.46237 1, 7000, 27000, 94.322, 133.091, 107.765, 3.50764 1, 7000, 28000, 96.5752, 134.085, 109.644, 3.5752 1, 7000, 29000, 100.202, 139.071, 113.183, 3.5871 1, 7000, 30000, 103.856, 145.13, 117.683, 3.56892 1, 8000, 1000, 3.54712, 5.0061, 4.05404, 3.94668 1, 8000, 2000, 7.09399, 9.90015, 8.0437, 3.97827 1, 8000, 3000, 10.665, 14.6689, 12.015, 3.99501 1, 8000, 4000, 14.3059, 19.449, 16.0226, 3.99435 1, 8000, 5000, 17.8318, 24.3152, 19.9963, 4.00073 1, 8000, 6000, 21.3689, 29.125, 23.9716, 4.00474 1, 8000, 7000, 24.9409, 33.9871, 27.9867, 4.00191 1, 8000, 8000, 28.52, 38.4771, 31.9, 4.01254 1, 8000, 9000, 32.0559, 43.5032, 35.8853, 4.01278 1, 8000, 10000, 35.635, 48.1179, 39.806, 4.0195 1, 8000, 11000, 39.208, 53.032, 43.8177, 4.01664 1, 8000, 12000, 42.7771, 57.813, 47.8023, 4.01654 1, 8000, 13000, 46.3198, 62.7468, 51.8046, 4.01509 1, 8000, 14000, 52.6741, 69.4939, 58.3987, 3.8357 1, 8000, 15000, 55.1589, 74.821, 61.7417, 3.88716 1, 8000, 16000, 58.3799, 79.2141, 65.4294, 3.91262 1, 8000, 17000, 62.2969, 84.2341, 69.7703, 3.8985 1, 8000, 18000, 64.4871, 87.989, 72.3247, 3.98204 1, 8000, 19000, 68.45, 92.7681, 76.578, 3.96981 1, 8000, 20000, 71.946, 97.6548, 80.5183, 3.97425 1, 8000, 21000, 75.5339, 102.5, 84.5537, 3.97381 1, 8000, 22000, 79.5378, 108.714, 89.306, 3.9415 1, 8000, 23000, 83.282, 113.468, 93.397, 3.94017 1, 8000, 24000, 87.2698, 118.491, 97.6826, 3.9311 1, 8000, 25000, 90.9441, 123.318, 101.762, 3.93075 1, 8000, 26000, 97.7891, 128.235, 108.739, 3.82567 1, 8000, 27000, 102.156, 138.005, 114.16, 3.78416 1, 8000, 28000, 104.575, 142.041, 117.392, 3.81627 1, 8000, 29000, 106.41, 144.441, 119.111, 3.89554 1, 8000, 30000, 110.027, 146.088, 122.121, 3.93052 1, 9000, 1000, 4.81201, 6.84814, 5.53906, 3.24965 1, 9000, 2000, 9.65894, 13.396, 10.9116, 3.29923 1, 9000, 3000, 14.458, 19.73, 16.2283, 3.32753 1, 9000, 4000, 19.3472, 26.2642, 21.6547, 3.32491 1, 9000, 5000, 24.1401, 32.5271, 26.9604, 3.33823 1, 9000, 6000, 29.031, 39.1099, 32.395, 3.33385 1, 9000, 7000, 33.781, 45.665, 37.7624, 3.33666 1, 9000, 8000, 38.6521, 52.375, 43.2501, 3.32947 1, 9000, 9000, 43.4961, 58.376, 48.4653, 3.3426 1, 9000, 10000, 48.325, 65.0979, 53.9207, 3.33824 1, 9000, 11000, 53.105, 71.4341, 59.2367, 3.34253 1, 9000, 12000, 58.0129, 78.0618, 64.7069, 3.33813 1, 9000, 13000, 63.3918, 84.467, 70.665, 3.3114 1, 9000, 14000, 69.8191, 95.4031, 78.663, 3.20354 1, 9000, 15000, 73.844, 99.8379, 82.5369, 3.27126 1, 9000, 16000, 78.2559, 107.293, 88.2047, 3.26513 1, 9000, 17000, 82.7109, 111.635, 92.3537, 3.31335 1, 9000, 18000, 87.7671, 118.211, 97.9256, 3.30863 1, 9000, 19000, 92.8201, 124.75, 103.464, 3.3055 1, 9000, 20000, 97.844, 132.487, 109.418, 3.29013 1, 9000, 21000, 103.089, 139.16, 115.174, 3.28199 1, 9000, 22000, 108.126, 145.804, 120.707, 3.28068 1, 9000, 23000, 114.512, 152.545, 128.551, 3.22052 1, 9000, 24000, 122.116, 164.53, 136.634, 3.16173 1, 9000, 25000, 124.17, 169.459, 139.613, 3.22319 1, 9000, 26000, 128.685, 173.828, 143.799, 3.25454 1, 9000, 27000, 133.892, 186.328, 151.558, 3.20669 1, 9000, 28000, 142.174, 188.702, 158.075, 3.18837 1, 9000, 29000, 144.406, 195.28, 161.381, 3.23457 1, 9000, 30000, 154.376, 197.611, 168.811, 3.19884 1, 10000, 1000, 5.49512, 7.93994, 6.34733, 3.15093 1, 10000, 2000, 11.1101, 15.1609, 12.4873, 3.20325 1, 10000, 3000, 16.5139, 22.481, 18.5107, 3.24138 1, 10000, 4000, 22.2051, 29.9299, 24.7883, 3.22733 1, 10000, 5000, 27.6189, 37.2581, 30.8414, 3.2424 1, 10000, 6000, 33.2888, 44.645, 37.145, 3.23058 1, 10000, 7000, 38.5181, 51.686, 42.916, 3.26219 1, 10000, 8000, 44.176, 58.896, 49.0829, 3.25979 1, 10000, 9000, 49.802, 66.314, 55.3073, 3.25454 1, 10000, 10000, 55.3179, 73.6621, 61.437, 3.25537 1, 10000, 11000, 60.4641, 81.21, 67.398, 3.26419 1, 10000, 12000, 66.302, 88.3672, 73.6747, 3.25756 1, 10000, 13000, 71.509, 95.8101, 79.656, 3.26404 1, 10000, 14000, 77.6221, 103.607, 86.2974, 3.2446 1, 10000, 15000, 82.9338, 111.716, 92.5536, 3.24136 1, 10000, 16000, 88.95, 119.263, 99.106, 3.22887 1, 10000, 17000, 96.1609, 126.614, 107.006, 3.1774 1, 10000, 18000, 103.413, 138.33, 115.28, 3.12283 1, 10000, 19000, 106.754, 145.627, 119.956, 3.16782 1, 10000, 20000, 112.596, 150.436, 125.729, 3.18145 1, 10000, 21000, 117.42, 157.911, 130.931, 3.2078 1, 10000, 22000, 124.122, 166.79, 138.359, 3.18013 1, 10000, 23000, 129.307, 174.244, 144.39, 3.18582 1, 10000, 24000, 135.491, 187.198, 152.97, 3.13787 1, 10000, 25000, 145.259, 195.869, 162.4, 3.07881 1, 10000, 26000, 149.581, 205.029, 168.446, 3.08704 1, 10000, 27000, 153.606, 208.81, 172.024, 3.13909 1, 10000, 28000, 160.071, 216.839, 179.057, 3.1275 1, 10000, 29000, 165.636, 223.971, 185.157, 3.13247 1, 10000, 30000, 172.496, 233.135, 193.606, 3.09907 1, 11000, 1000, 5.29199, 7.98389, 6.21769, 3.53829 1, 11000, 2000, 10.6021, 15.2449, 12.1663, 3.61654 1, 11000, 3000, 15.926, 22.4941, 18.1584, 3.63469 1, 11000, 4000, 21.2249, 30.062, 24.1796, 3.63943 1, 11000, 5000, 26.5271, 37.3081, 30.1544, 3.64789 1, 11000, 6000, 31.9009, 44.748, 36.2, 3.64641 1, 11000, 7000, 37.4829, 52.45, 42.4806, 3.62518 1, 11000, 8000, 42.2939, 59.3821, 48.029, 3.66445 1, 11000, 9000, 47.5461, 66.3279, 53.8373, 3.67775 1, 11000, 10000, 52.8772, 73.9219, 59.899, 3.67285 1, 11000, 11000, 58.197, 81.0652, 65.8271, 3.6763 1, 11000, 12000, 63.4192, 88.469, 71.7977, 3.677 1, 11000, 13000, 68.95, 96.325, 78.083, 3.66277 1, 11000, 14000, 74.519, 104.383, 84.4833, 3.64569 1, 11000, 15000, 79.918, 111.724, 90.57, 3.64359 1, 11000, 16000, 85.458, 119.403, 96.8174, 3.63571 1, 11000, 17000, 91.0049, 128.256, 103.47, 3.61456 1, 11000, 18000, 100.583, 137.565, 113.263, 3.49628 1, 11000, 19000, 105.653, 148.63, 120.173, 3.47831 1, 11000, 20000, 108.24, 155.124, 124.276, 3.5405 1, 11000, 21000, 113.994, 160.062, 129.42, 3.56978 1, 11000, 22000, 119.487, 172.668, 137.38, 3.52307 1, 11000, 23000, 125.575, 177.946, 143.099, 3.53602 1, 11000, 24000, 131.508, 187.442, 150.22, 3.51485 1, 11000, 25000, 137.768, 195.504, 158.064, 3.4796 1, 11000, 26000, 146.671, 205.306, 166.222, 3.44117 1, 11000, 27000, 149.558, 211.812, 170.427, 3.48536 1, 11000, 28000, 155.08, 219.182, 176.721, 3.48572 1, 11000, 29000, 160.673, 226.228, 182.616, 3.49366 1, 11000, 30000, 166.834, 236.193, 189.99, 3.47387 1, 12000, 1000, 5.36011, 7.90405, 6.25203, 3.83875 1, 12000, 2000, 10.7571, 15.0869, 12.2053, 3.93271 1, 12000, 3000, 16.1082, 22.3999, 18.2217, 3.95134 1, 12000, 4000, 21.5781, 29.3408, 24.185, 3.96941 1, 12000, 5000, 27.1482, 37.2048, 30.508, 3.9334 1, 12000, 6000, 33.416, 44.6211, 37.454, 3.84471 1, 12000, 7000, 38.238, 52.0679, 42.857, 3.92001 1, 12000, 8000, 43.8711, 59.8291, 49.2034, 3.90217 1, 12000, 9000, 49.4509, 67.2891, 55.422, 3.89737 1, 12000, 10000, 53.8618, 74.5881, 60.8604, 3.94345 1, 12000, 11000, 59.1719, 80.8972, 66.4661, 3.97195 1, 12000, 12000, 64.7439, 88.5049, 72.747, 3.95893 1, 12000, 13000, 70.4441, 96.3269, 79.0896, 3.94489 1, 12000, 14000, 75.8909, 103.666, 85.1983, 3.94374 1, 12000, 15000, 81.6372, 112.398, 91.9157, 3.91663 1, 12000, 16000, 87.509, 119.904, 98.3287, 3.90527 1, 12000, 17000, 94.51, 130.913, 107.123, 3.80871 1, 12000, 18000, 98.311, 136.375, 111.207, 3.88465 1, 12000, 19000, 108.527, 148.606, 122.077, 3.73535 1, 12000, 20000, 113.746, 159.251, 129.091, 3.7183 1, 12000, 21000, 116.606, 162.786, 132.053, 3.81665 1, 12000, 22000, 122.38, 169.983, 138.367, 3.81593 1, 12000, 23000, 128.432, 177.612, 144.854, 3.81072 1, 12000, 24000, 134.392, 188.625, 152.576, 3.77518 1, 12000, 25000, 140.315, 194.93, 158.588, 3.7834 1, 12000, 26000, 149.354, 206.985, 168.681, 3.69929 1, 12000, 27000, 152.871, 212.574, 173.065, 3.74426 1, 12000, 28000, 158.574, 219.572, 178.921, 3.75585 1, 12000, 29000, 163.914, 228.259, 185.384, 3.75438 1, 12000, 30000, 169.974, 236.121, 192.079, 3.74845 1, 13000, 1000, 7.01709, 10.2729, 8.13338, 3.1967 1, 13000, 2000, 14.0591, 19.53, 15.906, 3.26921 1, 13000, 3000, 21.126, 28.886, 23.7266, 3.28744 1, 13000, 4000, 28.1951, 38.3301, 31.5787, 3.29336 1, 13000, 5000, 35.272, 47.718, 39.671, 3.27695 1, 13000, 6000, 43.012, 58.4019, 48.2666, 3.23205 1, 13000, 7000, 50.2061, 67.887, 56.1104, 3.24361 1, 13000, 8000, 57.429, 77.3491, 64.0837, 3.24576 1, 13000, 9000, 65.0852, 87.6951, 72.9247, 3.20879 1, 13000, 10000, 70.6021, 95.5098, 78.936, 3.29381 1, 13000, 11000, 77.9519, 105.212, 87.0476, 3.28556 1, 13000, 12000, 85.2468, 115.542, 95.3906, 3.27076 1, 13000, 13000, 92.739, 125.343, 103.629, 3.26164 1, 13000, 14000, 99.895, 135.898, 111.957, 3.25124 1, 13000, 15000, 107.531, 146.608, 120.811, 3.22819 1, 13000, 16000, 115.049, 155.973, 128.712, 3.23203 1, 13000, 17000, 127.121, 168.988, 141.2, 3.13032 1, 13000, 18000, 132.921, 180.709, 149.139, 3.13802 1, 13000, 19000, 136.76, 193.398, 155.961, 3.16746 1, 13000, 20000, 145.331, 199.553, 163.552, 3.17941 1, 13000, 21000, 152.961, 209.506, 171.948, 3.17538 1, 13000, 22000, 161.185, 222.598, 181.678, 3.14843 1, 13000, 23000, 172.528, 233.444, 193.071, 3.09731 1, 13000, 24000, 177.923, 245.579, 200.892, 3.10615 1, 13000, 25000, 184.269, 253.514, 207.424, 3.13368 1, 13000, 26000, 191.912, 264.537, 216.255, 3.12593 1, 13000, 27000, 199.594, 273.061, 224.133, 3.13206 1, 13000, 28000, 210.423, 286.524, 235.934, 3.08561 1, 13000, 29000, 214.946, 295.301, 241.779, 3.11855 1, 13000, 30000, 222.521, 304.642, 249.997, 3.12004 1, 14000, 1000, 10.646, 13.6819, 11.6657, 2.4002 1, 14000, 2000, 21.1951, 26.8052, 23.089, 2.42539 1, 14000, 3000, 31.7649, 39.74, 34.4649, 2.43726 1, 14000, 4000, 42.4109, 52.4521, 45.7734, 2.44684 1, 14000, 5000, 53.0269, 65.7729, 57.276, 2.44431 1, 14000, 6000, 63.604, 78.491, 68.5723, 2.44997 1, 14000, 7000, 75.6641, 91.7429, 81.026, 2.41898 1, 14000, 8000, 86.822, 109.022, 94.4377, 2.37194 1, 14000, 9000, 97.532, 120.408, 105.215, 2.39509 1, 14000, 10000, 106.422, 131.847, 114.918, 2.43651 1, 14000, 11000, 117.198, 145.443, 126.655, 2.4318 1, 14000, 12000, 128.054, 158.362, 138.167, 2.43184 1, 14000, 13000, 139.12, 172.861, 150.41, 2.42005 1, 14000, 14000, 149.921, 186.241, 162.126, 2.41787 1, 14000, 15000, 165.101, 200.54, 177.351, 2.36819 1, 14000, 16000, 174.463, 218.943, 189.774, 2.3607 1, 14000, 17000, 183.077, 233.794, 200.181, 2.37785 1, 14000, 18000, 194.555, 244.52, 211.274, 2.38552 1, 14000, 19000, 205.774, 257.935, 223.203, 2.38348 1, 14000, 20000, 222.349, 272.888, 239.268, 2.34047 1, 14000, 21000, 228.042, 289.798, 249.11, 2.3604 1, 14000, 22000, 240.099, 302.22, 260.822, 2.36176 1, 14000, 23000, 251.164, 316.545, 273.025, 2.35876 1, 14000, 24000, 265.915, 331.861, 288.172, 2.33194 1, 14000, 25000, 273.569, 342.763, 296.657, 2.35963 1, 14000, 26000, 284.988, 358.174, 309.444, 2.3526 1, 14000, 27000, 299.63, 373.511, 324.348, 2.33083 1, 14000, 28000, 307.341, 386.194, 333.769, 2.34893 1, 14000, 29000, 318.136, 398.471, 345.159, 2.35254 1, 14000, 30000, 332.988, 412.578, 359.697, 2.3353 1, 15000, 1000, 7.25684, 11.124, 8.56901, 3.50099 1, 15000, 2000, 14.5132, 21.0151, 16.7021, 3.59237 1, 15000, 3000, 21.7959, 31.0042, 24.892, 3.61562 1, 15000, 4000, 29.0662, 40.8711, 33.0227, 3.63386 1, 15000, 5000, 36.3132, 50.886, 41.2027, 3.64054 1, 15000, 6000, 43.6201, 61.0759, 49.4553, 3.63965 1, 15000, 7000, 50.949, 71.094, 57.6803, 3.64076 1, 15000, 8000, 58.21, 81.0901, 65.85, 3.64465 1, 15000, 9000, 65.623, 91.6899, 74.3394, 3.63199 1, 15000, 10000, 73.3411, 102.895, 83.2257, 3.60466 1, 15000, 11000, 80.844, 115.506, 92.5037, 3.56743 1, 15000, 12000, 88.749, 124.176, 100.558, 3.58001 1, 15000, 13000, 96.5291, 135.792, 109.696, 3.55529 1, 15000, 14000, 108.01, 149.708, 122.452, 3.42992 1, 15000, 15000, 116.015, 163.783, 132.016, 3.40867 1, 15000, 16000, 119.981, 176.299, 138.928, 3.45504 1, 15000, 17000, 128.018, 182.549, 146.295, 3.48611 1, 15000, 18000, 136.294, 194.879, 155.831, 3.4653 1, 15000, 19000, 144.173, 207.99, 165.707, 3.43981 1, 15000, 20000, 152.792, 218.221, 174.973, 3.42911 1, 15000, 21000, 164.644, 233.604, 187.643, 3.35743 1, 15000, 22000, 167.785, 242.417, 192.914, 3.42122 1, 15000, 23000, 176.826, 251.531, 201.83, 3.41872 1, 15000, 24000, 185.166, 262.957, 211.102, 3.41067 1, 15000, 25000, 193.271, 273.74, 220.513, 3.40116 1, 15000, 26000, 203.344, 288.231, 231.815, 3.36475 1, 15000, 27000, 208.936, 297.589, 238.505, 3.39615 1, 15000, 28000, 216.943, 309.521, 247.824, 3.38951 1, 15000, 29000, 224.907, 320.749, 257.03, 3.38482 1, 15000, 30000, 234.895, 332.737, 267.616, 3.36303 1, 16000, 1000, 8.25293, 11.738, 9.44238, 3.38898 1, 16000, 2000, 16.6089, 22.72, 18.65, 3.43164 1, 16000, 3000, 24.7988, 33.7661, 27.7987, 3.4534 1, 16000, 4000, 33.106, 44.7932, 37.066, 3.4533 1, 16000, 5000, 41.259, 55.895, 46.2083, 3.46258 1, 16000, 6000, 49.842, 66.9702, 55.568, 3.45522 1, 16000, 7000, 57.7659, 78.0581, 64.5964, 3.46769 1, 16000, 8000, 66.53, 89.304, 74.141, 3.45288 1, 16000, 9000, 74.6201, 100.764, 83.3766, 3.45421 1, 16000, 10000, 85.9419, 112.951, 95.3713, 3.35531 1, 16000, 11000, 91.7368, 124.012, 102.529, 3.43317 1, 16000, 12000, 100.643, 135.952, 112.995, 3.39839 1, 16000, 13000, 111.689, 150.994, 125.035, 3.32708 1, 16000, 14000, 119.864, 163.289, 134.6, 3.32838 1, 16000, 15000, 126.973, 177.486, 143.961, 3.33424 1, 16000, 16000, 135.582, 185.026, 152.117, 3.36584 1, 16000, 17000, 143.432, 196.881, 161.319, 3.37219 1, 16000, 18000, 153.356, 210.288, 172.384, 3.34138 1, 16000, 19000, 163.131, 221.554, 182.836, 3.32538 1, 16000, 20000, 172.73, 236.933, 194.372, 3.29266 1, 16000, 21000, 179.769, 245.081, 201.612, 3.33313 1, 16000, 22000, 188.686, 259.261, 212.342, 3.3154 1, 16000, 23000, 196.38, 270.942, 221.401, 3.32429 1, 16000, 24000, 208.252, 281.551, 232.693, 3.30048 1, 16000, 25000, 214.027, 293.931, 240.832, 3.32182 1, 16000, 26000, 223.943, 306.597, 251.508, 3.30805 1, 16000, 27000, 231.435, 318.35, 260.458, 3.31724 1, 16000, 28000, 243.287, 328.963, 271.887, 3.29549 1, 16000, 29000, 248.785, 341.701, 279.871, 3.31581 OOM mem_cost:1920248000B skipped 1, 17000, 1000, 9.45703, 13.2898, 10.7433, 3.16476 1, 17000, 2000, 18.9429, 25.738, 21.2103, 3.20599 1, 17000, 3000, 28.4058, 38.1001, 31.6486, 3.22289 1, 17000, 4000, 37.813, 50.718, 42.144, 3.22703 1, 17000, 5000, 47.3091, 63.1621, 52.606, 3.23157 1, 17000, 6000, 56.7468, 75.8152, 63.1177, 3.23206 1, 17000, 7000, 66.2991, 88.438, 73.691, 3.2297 1, 17000, 8000, 75.9099, 101.635, 84.5029, 3.21882 1, 17000, 9000, 85.6812, 114.973, 95.4556, 3.20568 1, 17000, 10000, 97.1199, 127.76, 108.01, 3.14787 1, 17000, 11000, 107.657, 145.398, 120.431, 3.10552 1, 17000, 12000, 116.159, 157.999, 130.41, 3.12859 1, 17000, 13000, 124.826, 168.369, 139.413, 3.17043 1, 17000, 14000, 135.032, 185.56, 151.938, 3.13285 1, 17000, 15000, 144.769, 197.395, 162.391, 3.14057 1, 17000, 16000, 154.86, 209.768, 173.181, 3.14123 1, 17000, 17000, 168.395, 225.941, 187.584, 3.08128 1, 17000, 18000, 176.181, 241.666, 198.428, 3.08425 1, 17000, 19000, 186.306, 251.047, 208.363, 3.10036 1, 17000, 20000, 194.888, 264.354, 218.203, 3.11637 1, 17000, 21000, 205.214, 277.808, 229.458, 3.11168 1, 17000, 22000, 217.174, 294.979, 243.198, 3.07569 1, 17000, 23000, 224.988, 307.031, 252.342, 3.09897 1, 17000, 24000, 235.043, 320.62, 263.667, 3.09482 1, 17000, 25000, 245.109, 330.86, 273.86, 3.10378 1, 17000, 26000, 255.747, 347.235, 286.583, 3.08462 1, 17000, 27000, 265.027, 357.573, 295.947, 3.10191 OOM mem_cost:1904248000B skipped OOM mem_cost:1972252000B skipped OOM mem_cost:2040256000B skipped 1, 18000, 1000, 10.1602, 14.5532, 11.6361, 3.09383 1, 18000, 2000, 20.2969, 27.6282, 22.7644, 3.16283 1, 18000, 3000, 30.4602, 40.9458, 33.9603, 3.18019 1, 18000, 4000, 40.6599, 54.375, 45.234, 3.18345 1, 18000, 5000, 50.6909, 67.4099, 56.2873, 3.19788 1, 18000, 6000, 60.8982, 80.8782, 67.5594, 3.19719 1, 18000, 7000, 71.0869, 94.696, 79, 3.18987 1, 18000, 8000, 81.613, 108.476, 90.757, 3.17331 1, 18000, 9000, 95.2002, 127.174, 106.147, 3.05236 1, 18000, 10000, 104.865, 140.816, 117, 3.07691 1, 18000, 11000, 113.235, 152.371, 126.3, 3.13538 1, 18000, 12000, 123.72, 165.955, 137.836, 3.13415 1, 18000, 13000, 134.484, 181.334, 150.188, 3.11609 1, 18000, 14000, 145.597, 202.06, 164.555, 3.06281 1, 18000, 15000, 156.046, 214.113, 175.518, 3.07661 1, 18000, 16000, 170.855, 233.677, 192.042, 2.99935 1, 18000, 17000, 178.281, 246.958, 201.476, 3.03758 1, 18000, 18000, 189.095, 259.836, 212.858, 3.04428 1, 18000, 19000, 199.979, 274.936, 225.184, 3.03751 1, 18000, 20000, 211.377, 287.936, 237.752, 3.02837 1, 18000, 21000, 222.744, 308.092, 251.66, 3.00405 1, 18000, 22000, 232.769, 316.564, 260.772, 3.03714 1, 18000, 23000, 244.237, 329.932, 272.827, 3.03489 1, 18000, 24000, 256.211, 347.483, 287.14, 3.00898 1, 18000, 25000, 265.186, 363.297, 298.135, 3.01877 1, 18000, 26000, 276.005, 374.887, 309.019, 3.02894 OOM mem_cost:1944252000B skipped OOM mem_cost:2016256000B skipped OOM mem_cost:2088260000B skipped OOM mem_cost:-2134703296B skipped 1, 19000, 1000, 9.38599, 13.8469, 10.902, 3.48559 1, 19000, 2000, 18.6699, 27.584, 21.643, 3.51153 1, 19000, 3000, 27.958, 39.377, 31.7866, 3.58641 1, 19000, 4000, 37.3301, 52.4521, 42.3734, 3.58716 1, 19000, 5000, 46.7249, 64.8831, 52.864, 3.59413 1, 19000, 6000, 56.1692, 78.1809, 63.5207, 3.58938 1, 19000, 7000, 67.2549, 91.9312, 75.504, 3.52299 1, 19000, 8000, 77.823, 108.839, 88.4849, 3.43561 1, 19000, 9000, 86.907, 121.615, 98.4924, 3.47235 1, 19000, 10000, 94.7849, 133.454, 107.715, 3.52783 1, 19000, 11000, 104.439, 146.619, 118.585, 3.52491 1, 19000, 12000, 114.459, 161.346, 130.093, 3.50519 1, 19000, 13000, 125.258, 181.683, 144.16, 3.42676 1, 19000, 14000, 134.576, 194.624, 154.79, 3.43692 1, 19000, 15000, 145.704, 207.871, 167.12, 3.41073 1, 19000, 16000, 157.42, 224.783, 180.126, 3.37541 1, 19000, 17000, 165.255, 236.57, 189.209, 3.41422 1, 19000, 18000, 175.316, 251.792, 200.939, 3.40401 1, 19000, 19000, 185.067, 264.558, 211.684, 3.41075 1, 19000, 20000, 194.847, 278.634, 223.958, 3.39349 1, 19000, 21000, 206.702, 294.848, 236.628, 3.37238 1, 19000, 22000, 215.515, 305.857, 245.674, 3.40289 1, 19000, 23000, 224.46, 322.755, 257.373, 3.39585 1, 19000, 24000, 235.712, 336.923, 270.063, 3.37699 OOM mem_cost:1900252000B skipped OOM mem_cost:1976256000B skipped OOM mem_cost:2052260000B skipped OOM mem_cost:2128264000B skipped OOM mem_cost:-2090699296B skipped OOM mem_cost:-2014695296B skipped 1, 20000, 1000, 10.6731, 15.2419, 12.247, 3.26611 1, 20000, 2000, 21.001, 29.1619, 23.7343, 3.37065 1, 20000, 3000, 31.801, 42.8948, 35.518, 3.37857 1, 20000, 4000, 42.0779, 56.812, 47.025, 3.40245 1, 20000, 5000, 52.4609, 71.2539, 58.819, 3.40026 1, 20000, 6000, 62.728, 84.5151, 70.0073, 3.42821 1, 20000, 7000, 73.2131, 98.4861, 81.6517, 3.4292 1, 20000, 8000, 84.2998, 113.324, 93.9856, 3.40478 1, 20000, 9000, 95.0701, 128.143, 106.13, 3.39208 1, 20000, 10000, 105.893, 143.145, 118.391, 3.37863 1, 20000, 11000, 117.029, 158.466, 130.865, 3.36224 1, 20000, 12000, 128.38, 181.774, 146.256, 3.28192 1, 20000, 13000, 143.054, 197.225, 161.203, 3.22574 1, 20000, 14000, 151.377, 211.545, 171.74, 3.26075 1, 20000, 15000, 161.519, 226.11, 183.139, 3.2762 1, 20000, 16000, 170.978, 239.406, 193.9, 3.30067 1, 20000, 17000, 183.812, 254.896, 207.824, 3.272 1, 20000, 18000, 197.892, 270.56, 222.301, 3.23885 1, 20000, 19000, 206.605, 288.294, 234.106, 3.24639 1, 20000, 20000, 215.257, 301.163, 243.934, 3.27958 1, 20000, 21000, 229.277, 313.961, 257.578, 3.26115 1, 20000, 22000, 240.384, 330.125, 270.37, 3.2548 1, 20000, 23000, 251.102, 349.544, 284.171, 3.23748 OOM mem_cost:1920256000B skipped OOM mem_cost:2000260000B skipped OOM mem_cost:2080264000B skipped OOM mem_cost:-2134699296B skipped OOM mem_cost:-2054695296B skipped OOM mem_cost:-1974691296B skipped OOM mem_cost:-1894687296B skipped 1, 21000, 1000, 18.6392, 23.5979, 20.311, 2.06785 1, 21000, 2000, 37.311, 45.6951, 40.1344, 2.09297 1, 21000, 3000, 56.0149, 67.9841, 60.029, 2.09899 1, 21000, 4000, 74.7549, 90.4939, 80.0086, 2.09977 1, 21000, 5000, 93.4651, 112.476, 99.8974, 2.10216 1, 21000, 6000, 112.407, 136.42, 120.536, 2.09067 1, 21000, 7000, 131.19, 158.375, 140.294, 2.0956 1, 21000, 8000, 153.666, 185.768, 164.386, 2.04396 1, 21000, 9000, 169.823, 210.182, 183.662, 2.05813 1, 21000, 10000, 188.745, 229.336, 202.292, 2.0762 1, 21000, 11000, 207.693, 253.567, 223.036, 2.07141 1, 21000, 12000, 227.854, 283.165, 246.456, 2.04499 1, 21000, 13000, 249.46, 307.905, 269.398, 2.02674 1, 21000, 14000, 266.521, 330.45, 287.944, 2.04206 1, 21000, 15000, 285.868, 350.018, 307.265, 2.05035 1, 21000, 16000, 308.565, 377.843, 331.674, 2.02608 1, 21000, 17000, 324.584, 401.935, 350.58, 2.03663 1, 21000, 18000, 343.938, 425.046, 371.022, 2.03762 1, 21000, 19000, 365.063, 451.523, 394.593, 2.02234 1, 21000, 20000, 382.854, 473.31, 413.197, 2.03293 1, 21000, 21000, 403.726, 496.76, 435.239, 2.02647 1, 21000, 22000, 421.393, 519.338, 454.195, 2.03437 OOM mem_cost:1932260000B skipped OOM mem_cost:2016264000B skipped OOM mem_cost:2100268000B skipped OOM mem_cost:-2110695296B skipped OOM mem_cost:-2026691296B skipped OOM mem_cost:-1942687296B skipped OOM mem_cost:-1858683296B skipped OOM mem_cost:-1774679296B skipped 1, 22000, 1000, 11.6169, 16.7471, 13.34, 3.29835 1, 22000, 2000, 23.269, 32.3372, 26.297, 3.34638 1, 22000, 3000, 34.8608, 47.7681, 39.198, 3.36752 1, 22000, 4000, 46.449, 63.7542, 52.246, 3.36868 1, 22000, 5000, 58.1091, 79.0049, 65.204, 3.37403 1, 22000, 6000, 69.895, 95.1809, 78.3547, 3.3693 1, 22000, 7000, 82.1531, 111.402, 92.423, 3.3325 1, 22000, 8000, 97.627, 134.997, 110.343, 3.19005 1, 22000, 9000, 108.503, 149.915, 122.4, 3.23528 1, 22000, 10000, 118.477, 162.691, 133.267, 3.30165 1, 22000, 11000, 131.765, 187.168, 150.623, 3.21333 1, 22000, 12000, 143.96, 200.178, 162.824, 3.24277 1, 22000, 13000, 155.928, 216.992, 176.355, 3.24345 1, 22000, 14000, 169.669, 232.844, 191.425, 3.21797 1, 22000, 15000, 183.022, 256.993, 208.072, 3.17198 1, 22000, 16000, 193.179, 270.628, 219.082, 3.21341 1, 22000, 17000, 205.493, 287.985, 233.209, 3.20742 1, 22000, 18000, 218.339, 305.225, 247.446, 3.2007 1, 22000, 19000, 234.73, 325.152, 264.956, 3.15524 1, 22000, 20000, 242.681, 338.395, 274.69, 3.20361 1, 22000, 21000, 255.173, 356.546, 289.003, 3.1972 OOM mem_cost:1936264000B skipped OOM mem_cost:2024268000B skipped OOM mem_cost:2112272000B skipped OOM mem_cost:-2094691296B skipped OOM mem_cost:-2006687296B skipped OOM mem_cost:-1918683296B skipped OOM mem_cost:-1830679296B skipped OOM mem_cost:-1742675296B skipped OOM mem_cost:-1654671296B skipped 1, 23000, 1000, 13.042, 18.8579, 14.991, 3.06851 1, 23000, 2000, 26.052, 35.6941, 29.2797, 3.14211 1, 23000, 3000, 39.0332, 52.9358, 43.691, 3.15855 1, 23000, 4000, 52.1099, 69.5359, 57.9283, 3.17634 1, 23000, 5000, 65.9709, 87.2771, 73.3516, 3.13558 1, 23000, 6000, 80.2209, 108.286, 89.6293, 3.07935 1, 23000, 7000, 93.748, 130.913, 106.341, 3.02799 1, 23000, 8000, 105.034, 142.521, 117.657, 3.12773 1, 23000, 9000, 118.846, 160.708, 132.823, 3.11693 1, 23000, 10000, 133.631, 181.341, 150.032, 3.06601 1, 23000, 11000, 145.981, 207.991, 167.041, 3.02919 1, 23000, 12000, 160.545, 221.735, 181.129, 3.04756 1, 23000, 13000, 178.469, 246.027, 201.049, 2.9744 1, 23000, 14000, 189.008, 265.501, 214.774, 2.9985 1, 23000, 15000, 203.389, 280.224, 229.362, 3.00835 1, 23000, 16000, 216.389, 303.031, 245.405, 2.99912 1, 23000, 17000, 233.111, 319.77, 262.241, 2.98199 1, 23000, 18000, 244.314, 341.772, 277.008, 2.98908 1, 23000, 19000, 258.154, 356.847, 291.15, 3.00189 1, 23000, 20000, 271.776, 375.553, 306.423, 3.00238 OOM mem_cost:1932268000B skipped OOM mem_cost:2024272000B skipped OOM mem_cost:2116276000B skipped OOM mem_cost:-2086687296B skipped OOM mem_cost:-1994683296B skipped OOM mem_cost:-1902679296B skipped OOM mem_cost:-1810675296B skipped OOM mem_cost:-1718671296B skipped OOM mem_cost:-1626667296B skipped OOM mem_cost:-1534663296B skipped 1, 24000, 1000, 13.7109, 19.1289, 15.5413, 3.08855 1, 24000, 2000, 27.501, 37.095, 30.7043, 3.12659 1, 24000, 3000, 41.688, 55.728, 46.4647, 3.09913 1, 24000, 4000, 56.1948, 74.125, 62.3023, 3.08175 1, 24000, 5000, 69.259, 91.959, 76.85, 3.12297 1, 24000, 6000, 82.2229, 109.497, 91.3327, 3.15331 1, 24000, 7000, 96.3279, 128.416, 107.033, 3.13923 1, 24000, 8000, 110.482, 147.805, 122.964, 3.12287 1, 24000, 9000, 124.095, 166.738, 138.351, 3.1225 1, 24000, 10000, 138.478, 190.042, 155.885, 3.07919 1, 24000, 11000, 153.231, 207.531, 171.696, 3.0752 1, 24000, 12000, 170.084, 229.455, 190.008, 3.03146 1, 24000, 13000, 181.586, 246.918, 203.439, 3.06726 1, 24000, 14000, 196.417, 265.441, 219.426, 3.06253 1, 24000, 15000, 210.303, 283.475, 234.733, 3.06732 1, 24000, 16000, 226.049, 303.211, 252.094, 3.04648 1, 24000, 17000, 239.164, 325.602, 268.107, 3.04356 1, 24000, 18000, 253.479, 342.761, 283.278, 3.05001 1, 24000, 19000, 267.407, 362.356, 299.139, 3.04875 OOM mem_cost:1920272000B skipped OOM mem_cost:2016276000B skipped OOM mem_cost:2112280000B skipped OOM mem_cost:-2086683296B skipped OOM mem_cost:-1990679296B skipped OOM mem_cost:-1894675296B skipped OOM mem_cost:-1798671296B skipped OOM mem_cost:-1702667296B skipped OOM mem_cost:-1606663296B skipped OOM mem_cost:-1510659296B skipped OOM mem_cost:-1414655296B skipped 1, 25000, 1000, 12.5181, 18.2358, 14.4273, 3.46565 1, 25000, 2000, 25.165, 35.4041, 28.6127, 3.49495 1, 25000, 3000, 37.834, 52.6819, 42.7977, 3.50486 1, 25000, 4000, 50.6599, 70.437, 57.2523, 3.49331 1, 25000, 5000, 63.2939, 90.605, 72.5286, 3.44691 1, 25000, 6000, 75.6599, 106.463, 86.0703, 3.48552 1, 25000, 7000, 88.1821, 122.508, 99.7083, 3.51024 1, 25000, 8000, 100.959, 140.856, 114.327, 3.49875 1, 25000, 9000, 114.042, 158.913, 129.084, 3.48609 1, 25000, 10000, 127.319, 181.703, 145.508, 3.43625 1, 25000, 11000, 140.401, 197.817, 159.615, 3.44578 1, 25000, 12000, 155.571, 214.767, 175.499, 3.41883 1, 25000, 13000, 167.416, 238.864, 191.604, 3.39241 1, 25000, 14000, 179.635, 253.414, 204.364, 3.42527 1, 25000, 15000, 192.755, 272.036, 219.286, 3.42019 1, 25000, 16000, 206.101, 292.934, 235.057, 3.40342 1, 25000, 17000, 220.779, 309.531, 250.448, 3.39392 1, 25000, 18000, 232.438, 327.518, 264.232, 3.4061 OOM mem_cost:1900276000B skipped OOM mem_cost:2000280000B skipped OOM mem_cost:2100284000B skipped OOM mem_cost:-2094679296B skipped OOM mem_cost:-1994675296B skipped OOM mem_cost:-1894671296B skipped OOM mem_cost:-1794667296B skipped OOM mem_cost:-1694663296B skipped OOM mem_cost:-1594659296B skipped OOM mem_cost:-1494655296B skipped OOM mem_cost:-1394651296B skipped OOM mem_cost:-1294647296B skipped 1, 26000, 1000, 13.75, 20.0251, 15.86, 3.27868 1, 26000, 2000, 27.3879, 38.0889, 30.9786, 3.35716 1, 26000, 3000, 41.1909, 55.9302, 46.1084, 3.38333 1, 26000, 4000, 54.9482, 74.5828, 61.4956, 3.38236 1, 26000, 5000, 69.2859, 93.3359, 77.4033, 3.35903 1, 26000, 6000, 83.0872, 112.444, 92.947, 3.35675 1, 26000, 7000, 97.8779, 135.051, 110.411, 3.29676 1, 26000, 8000, 112.193, 152.384, 126.232, 3.29552 1, 26000, 9000, 129.928, 179.133, 146.51, 3.19431 1, 26000, 10000, 140.569, 201.649, 161.432, 3.22117 1, 26000, 11000, 155.705, 216.522, 176.011, 3.2498 1, 26000, 12000, 169.925, 240.288, 193.604, 3.22308 1, 26000, 13000, 185.502, 258.505, 210.025, 3.21867 1, 26000, 14000, 202.347, 280.304, 228.435, 3.1869 1, 26000, 15000, 213.803, 303.162, 243.723, 3.20035 1, 26000, 16000, 228.707, 320.282, 259.452, 3.20676 1, 26000, 17000, 244.474, 340.152, 276.423, 3.198 1, 26000, 18000, 259.886, 363.652, 294.599, 3.1772 OOM mem_cost:1976284000B skipped OOM mem_cost:2080288000B skipped OOM mem_cost:-2110675296B skipped OOM mem_cost:-2006671296B skipped OOM mem_cost:-1902667296B skipped OOM mem_cost:-1798663296B skipped OOM mem_cost:-1694659296B skipped OOM mem_cost:-1590655296B skipped OOM mem_cost:-1486651296B skipped OOM mem_cost:-1382647296B skipped OOM mem_cost:-1278643296B skipped OOM mem_cost:-1174639296B skipped 1, 27000, 1000, 15.3042, 21.8411, 17.509, 3.08412 1, 27000, 2000, 30.6868, 42.0059, 34.4753, 3.13268 1, 27000, 3000, 46.0159, 62.1741, 51.4163, 3.15075 1, 27000, 4000, 61.4131, 82.501, 68.455, 3.15536 1, 27000, 5000, 77.074, 103.071, 85.7483, 3.14875 1, 27000, 6000, 92.6829, 124.414, 103.334, 3.13547 1, 27000, 7000, 108.412, 145.659, 120.905, 3.12642 1, 27000, 8000, 124.518, 168.107, 139.08, 3.10613 1, 27000, 9000, 141.067, 197.381, 160.019, 3.03713 1, 27000, 10000, 160.642, 219.939, 180.437, 2.99274 1, 27000, 11000, 173.756, 241.004, 196.317, 3.02571 1, 27000, 12000, 189.634, 262.852, 214.193, 3.02531 1, 27000, 13000, 205.745, 283.149, 231.762, 3.02897 1, 27000, 14000, 223.871, 306.801, 251.94, 3.00071 1, 27000, 15000, 238.472, 331.268, 269.912, 3.00097 1, 27000, 16000, 253.863, 350.213, 286.521, 3.01549 1, 27000, 17000, 270.86, 369.98, 303.929, 3.02044 OOM mem_cost:1944288000B skipped OOM mem_cost:2052292000B skipped OOM mem_cost:-2134671296B skipped OOM mem_cost:-2026667296B skipped OOM mem_cost:-1918663296B skipped OOM mem_cost:-1810659296B skipped OOM mem_cost:-1702655296B skipped OOM mem_cost:-1594651296B skipped OOM mem_cost:-1486647296B skipped OOM mem_cost:-1378643296B skipped OOM mem_cost:-1270639296B skipped OOM mem_cost:-1162635296B skipped OOM mem_cost:-1054631296B skipped 1, 28000, 1000, 15.9888, 22.99, 18.338, 3.05377 1, 28000, 2000, 32.3362, 43.7888, 36.1966, 3.09421 1, 28000, 3000, 48.532, 65.4919, 54.1873, 3.10036 1, 28000, 4000, 65.405, 87.6741, 73.0574, 3.06608 1, 28000, 5000, 81.741, 110.8, 91.5047, 3.05995 1, 28000, 6000, 96.6479, 129.806, 107.747, 3.11841 1, 28000, 7000, 113.587, 153.009, 126.73, 3.09318 1, 28000, 8000, 130.361, 176.304, 145.693, 3.07495 1, 28000, 9000, 147.214, 206.544, 167.159, 3.01509 1, 28000, 10000, 164.244, 227.835, 185.719, 3.01531 1, 28000, 11000, 184.493, 253.665, 207.598, 2.96728 1, 28000, 12000, 198.737, 277.978, 225.351, 2.98202 1, 28000, 13000, 215.513, 297.995, 243.223, 2.99314 1, 28000, 14000, 232.939, 320.286, 262.055, 2.99173 1, 28000, 15000, 251.098, 344.914, 282.466, 2.97381 1, 28000, 16000, 266.288, 367.802, 300.162, 2.98505 OOM mem_cost:1904292000B skipped OOM mem_cost:2016296000B skipped OOM mem_cost:2128300000B skipped OOM mem_cost:-2054663296B skipped OOM mem_cost:-1942659296B skipped OOM mem_cost:-1830655296B skipped OOM mem_cost:-1718651296B skipped OOM mem_cost:-1606647296B skipped OOM mem_cost:-1494643296B skipped OOM mem_cost:-1382639296B skipped OOM mem_cost:-1270635296B skipped OOM mem_cost:-1158631296B skipped OOM mem_cost:-1046627296B skipped OOM mem_cost:-934623296B skipped 1, 29000, 1000, 12.6399, 19.4299, 14.9256, 3.88594 1, 29000, 2000, 25.1118, 37.0291, 29.0913, 3.98745 1, 29000, 3000, 39.2559, 54.7571, 44.78, 3.88566 1, 29000, 4000, 50.5159, 72.3071, 57.8167, 4.01268 1, 29000, 5000, 63.2451, 90.8579, 72.462, 4.0021 1, 29000, 6000, 76.23, 108.519, 87.0844, 3.99612 1, 29000, 7000, 89.615, 129.436, 102.896, 3.94572 1, 29000, 8000, 103.175, 149.447, 119.255, 3.89083 1, 29000, 9000, 118.636, 176.85, 138.223, 3.77651 1, 29000, 10000, 129.866, 195.811, 151.953, 3.81698 1, 29000, 11000, 143.256, 213.141, 166.731, 3.82653 1, 29000, 12000, 156.613, 233.622, 182.349, 3.81686 1, 29000, 13000, 164.143, 252.604, 193.633, 3.89397 1, 29000, 14000, 184.897, 272.476, 214.237, 3.7902 1, 29000, 15000, 197.273, 294.658, 229.741, 3.78687 1, 29000, 16000, 210.594, 310.237, 243.9, 3.80484 OOM mem_cost:1972300000B skipped OOM mem_cost:2088304000B skipped OOM mem_cost:-2090659296B skipped OOM mem_cost:-1974655296B skipped OOM mem_cost:-1858651296B skipped OOM mem_cost:-1742647296B skipped OOM mem_cost:-1626643296B skipped OOM mem_cost:-1510639296B skipped OOM mem_cost:-1394635296B skipped OOM mem_cost:-1278631296B skipped OOM mem_cost:-1162627296B skipped OOM mem_cost:-1046623296B skipped OOM mem_cost:-930619296B skipped OOM mem_cost:-814615296B skipped 1, 30000, 1000, 15.4431, 22.752, 17.8973, 3.35246 1, 30000, 2000, 31.021, 43.3789, 35.142, 3.41472 1, 30000, 3000, 46.384, 63.9932, 52.2864, 3.44258 1, 30000, 4000, 62.0078, 84.646, 69.5706, 3.44973 1, 30000, 5000, 77.937, 106.454, 87.4906, 3.42894 1, 30000, 6000, 93.3782, 128.509, 105.124, 3.42452 1, 30000, 7000, 112.132, 151.537, 125.774, 3.33933 1, 30000, 8000, 130.462, 185.1, 149.029, 3.22084 1, 30000, 9000, 143.299, 204.317, 163.847, 3.29575 1, 30000, 10000, 160.829, 226.949, 182.926, 3.28002 1, 30000, 11000, 177.491, 250.405, 201.884, 3.2692 1, 30000, 12000, 193.843, 272.193, 220.09, 3.27138 1, 30000, 13000, 213.07, 299.188, 241.809, 3.22569 1, 30000, 14000, 226.959, 316.733, 259.662, 3.23497 1, 30000, 15000, 243.724, 343.136, 276.963, 3.24953 OOM mem_cost:1920304000B skipped OOM mem_cost:2040308000B skipped OOM mem_cost:-2134655296B skipped OOM mem_cost:-2014651296B skipped OOM mem_cost:-1894647296B skipped OOM mem_cost:-1774643296B skipped OOM mem_cost:-1654639296B skipped OOM mem_cost:-1534635296B skipped OOM mem_cost:-1414631296B skipped OOM mem_cost:-1294627296B skipped OOM mem_cost:-1174623296B skipped OOM mem_cost:-1054619296B skipped OOM mem_cost:-934615296B skipped OOM mem_cost:-814611296B skipped OOM mem_cost:-694607296B skipped compare results...
ysh329 commented 5 years ago
/* Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License. */

#include <iostream>
#include "../test_helper.h"
#include "../test_include.h"
#include "operators/math/gemm.h"
#include "operators/math/math_function.h"

#define a(i, j) a[(i)*lda + (j)]
#define b(i, j) b[(i)*ldb + (j)]
#define c1(i, j) c1[(i)*ldc + (j)]

#define m 1024
#define n 1024
#define k 1024

int main() {
  paddle_mobile::PaddleMobile<paddle_mobile::CPU> paddle_mobile;
  paddle_mobile.SetThreadNum(4);
  Tensor aa, bb, cc;
  auto aaptr = aa.mutable_data<float>({m, k});
  auto bbptr = bb.mutable_data<float>({k, n});
  auto ccptr = cc.mutable_data<float>({m, n});

  for (int i = 0; i < m * k; ++i) {
    aaptr[i] = 2;
  }
  for (int i = 0; i < k * n; ++i) {
    bbptr[i] = 2;
  }
  for (int i = 0; i < m * n; ++i) {
    ccptr[i] = 2;
  }

  Tensor aa_int8, bb_int8, cc_int32, cc_int8;
  auto aaptr_int8 = aa_int8.mutable_data<int8_t>({m, k});
  auto bbptr_int8 = bb_int8.mutable_data<int8_t>({k, n});
  auto ccptr_int32 = cc_int32.mutable_data<int32_t>({m, n});
  auto ccptr_int8 = cc_int8.mutable_data<int8_t>({m, n});
  int32_t* bias_data_col = new int32_t[m];
  int32_t* bias_data_row = new int32_t[n];

  for (int i = 0; i < m * k; ++i) {
    aaptr_int8[i] = static_cast<int8_t>(2);
  }
  for (int i = 0; i < k * n; ++i) {
    bbptr_int8[i] = static_cast<int8_t>(2);
  }
  for (int i = 0; i < m * n; ++i) {
    ccptr_int32[i] = static_cast<int32_t>(2);
  }

  for (int i = 0; i < m; ++i) {
    bias_data_col[i] = 2;
  }

  for (int i = 0; i < n; ++i) {
    bias_data_row[i] = 2;
  }

  // float
  // warm-up 10 times
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<float, float>(
        aa, false, bb, false, static_cast<float>(1), &cc, static_cast<float>(0),
        false, nullptr);
  }

  auto time_start0 = time();
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<float, float>(
        aa, false, bb, false, static_cast<float>(1), &cc, static_cast<float>(0),
        false, nullptr);
  }
  auto time_end0 = time();
  std::cout << "float gemm  cost :" << time_diff(time_start0, time_end0) / 10
            << "ms\n";

  // int8_t without bias
  // warm-up 10 times
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<int8_t, int32_t>(
        aa_int8, false, bb_int8, false, static_cast<float>(1), &cc_int32,
        static_cast<float>(0));
  }

  auto time_start1 = time();
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<int8_t, int32_t>(
        aa_int8, false, bb_int8, false, static_cast<float>(1), &cc_int32,
        static_cast<float>(0));
  }
  auto time_end1 = time();
  std::cout << "int8_t gemm  cost :" << time_diff(time_start1, time_end1) / 10
            << "ms\n";

  // int8_t with bias, column element wise add
  // warm-up 10 times
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<int8_t, int32_t>(
        aa_int8, false, bb_int8, false, static_cast<float>(0.618), &cc_int8,
        static_cast<float>(0), false, bias_data_col, false);
  }
  auto time_start2 = time();
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<int8_t, int32_t>(
        aa_int8, false, bb_int8, false, static_cast<float>(0.618), &cc_int8,
        static_cast<float>(0), false, bias_data_col, false);
  }
  auto time_end2 = time();
  std::cout << "int8_t gemm_with_bias(column add) cost :"
            << time_diff(time_start2, time_end2) / 10 << "ms\n";

  // int8_t with bias, row element wise add
  // warm-up 10 times
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<int8_t, int32_t>(
        aa_int8, false, bb_int8, false, static_cast<float>(0.618), &cc_int8,
        static_cast<float>(0), false, bias_data_row, true);
  }
  auto time_start3 = time();
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<int8_t, int32_t>(
        aa_int8, false, bb_int8, false, static_cast<float>(0.618), &cc_int8,
        static_cast<float>(0), false, bias_data_row, true);
  }
  auto time_end3 = time();
  std::cout << "int8_t gemm_with_bias(row add) cost :"
            << time_diff(time_start3, time_end3) / 10 << "ms\n";

  // int8_t with bias&relu
  // warm-up 10 times
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<int8_t, int32_t>(
        aa_int8, false, bb_int8, false, static_cast<float>(0.618), &cc_int8,
        static_cast<float>(0), true, bias_data_col, false);
  }
  auto time_start4 = time();
  for (int j = 0; j < 10; ++j) {
    paddle_mobile::operators::math::MatMul<int8_t, int32_t>(
        aa_int8, false, bb_int8, false, static_cast<float>(0.618), &cc_int8,
        static_cast<float>(0), true, bias_data_col, false);
  }
  auto time_end4 = time();
  std::cout << "int8_t gemm_with_bias_relu cost :"
            << time_diff(time_start4, time_end4) / 10 << "ms\n";

  delete[] bias_data_row;
  delete[] bias_data_col;

  return 0;
}
ysh329 commented 5 years ago

Segmentation Fault与堆内存

m=1, n=1~60000, k=1~60000,其中mn以1000递增的gemv_trans_mx1时,当跑到m=1, n=8000, k=30000时出现Segmentation Fault卡主,CTRL+C中断程序后,立马logcat查询当前日志(根据这份adb logcat总结,发现两个常用命令:adb logcat -v timeadb logcat -c),在不打印的地方再次中断并用date打印当前时间以确认打印出的日志是否符合预期。

如下是出现捕捉到的Segmentation Fault后的日志信息,其中可以看到执行的程序名test-gemm-accuracy,再就是对应的Build fingerprint部分,有写道Cause: null pointer dereference,导致的原因是空指针,因为代码中没对malloc后的指针做判断,猜测原因是申请到的堆内存失败,返回了nullptr

11-04 17:28:42.889 27339 27339 F libc    : Fatal signal 11 (SIGSEGV), code 1, fault addr 0x0 in tid 27339 (test-gemm-accur)                                                                       
11-04 17:28:42.915 27342 27342 W crash_dump32: type=1400 audit(0.0:2846): avc: denied { search } for name="tmp" dev="sda17" ino=2097154 scontext=u:r:crash_dump:s0 tcontext=u:object_r:shell_data_file:s0 tc
lass=dir permissive=0                                                                                                                                                                                      
11-04 17:28:42.915 27342 27342 W crash_dump32: type=1400 audit(0.0:2847): avc: denied { search } for name="tmp" dev="sda17" ino=2097154 scontext=u:r:crash_dump:s0 tcontext=u:object_r:shell_data_file:s0 tc
lass=dir permissive=0                                                     
11-04 17:28:42.915 27342 27342 W crash_dump32: type=1400 audit(0.0:2848): avc: denied { search } for name="bin" dev="sda17" ino=2097510 scontext=u:r:crash_dump:s0 tcontext=u:object_r:shell_data_file:s0 tc
lass=dir permissive=0                                                                            
11-04 17:28:42.925 27342 27342 I crash_dump32: obtaining output fd from tombstoned               
11-04 17:28:42.925   959   959 I /system/bin/tombstoned: received crash request for pid 27339                                                                                                              
11-04 17:28:42.927 27342 27342 I crash_dump32: performing dump of process 27339 (target tid = 27339)
11-04 17:28:42.915 27342 27342 W crash_dump32: type=1400 audit(0.0:2849): avc: denied { search } for name="tmp" dev="sda17" ino=2097154 scontext=u:r:crash_dump:s0 tcontext=u:object_r:shell_data_file:s0 tc
lass=dir permissive=0                                                                                                                                                                                      
11-04 17:28:42.928 27342 27342 F DEBUG   : *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** ***
11-04 17:28:42.928 27342 27342 F DEBUG   : Build fingerprint: 'Xiaomi/chiron/chiron:8.0.0/OPR1.170623.027/V10.0.1.0.ODECNFH:user/release-keys'
11-04 17:28:42.928 27342 27342 F DEBUG   : Revision: '0'
11-04 17:28:42.928 27342 27342 F DEBUG   : ABI: 'arm'
11-04 17:28:42.928 27342 27342 F DEBUG   : pid: 27339, tid: 27339, name: test-gemm-accur  >>> ./test-gemm-accuracy <<<                                                                              
11-04 17:28:42.928 27342 27342 F DEBUG   : signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0x0
11-04 17:28:42.929 27342 27342 F DEBUG   : Cause: null pointer dereference
11-04 17:28:42.929 27342 27342 F DEBUG   :     r0 0000fa00  r1 00000000  r2 00000000  r3 00000004
11-04 17:28:42.929 27342 27342 F DEBUG   :     r4 ffafa010  r5 00003e80  r6 ef200040  r7 000493e0
11-04 17:28:42.929 27342 27342 F DEBUG   :     r8 00000000  r9 00000000  sl 000493dd  fp 00000001
11-04 17:28:42.929 27342 27342 F DEBUG   :     ip efa47440  sp ffaf9fc0  lr 00000000  pc ef66c152  cpsr 00010030
11-04 17:28:42.929 27342 27342 F DEBUG   :
11-04 17:28:42.929 27342 27342 F DEBUG   : backtrace:
11-04 17:28:42.929 27342 27342 F DEBUG   :     #00 pc 00226152  /data/local/tmp/bin/libpaddle-mobile.so
11-04 17:28:42.929 27342 27342 F DEBUG   :     #01 pc 002923df  /data/local/tmp/bin/libpaddle-mobile.so
11-04 17:28:42.937 27342 27342 E crash_dump32: cannot open libmiuindbg.so: No such file or directory
11-04 17:28:42.938  1557  2753 W NativeCrashListener: Couldn't find ProcessRecord for pid 27339
11-04 17:28:42.939   959   959 E /system/bin/tombstoned: Tombstone written to: /data/tombstones//tombstone_00
11-04 17:28:49.694 27344 27344 E QCALOG  : [mlid] Failed to load libminksocket

free -m(或free -g分别是以MB和GB为单位)终端里查询手机当前的内存情况。

chiron:/data/local/tmp/bin $ free -m
                total        used        free      shared     buffers
Mem:             5724        5023         700          15         236
-/+ buffers/cache:           4786         937
Swap:            2559          44        2515
chiron:/data/local/tmp/bin $ free -g
                total        used        free      shared     buffers
Mem:                5           5           0           0           0
-/+ buffers/cache:              4           0
Swap:               2           0           2

根据内存查看命令free解读

Segmentation Fault 时的矩阵、向量规模(每个float占32bit,每个字节是8bit,即4字节):