no data files - Githubissues

I used movielens-1m for testing, and did not achieve the effect in the paper, probably because my data preprocessing was not written correctly, I hope the author will disclose the preprocessing process of movielens-1m. Here are the results of my tests：

0 0-0 Epoch 1 - loss=205.3567 0-1 Epoch 1 - loss=204.9783 0-2 Epoch 1 - loss=196.8071 0-3 Epoch 1 - loss=184.8365 0-4 Epoch 1 - loss=176.3383 0-5 Epoch 1 - loss=162.3856 0-6 Epoch 1 - loss=151.6234 0-7 Epoch 1 - loss=135.2499 0-8 Epoch 1 - loss=127.9580 0-9 Epoch 1 - loss=118.2730 0-10 Epoch 1 - loss=111.0059 0-11 Epoch 1 - loss=105.8223 0-12 Epoch 1 - loss=94.1179 0-13 Epoch 1 - loss=86.8087 0-14 Epoch 1 - loss=60.6968 precision : [0.04330671676843606, 0.04250821982151244, 0.03958039768279323, 0.034194457491780066] recall : [0.010826679192109015, 0.02125410991075622, 0.029685298262094796, 0.034194457491780066] MAP : [0.028232346954751842, 0.019905537289285524, 0.0158144583179811, 0.012819485926088576] ndcg : [0.04664384611184905, 0.044812432401552686, 0.042337863019969404, 0.03822263438122158] 1 1-0 Epoch 2 - loss=90.2064 1-1 Epoch 2 - loss=80.5032 1-2 Epoch 2 - loss=67.9278 1-3 Epoch 2 - loss=63.5593 1-4 Epoch 2 - loss=65.5669 1-5 Epoch 2 - loss=60.2247 1-6 Epoch 2 - loss=56.5831 1-7 Epoch 2 - loss=55.1667 1-8 Epoch 2 - loss=57.8262 1-9 Epoch 2 - loss=53.6529 1-10 Epoch 2 - loss=56.9821 1-11 Epoch 2 - loss=57.8628 1-12 Epoch 2 - loss=48.0727 1-13 Epoch 2 - loss=52.6325 1-14 Epoch 2 - loss=33.6227 precision : [0.040112728980742175, 0.049318929074682716, 0.048097698449976536, 0.04704086425551872] recall : [0.010028182245185544, 0.024659464537341358, 0.03607327383748213, 0.04704086425551872] MAP : [0.03491780178487553, 0.02682060658927732, 0.0223135642604877, 0.01819596037708147] ndcg : [0.047541501319847544, 0.05203337254587955, 0.050625748384504204, 0.04943947268136284] 2 2-0 Epoch 3 - loss=74.5687 2-1 Epoch 3 - loss=67.0918 2-2 Epoch 3 - loss=47.4482 2-3 Epoch 3 - loss=43.1047 2-4 Epoch 3 - loss=49.8758 2-5 Epoch 3 - loss=47.1292 2-6 Epoch 3 - loss=44.1439 2-7 Epoch 3 - loss=39.9284 2-8 Epoch 3 - loss=42.8612 2-9 Epoch 3 - loss=42.3989 2-10 Epoch 3 - loss=45.9361 2-11 Epoch 3 - loss=43.3453 2-12 Epoch 3 - loss=39.5204 2-13 Epoch 3 - loss=37.3069 2-14 Epoch 3 - loss=25.4328 precision : [0.05429779239079387, 0.04814466885861889, 0.04239862220134654, 0.036942226397369375] recall : [0.013574448097698467, 0.024072334429309446, 0.03179896665100968, 0.036942226397369375] MAP : [0.04006575857209958, 0.02675417701134, 0.02026879206071315, 0.01608916531509153] ndcg : [0.056491204501605045, 0.05160543321965035, 0.047006346681776875, 0.042562423217882395] 3 3-0 Epoch 4 - loss=72.6122 3-1 Epoch 4 - loss=53.5380 3-2 Epoch 4 - loss=41.2988 3-3 Epoch 4 - loss=36.9067 3-4 Epoch 4 - loss=44.2711 3-5 Epoch 4 - loss=43.7877 3-6 Epoch 4 - loss=37.6888 3-7 Epoch 4 - loss=37.6778 3-8 Epoch 4 - loss=35.0479 3-9 Epoch 4 - loss=36.2907 3-10 Epoch 4 - loss=40.4050 3-11 Epoch 4 - loss=41.9591 3-12 Epoch 4 - loss=34.3850 3-13 Epoch 4 - loss=36.0059 3-14 Epoch 4 - loss=23.9649 precision : [0.045185533114138254, 0.04307186472522295, 0.038108658211993156, 0.041874119304837594] recall : [0.011296383278534564, 0.021535932362611476, 0.028581493658994643, 0.041874119304837594] MAP : [0.027075309221856896, 0.019563287033930527, 0.015171435735080636, 0.013857002950885784] ndcg : [0.04525629258374485, 0.043717310801200414, 0.04020202661295856, 0.04236376473433662] 4 4-0 Epoch 5 - loss=61.8925 4-1 Epoch 5 - loss=50.0482 4-2 Epoch 5 - loss=35.6327 4-3 Epoch 5 - loss=34.2871 4-4 Epoch 5 - loss=37.6356 4-5 Epoch 5 - loss=40.5915 4-6 Epoch 5 - loss=35.0897 4-7 Epoch 5 - loss=36.0132 4-8 Epoch 5 - loss=33.8157 4-9 Epoch 5 - loss=33.8290 4-10 Epoch 5 - loss=36.7306 4-11 Epoch 5 - loss=40.2762 4-12 Epoch 5 - loss=33.1490 4-13 Epoch 5 - loss=33.8866 4-14 Epoch 5 - loss=19.2487 precision : [0.045185533114138254, 0.04011272898074214, 0.034695475183967546, 0.0393377172381398] recall : [0.011296383278534564, 0.02005636449037107, 0.02602160638797548, 0.0393377172381398] MAP : [0.027145764834820733, 0.021772890618592826, 0.01631726405563888, 0.014273858349092073] ndcg : [0.04564281740656943, 0.04195963100557218, 0.03775462939602092, 0.040415909549211176] 5 5-0 Epoch 6 - loss=58.4320 5-1 Epoch 6 - loss=50.8018 5-2 Epoch 6 - loss=37.0527 5-3 Epoch 6 - loss=32.8270 5-4 Epoch 6 - loss=37.1209 5-5 Epoch 6 - loss=37.1875 5-6 Epoch 6 - loss=33.1775 5-7 Epoch 6 - loss=32.7904 5-8 Epoch 6 - loss=34.6279 5-9 Epoch 6 - loss=32.0058 5-10 Epoch 6 - loss=35.3103 5-11 Epoch 6 - loss=34.9769 5-12 Epoch 6 - loss=31.5922 5-13 Epoch 6 - loss=32.9718 5-14 Epoch 6 - loss=18.4296 precision : [0.045185533114138254, 0.04941286989196785, 0.04468451542195087, 0.042226397369656804] recall : [0.011296383278534564, 0.024706434945983926, 0.033513386566462876, 0.042226397369656804] MAP : [0.026884296226710503, 0.02263785442155569, 0.01744196976935352, 0.014593090849419312] ndcg : [0.045465659985436856, 0.04832486733435034, 0.0453425346385716, 0.043608224215221855] 6 6-0 Epoch 7 - loss=58.4213 6-1 Epoch 7 - loss=45.7135 6-2 Epoch 7 - loss=36.9579 6-3 Epoch 7 - loss=31.4550 6-4 Epoch 7 - loss=35.1586 6-5 Epoch 7 - loss=32.9685 6-6 Epoch 7 - loss=35.8421 6-7 Epoch 7 - loss=30.7457 6-8 Epoch 7 - loss=29.3249 6-9 Epoch 7 - loss=30.6614 6-10 Epoch 7 - loss=36.5477 6-11 Epoch 7 - loss=36.3523 6-12 Epoch 7 - loss=32.4100 6-13 Epoch 7 - loss=33.5181 6-14 Epoch 7 - loss=18.9208 precision : [0.045185533114138254, 0.03832785345232497, 0.044778456239235966, 0.042578675434475965] recall : [0.011296383278534564, 0.019163926726162486, 0.03358384217942674, 0.042578675434475965] MAP : [0.026884296226710503, 0.018490814675643234, 0.01723182711205257, 0.014830713508133864] ndcg : [0.045465659985436856, 0.04035198211461505, 0.04425321088620042, 0.042954125105814145] 7 7-0 Epoch 8 - loss=55.3511 7-1 Epoch 8 - loss=49.8505 7-2 Epoch 8 - loss=34.8276 7-3 Epoch 8 - loss=29.2295 7-4 Epoch 8 - loss=33.9552 7-5 Epoch 8 - loss=33.1419 7-6 Epoch 8 - loss=32.8799 7-7 Epoch 8 - loss=31.0669 7-8 Epoch 8 - loss=31.1622 7-9 Epoch 8 - loss=30.7182 7-10 Epoch 8 - loss=35.6672 7-11 Epoch 8 - loss=35.0867 7-12 Epoch 8 - loss=34.3456 7-13 Epoch 8 - loss=28.9197 7-14 Epoch 8 - loss=18.0465 precision : [0.045185533114138254, 0.044058243306716594, 0.045467355565993614, 0.04605448567402504] recall : [0.011296383278534564, 0.022029121653358297, 0.034100516674494874, 0.04605448567402504] MAP : [0.022492563018631593, 0.015344319190021397, 0.013568173471884134, 0.012894196729506917] ndcg : [0.03997085843739438, 0.04077617713482408, 0.0423819034161583, 0.04336216128727592] 8 8-0 Epoch 9 - loss=56.0580 8-1 Epoch 9 - loss=46.4357 8-2 Epoch 9 - loss=30.7667 8-3 Epoch 9 - loss=29.0713 8-4 Epoch 9 - loss=32.4376 8-5 Epoch 9 - loss=31.5925 8-6 Epoch 9 - loss=33.1686 8-7 Epoch 9 - loss=32.6105 8-8 Epoch 9 - loss=29.3623 8-9 Epoch 9 - loss=28.9745 8-10 Epoch 9 - loss=31.4513 8-11 Epoch 9 - loss=33.9913 8-12 Epoch 9 - loss=28.3835 8-13 Epoch 9 - loss=28.1203 8-14 Epoch 9 - loss=18.1663 precision : [0.06077970878346682, 0.04950681070925292, 0.04778456239235964, 0.051385627054955016] recall : [0.015194927195866705, 0.02475340535462646, 0.035838421794269375, 0.051385627054955016] MAP : [0.038038202599029285, 0.023979623789393632, 0.018980455377825035, 0.016558795630094856] ndcg : [0.06468481207097997, 0.05565032997554468, 0.05313523868406691, 0.05471932857585353] 9 9-0 Epoch 10 - loss=52.7719 9-1 Epoch 10 - loss=42.9529 9-2 Epoch 10 - loss=32.9765 9-3 Epoch 10 - loss=27.3142 9-4 Epoch 10 - loss=31.6532 9-5 Epoch 10 - loss=33.5192 9-6 Epoch 10 - loss=31.0452 9-7 Epoch 10 - loss=27.5306 9-8 Epoch 10 - loss=28.2761 9-9 Epoch 10 - loss=30.1534 9-10 Epoch 10 - loss=32.4576 9-11 Epoch 10 - loss=32.6327 9-12 Epoch 10 - loss=27.1999 9-13 Epoch 10 - loss=28.2267 9-14 Epoch 10 - loss=16.3549 precision : [0.06566463128229241, 0.0529356505401594, 0.0562392359480195, 0.05767966181305709] recall : [0.016416157820573103, 0.0264678252700797, 0.042179426961014094, 0.05767966181305709] MAP : [0.03945201189917019, 0.024120069039045084, 0.019940927590058638, 0.017796747292454337] ndcg : [0.07159990512658894, 0.060638204824848996, 0.06110001039687664, 0.061255800814033104] 10 10-0 Epoch 11 - loss=49.0057 10-1 Epoch 11 - loss=42.1460 10-2 Epoch 11 - loss=28.2850 10-3 Epoch 11 - loss=26.3456 10-4 Epoch 11 - loss=32.0856 10-5 Epoch 11 - loss=30.2405 10-6 Epoch 11 - loss=27.4258 10-7 Epoch 11 - loss=23.1670 10-8 Epoch 11 - loss=24.1116 10-9 Epoch 11 - loss=27.2802 10-10 Epoch 11 - loss=30.9590 10-11 Epoch 11 - loss=29.1598 10-12 Epoch 11 - loss=27.0448 10-13 Epoch 11 - loss=25.0346 10-14 Epoch 11 - loss=14.4787 precision : [0.09243776420854802, 0.08158759981211734, 0.07427587286676032, 0.06906998590887718] recall : [0.023109441052137004, 0.04079379990605867, 0.05570690465006973, 0.06906998590887718] MAP : [0.05584155315484578, 0.0363989353374041, 0.02800120864470324, 0.023273693190853314] ndcg : [0.09642779815118717, 0.08737738911213011, 0.08113783502030189, 0.07648540843604405] 11 11-0 Epoch 12 - loss=48.2827 11-1 Epoch 12 - loss=39.9674 11-2 Epoch 12 - loss=29.2160 11-3 Epoch 12 - loss=26.2362 11-4 Epoch 12 - loss=28.6038 11-5 Epoch 12 - loss=28.8925 11-6 Epoch 12 - loss=27.4668 11-7 Epoch 12 - loss=24.0685 11-8 Epoch 12 - loss=21.2066 11-9 Epoch 12 - loss=22.7477 11-10 Epoch 12 - loss=26.5697 11-11 Epoch 12 - loss=28.5727 11-12 Epoch 12 - loss=25.6128 11-13 Epoch 12 - loss=24.6799 11-14 Epoch 12 - loss=16.2045 precision : [0.0978863316110844, 0.08604978863316, 0.0779708783466412, 0.07287458900892435] recall : [0.0244715829027711, 0.04302489431658, 0.05847815875998064, 0.07287458900892435] MAP : [0.061698763112572406, 0.04122594630462174, 0.03198675487308649, 0.02646535579354989] ndcg : [0.10576556772476561, 0.0948704144446469, 0.08745562602065801, 0.08245132878159134] 12 12-0 Epoch 13 - loss=48.4861 12-1 Epoch 13 - loss=38.6461 12-2 Epoch 13 - loss=26.0090 12-3 Epoch 13 - loss=23.6564 12-4 Epoch 13 - loss=28.3239 12-5 Epoch 13 - loss=25.3221 12-6 Epoch 13 - loss=24.2761 12-7 Epoch 13 - loss=20.1080 12-8 Epoch 13 - loss=21.5273 12-9 Epoch 13 - loss=20.7912 12-10 Epoch 13 - loss=26.0327 12-11 Epoch 13 - loss=26.0098 12-12 Epoch 13 - loss=22.7495 12-13 Epoch 13 - loss=22.7097 12-14 Epoch 13 - loss=13.3440 precision : [0.09300140911225886, 0.09234382339126232, 0.08345075935493927, 0.07703147017379056] recall : [0.023250352278064716, 0.04617191169563116, 0.06258806951620449, 0.07703147017379056] MAP : [0.06007671833411617, 0.041551645082645555, 0.03221132215730618, 0.02677880703873481] ndcg : [0.1020820636926194, 0.09878285512572993, 0.09141998575260606, 0.08577923929912881] 13 13-0 Epoch 14 - loss=47.5182 13-1 Epoch 14 - loss=37.1316 13-2 Epoch 14 - loss=23.1244 13-3 Epoch 14 - loss=22.2895 13-4 Epoch 14 - loss=24.3929 13-5 Epoch 14 - loss=23.1046 13-6 Epoch 14 - loss=23.9708 13-7 Epoch 14 - loss=20.5655 13-8 Epoch 14 - loss=21.2519 13-9 Epoch 14 - loss=22.7694 13-10 Epoch 14 - loss=25.3373 13-11 Epoch 14 - loss=26.0772 13-12 Epoch 14 - loss=24.4897 13-13 Epoch 14 - loss=21.4710 13-14 Epoch 14 - loss=13.1921 precision : [0.09469234382339085, 0.08351338656646219, 0.07865977767339893, 0.07428370126820105] recall : [0.023673085955847713, 0.041756693283231096, 0.058994833255048895, 0.07428370126820105] MAP : [0.05535149522467512, 0.036725398316520906, 0.02902807741464388, 0.024226335187201783] ndcg : [0.09865520650866366, 0.0894120889127534, 0.0848747719353327, 0.0809013977260015] 14 14-0 Epoch 15 - loss=44.3069 14-1 Epoch 15 - loss=35.2363 14-2 Epoch 15 - loss=23.8678 14-3 Epoch 15 - loss=21.6857 14-4 Epoch 15 - loss=25.1394 14-5 Epoch 15 - loss=25.7987 14-6 Epoch 15 - loss=22.3635 14-7 Epoch 15 - loss=22.7689 14-8 Epoch 15 - loss=20.5078 14-9 Epoch 15 - loss=19.9842 14-10 Epoch 15 - loss=24.2718 14-11 Epoch 15 - loss=23.7482 14-12 Epoch 15 - loss=21.0331 14-13 Epoch 15 - loss=19.0839 14-14 Epoch 15 - loss=13.1097 precision : [0.08896195396899914, 0.08243306716768346, 0.07693752935650522, 0.07207609206200091] recall : [0.022240488492249785, 0.04121653358384173, 0.05770314701737852, 0.07207609206200091] MAP : [0.05107875371849068, 0.034972824263571095, 0.027361810466554472, 0.02284144458278705] ndcg : [0.09101831519730881, 0.08570255722128158, 0.08129961287410348, 0.07732955724134832] 15 15-0 Epoch 16 - loss=41.5867 15-1 Epoch 16 - loss=35.4304 15-2 Epoch 16 - loss=23.7324 15-3 Epoch 16 - loss=23.0161 15-4 Epoch 16 - loss=26.0383 15-5 Epoch 16 - loss=23.0243 15-6 Epoch 16 - loss=22.9148 15-7 Epoch 16 - loss=22.3321 15-8 Epoch 16 - loss=18.6186 15-9 Epoch 16 - loss=20.0840 15-10 Epoch 16 - loss=24.0604 15-11 Epoch 16 - loss=25.0408 15-12 Epoch 16 - loss=24.7186 15-13 Epoch 16 - loss=22.7209 15-14 Epoch 16 - loss=12.5533 precision : [0.0898074213245651, 0.0764678252700791, 0.07145764834820736, 0.06928135274776877] recall : [0.022451855331141274, 0.03823391263503955, 0.053593236261154996, 0.06928135274776877] MAP : [0.05169406607170816, 0.03356893093858806, 0.02618595711127416, 0.022019812151433817] ndcg : [0.09264416299423339, 0.0826056714653445, 0.07788622729243448, 0.07531241704907025] 16 16-0 Epoch 17 - loss=47.4120 16-1 Epoch 17 - loss=34.4431 16-2 Epoch 17 - loss=23.3237 16-3 Epoch 17 - loss=22.2416 16-4 Epoch 17 - loss=24.8582 16-5 Epoch 17 - loss=23.4470 16-6 Epoch 17 - loss=22.7879 16-7 Epoch 17 - loss=20.7911 16-8 Epoch 17 - loss=19.4555 16-9 Epoch 17 - loss=20.0486 16-10 Epoch 17 - loss=23.0827 16-11 Epoch 17 - loss=22.6455 16-12 Epoch 17 - loss=21.9224 16-13 Epoch 17 - loss=22.1572 16-14 Epoch 17 - loss=13.4514 precision : [0.0936589948332545, 0.0817754814466876, 0.07455769531861585, 0.06930483795209015] recall : [0.023414748708313626, 0.0408877407233438, 0.05591827148896146, 0.06930483795209015] MAP : [0.050945670894003446, 0.03415320927180956, 0.0268741919493446, 0.022442206918917663] ndcg : [0.09536461896139942, 0.08644781627799819, 0.08056414475347046, 0.07604710036614157] 17 17-0 Epoch 18 - loss=41.5430 17-1 Epoch 18 - loss=37.1483 17-2 Epoch 18 - loss=23.4037 17-3 Epoch 18 - loss=22.0392 17-4 Epoch 18 - loss=24.6136 17-5 Epoch 18 - loss=22.7024 17-6 Epoch 18 - loss=24.0229 17-7 Epoch 18 - loss=22.9068 17-8 Epoch 18 - loss=19.3535 17-9 Epoch 18 - loss=19.9766 17-10 Epoch 18 - loss=24.4832 17-11 Epoch 18 - loss=23.5675 17-12 Epoch 18 - loss=21.1765 17-13 Epoch 18 - loss=20.8950 17-14 Epoch 18 - loss=11.1753 precision : [0.08802254579614814, 0.08276186002818135, 0.07621731642398626, 0.07209957726632214] recall : [0.022005636449037035, 0.041380930014090676, 0.05716298731798919, 0.07209957726632214] MAP : [0.04750587130108032, 0.03319119193003646, 0.026525894647078302, 0.022399395029593403] ndcg : [0.0879000495601815, 0.08404062247505334, 0.07940098221691258, 0.07610997211763348] 18 18-0 Epoch 19 - loss=43.5013 18-1 Epoch 19 - loss=34.1201 18-2 Epoch 19 - loss=22.1453 18-3 Epoch 19 - loss=21.2373 18-4 Epoch 19 - loss=23.6785 18-5 Epoch 19 - loss=23.0822 18-6 Epoch 19 - loss=20.0395 18-7 Epoch 19 - loss=19.6106 18-8 Epoch 19 - loss=17.0490 18-9 Epoch 19 - loss=19.9648 18-10 Epoch 19 - loss=22.9726 18-11 Epoch 19 - loss=23.8467 18-12 Epoch 19 - loss=22.4087 18-13 Epoch 19 - loss=20.9216 18-14 Epoch 19 - loss=11.5324 precision : [0.09365899483325453, 0.08177548144668766, 0.07590418036636903, 0.07240488492249879] recall : [0.023414748708313633, 0.04088774072334383, 0.05692813527477648, 0.07240488492249879] MAP : [0.05093314545169876, 0.03453391188947789, 0.02754268103727944, 0.023315187203952585] ndcg : [0.09415257723102553, 0.08589287800266072, 0.08098434238480993, 0.07781704846860789] 19 19-0 Epoch 20 - loss=42.1636 19-1 Epoch 20 - loss=35.6826 19-2 Epoch 20 - loss=24.5285 19-3 Epoch 20 - loss=20.2476 19-4 Epoch 20 - loss=24.2312 19-5 Epoch 20 - loss=21.9783 19-6 Epoch 20 - loss=21.2962 19-7 Epoch 20 - loss=21.2387 19-8 Epoch 20 - loss=19.0846 19-9 Epoch 20 - loss=22.2493 19-10 Epoch 20 - loss=24.8553 19-11 Epoch 20 - loss=22.9710 19-12 Epoch 20 - loss=21.4654 19-13 Epoch 20 - loss=20.1881 19-14 Epoch 20 - loss=11.5895 precision : [0.10145608266791863, 0.08666040394551341, 0.07928604978863299, 0.07456552372005645] recall : [0.025364020666979657, 0.04333020197275671, 0.059464537341474416, 0.07456552372005645] MAP : [0.05754814466885862, 0.03844872769837542, 0.030172293739696276, 0.025311877753799134] ndcg : [0.10269666362861683, 0.09199675596506543, 0.08587201294286323, 0.08160436857762103] 20 20-0 Epoch 21 - loss=41.6457 20-1 Epoch 21 - loss=34.2919 20-2 Epoch 21 - loss=22.8238 20-3 Epoch 21 - loss=19.9459 20-4 Epoch 21 - loss=20.7845 20-5 Epoch 21 - loss=22.1473 20-6 Epoch 21 - loss=20.7723 20-7 Epoch 21 - loss=19.6995 20-8 Epoch 21 - loss=17.4602 20-9 Epoch 21 - loss=20.3163 20-10 Epoch 21 - loss=23.2800 20-11 Epoch 21 - loss=23.3658 20-12 Epoch 21 - loss=20.4970 20-13 Epoch 21 - loss=19.1422 20-14 Epoch 21 - loss=11.1251 precision : [0.09816815406293983, 0.08553311413809211, 0.07537184906842012, 0.07007984969469226] recall : [0.024542038515734957, 0.04276655706904606, 0.05652888680131465, 0.07007984969469226] MAP : [0.054958509472365746, 0.03674379505990591, 0.028502171766615167, 0.023596762665581583] ndcg : [0.09840234311129559, 0.08964827584410563, 0.08186766681794135, 0.07721431412123902] 21 21-0 Epoch 22 - loss=39.0476 21-1 Epoch 22 - loss=30.3627 21-2 Epoch 22 - loss=21.6400 21-3 Epoch 22 - loss=20.8707 21-4 Epoch 22 - loss=23.5824 21-5 Epoch 22 - loss=22.3741 21-6 Epoch 22 - loss=21.1678 21-7 Epoch 22 - loss=19.7558 21-8 Epoch 22 - loss=17.8111 21-9 Epoch 22 - loss=19.6743 21-10 Epoch 22 - loss=23.4116 21-11 Epoch 22 - loss=24.5015 21-12 Epoch 22 - loss=22.1431 21-13 Epoch 22 - loss=22.4161 21-14 Epoch 22 - loss=11.4953 precision : [0.0975105683419441, 0.08759981211836453, 0.07847189603882875, 0.07181775481446673] recall : [0.024377642085486026, 0.04379990605918226, 0.05885392202912127, 0.07181775481446673] MAP : [0.05747925473618287, 0.039059044785911864, 0.03026371563478186, 0.025009075596038467] ndcg : [0.10218596524520224, 0.0935787246248673, 0.08614848485944232, 0.0803959648338711] 22 22-0 Epoch 23 - loss=38.0880 22-1 Epoch 23 - loss=32.6214 22-2 Epoch 23 - loss=21.0014 22-3 Epoch 23 - loss=21.8306 22-4 Epoch 23 - loss=23.9615 22-5 Epoch 23 - loss=23.3802 22-6 Epoch 23 - loss=21.1952 22-7 Epoch 23 - loss=20.0696 22-8 Epoch 23 - loss=18.1329 22-9 Epoch 23 - loss=17.9208 22-10 Epoch 23 - loss=23.4841 22-11 Epoch 23 - loss=21.3550 22-12 Epoch 23 - loss=19.7238 22-13 Epoch 23 - loss=19.1752 22-14 Epoch 23 - loss=10.4145 precision : [0.09675904180366332, 0.08388914983560279, 0.07574761233756072, 0.07022076092062002] recall : [0.02418976045091583, 0.041944574917801396, 0.056810709253170034, 0.07022076092062002] MAP : [0.054967903554094255, 0.037263134939273974, 0.02899277357473694, 0.023914939445703245] ndcg : [0.09853543719555016, 0.08909656553192193, 0.08249782041067194, 0.07765743416667199] 23 23-0 Epoch 24 - loss=38.7437 23-1 Epoch 24 - loss=33.5115 23-2 Epoch 24 - loss=22.8534 23-3 Epoch 24 - loss=21.0817 23-4 Epoch 24 - loss=24.3165 23-5 Epoch 24 - loss=22.7471 23-6 Epoch 24 - loss=22.2557 23-7 Epoch 24 - loss=21.0050 23-8 Epoch 24 - loss=16.5600 23-9 Epoch 24 - loss=18.5369 23-10 Epoch 24 - loss=20.4993 23-11 Epoch 24 - loss=23.9274 23-12 Epoch 24 - loss=21.5577 23-13 Epoch 24 - loss=18.8542 23-14 Epoch 24 - loss=10.9952 precision : [0.10192578675434431, 0.08600281822451782, 0.07634257084703303, 0.07106622827618589] recall : [0.02548144668858608, 0.04300140911225891, 0.0572569281352744, 0.07106622827618589] MAP : [0.05896038828871144, 0.03924426103618212, 0.03013435636263255, 0.025167366145007756] ndcg : [0.10420501596165607, 0.0923868488255388, 0.08445080660918368, 0.07955116874548884] 24 24-0 Epoch 25 - loss=37.0999 24-1 Epoch 25 - loss=30.8851 24-2 Epoch 25 - loss=20.8154 24-3 Epoch 25 - loss=21.8736 24-4 Epoch 25 - loss=23.5907 24-5 Epoch 25 - loss=22.2276 24-6 Epoch 25 - loss=18.0298 24-7 Epoch 25 - loss=18.1723 24-8 Epoch 25 - loss=17.3043 24-9 Epoch 25 - loss=20.4208 24-10 Epoch 25 - loss=24.8741 24-11 Epoch 25 - loss=22.4153 24-12 Epoch 25 - loss=20.4428 24-13 Epoch 25 - loss=19.7919 24-14 Epoch 25 - loss=11.2819 precision : [0.0963832785345227, 0.08727101925786669, 0.07909816815406277, 0.07217003287928603] recall : [0.024095819633630677, 0.043635509628933346, 0.05932362611554686, 0.07217003287928603] MAP : [0.0530624706434946, 0.037091040580941946, 0.029305444481583513, 0.02431081039783635] ndcg : [0.09754633297298815, 0.09094597785262153, 0.08462722922852592, 0.0790798605020886] 25 25-0 Epoch 26 - loss=38.3628 25-1 Epoch 26 - loss=32.7378 25-2 Epoch 26 - loss=21.7697 25-3 Epoch 26 - loss=20.9224 25-4 Epoch 26 - loss=19.7254 25-5 Epoch 26 - loss=21.8181 25-6 Epoch 26 - loss=20.2575 25-7 Epoch 26 - loss=19.3778 25-8 Epoch 26 - loss=18.1240 25-9 Epoch 26 - loss=21.8190 25-10 Epoch 26 - loss=23.4541 25-11 Epoch 26 - loss=22.6891 25-12 Epoch 26 - loss=21.0351 25-13 Epoch 26 - loss=20.2887 25-14 Epoch 26 - loss=12.4617 precision : [0.0936589948332545, 0.0831845937059643, 0.0759354939721308, 0.06979802724283694] recall : [0.023414748708313626, 0.04159229685298215, 0.0569516204790978, 0.06979802724283694] MAP : [0.05123062470643494, 0.03554001058698099, 0.02797981952984302, 0.02322750160764872] ndcg : [0.09628562237496154, 0.08821270489073825, 0.08219515203409163, 0.07703893180826628] 26 26-0 Epoch 27 - loss=38.2052 26-1 Epoch 27 - loss=34.2235 26-2 Epoch 27 - loss=21.8188 26-3 Epoch 27 - loss=22.0204 26-4 Epoch 27 - loss=25.3950 26-5 Epoch 27 - loss=19.2322 26-6 Epoch 27 - loss=19.6525 26-7 Epoch 27 - loss=18.3555 26-8 Epoch 27 - loss=16.9228 26-9 Epoch 27 - loss=19.0337 26-10 Epoch 27 - loss=21.4098 26-11 Epoch 27 - loss=19.9957 26-12 Epoch 27 - loss=20.3848 26-13 Epoch 27 - loss=20.7026 26-14 Epoch 27 - loss=12.0784 precision : [0.09891968060122058, 0.08158759981211763, 0.07214654767496477, 0.07036167214654762] recall : [0.024729920150305146, 0.04079379990605882, 0.054109910756223185, 0.07036167214654762] MAP : [0.05168780335055582, 0.03475271570973779, 0.026966877476506407, 0.023119676921637935] ndcg : [0.09742863176120756, 0.08589932626741872, 0.07856975117371551, 0.07629730248853077] 27 27-0 Epoch 28 - loss=41.9956 27-1 Epoch 28 - loss=29.8256 27-2 Epoch 28 - loss=21.4519 27-3 Epoch 28 - loss=20.6814 27-4 Epoch 28 - loss=22.2663 27-5 Epoch 28 - loss=22.7836 27-6 Epoch 28 - loss=20.2231 27-7 Epoch 28 - loss=20.0183 27-8 Epoch 28 - loss=16.8969 27-9 Epoch 28 - loss=18.9573 27-10 Epoch 28 - loss=24.1928 27-11 Epoch 28 - loss=23.9645 27-12 Epoch 28 - loss=20.8611 27-13 Epoch 28 - loss=21.3173 27-14 Epoch 28 - loss=13.2960 precision : [0.09929544387036107, 0.08525129168623688, 0.07596680757789255, 0.0693987787693752] recall : [0.024823860967590268, 0.04262564584311844, 0.05697510568341904, 0.0693987787693752] MAP : [0.0563472678878973, 0.03786074019399524, 0.029622862828593218, 0.02458051677484466] ndcg : [0.09939227708729428, 0.08969044240323655, 0.0824719944093542, 0.0769722503469909] 28 28-0 Epoch 29 - loss=37.3316 28-1 Epoch 29 - loss=30.2809 28-2 Epoch 29 - loss=22.5016 28-3 Epoch 29 - loss=22.2178 28-4 Epoch 29 - loss=23.6033 28-5 Epoch 29 - loss=22.6223 28-6 Epoch 29 - loss=19.3238 28-7 Epoch 29 - loss=17.9658 28-8 Epoch 29 - loss=18.1570 28-9 Epoch 29 - loss=19.8830 28-10 Epoch 29 - loss=21.2568 28-11 Epoch 29 - loss=19.9139 28-12 Epoch 29 - loss=20.3560 28-13 Epoch 29 - loss=18.0446 28-14 Epoch 29 - loss=12.0048 precision : [0.09732268670737385, 0.08717707844058162, 0.07703147017379058, 0.07125410991075626] recall : [0.02433067167684346, 0.04358853922029081, 0.05777360263034254, 0.07125410991075626] MAP : [0.05532018161891342, 0.038142115308625414, 0.029572355431913906, 0.02483058779643282] ndcg : [0.09761030215194433, 0.09052050789993558, 0.08292936245174601, 0.0780841548889868] 29 29-0 Epoch 30 - loss=35.7203 29-1 Epoch 30 - loss=31.2097 29-2 Epoch 30 - loss=23.4501 29-3 Epoch 30 - loss=21.8427 29-4 Epoch 30 - loss=22.1267 29-5 Epoch 30 - loss=22.1310 29-6 Epoch 30 - loss=20.2252 29-7 Epoch 30 - loss=20.3377 29-8 Epoch 30 - loss=16.1319 29-9 Epoch 30 - loss=18.1911 29-10 Epoch 30 - loss=23.4760 29-11 Epoch 30 - loss=21.8117 29-12 Epoch 30 - loss=20.3228 29-13 Epoch 30 - loss=20.1933 29-14 Epoch 30 - loss=11.8447 precision : [0.09140441521841201, 0.08337247534053484, 0.07521528103961175, 0.06979802724283704] recall : [0.022851103804603003, 0.04168623767026742, 0.05641146077970845, 0.06979802724283704] MAP : [0.04960544856740254, 0.03527941801427006, 0.027662605908261147, 0.02334864760778666] ndcg : [0.08951989738346539, 0.0847016636549115, 0.07893278122435823, 0.07469588637997883] 30 30-0 Epoch 31 - loss=36.0849 30-1 Epoch 31 - loss=30.5486 30-2 Epoch 31 - loss=21.4659 30-3 Epoch 31 - loss=18.7373 30-4 Epoch 31 - loss=22.6550 30-5 Epoch 31 - loss=20.0415 30-6 Epoch 31 - loss=19.6875 30-7 Epoch 31 - loss=19.0066 30-8 Epoch 31 - loss=18.4218 30-9 Epoch 31 - loss=19.2580 30-10 Epoch 31 - loss=23.2215 30-11 Epoch 31 - loss=21.9722 30-12 Epoch 31 - loss=21.0013 30-13 Epoch 31 - loss=18.4116 30-14 Epoch 31 - loss=11.6736 precision : [0.09365899483325461, 0.08276186002818156, 0.07612337560670109, 0.06998590887740729] recall : [0.023414748708313653, 0.04138093001409078, 0.05709253170502542, 0.06998590887740729] MAP : [0.050172224831689365, 0.03492108225786009, 0.027955752648096473, 0.02340674241145872] ndcg : [0.09090729190629997, 0.08437193586775371, 0.07954016948466655, 0.07486423026706182] 31 31-0 Epoch 32 - loss=41.2126 31-1 Epoch 32 - loss=32.5614 31-2 Epoch 32 - loss=23.0906 31-3 Epoch 32 - loss=20.7711 31-4 Epoch 32 - loss=21.3568 31-5 Epoch 32 - loss=18.6025 31-6 Epoch 32 - loss=20.4259 31-7 Epoch 32 - loss=17.9931 31-8 Epoch 32 - loss=17.0026 31-9 Epoch 32 - loss=17.4770 31-10 Epoch 32 - loss=21.6324 31-11 Epoch 32 - loss=21.0675 31-12 Epoch 32 - loss=22.1762 31-13 Epoch 32 - loss=19.6753 31-14 Epoch 32 - loss=11.7686 precision : [0.08971348050728016, 0.08130577736026245, 0.07643651166431807, 0.07078440582433065] recall : [0.02242837012682004, 0.04065288868013123, 0.05732738374823822, 0.07078440582433065] MAP : [0.05121496790355409, 0.03521636210457254, 0.028543382056768624, 0.02414602204662292] ndcg : [0.09128250165265706, 0.08496347952085272, 0.0808932721656055, 0.07638034528135355] 32 32-0 Epoch 33 - loss=36.8174 32-1 Epoch 33 - loss=29.7700 32-2 Epoch 33 - loss=23.1473 32-3 Epoch 33 - loss=18.9229 32-4 Epoch 33 - loss=20.6554 32-5 Epoch 33 - loss=17.6282 32-6 Epoch 33 - loss=18.6542 32-7 Epoch 33 - loss=20.1573 32-8 Epoch 33 - loss=17.1738 32-9 Epoch 33 - loss=19.8614 32-10 Epoch 33 - loss=25.0011 32-11 Epoch 33 - loss=21.7495 32-12 Epoch 33 - loss=20.1617 32-13 Epoch 33 - loss=18.7978 32-14 Epoch 33 - loss=11.0000 precision : [0.08529826209488, 0.07740723344293045, 0.07233442930953511, 0.06759041803663679] recall : [0.02132456552372, 0.038703616721465224, 0.05425082198215086, 0.06759041803663679] MAP : [0.04760137779865352, 0.03312947803201444, 0.026527438342844635, 0.02238763967550757] ndcg : [0.08544233586436974, 0.07999375490804171, 0.07596886885177175, 0.07219767090414046] 33 33-0 Epoch 34 - loss=35.5435 33-1 Epoch 34 - loss=30.5069 33-2 Epoch 34 - loss=21.8653 33-3 Epoch 34 - loss=19.2858 33-4 Epoch 34 - loss=22.8881 33-5 Epoch 34 - loss=20.8998 33-6 Epoch 34 - loss=17.7019 33-7 Epoch 34 - loss=17.9104 33-8 Epoch 34 - loss=15.5232 33-9 Epoch 34 - loss=18.4722 33-10 Epoch 34 - loss=21.3273 33-11 Epoch 34 - loss=20.3236 33-12 Epoch 34 - loss=21.0814 33-13 Epoch 34 - loss=18.8795 33-14 Epoch 34 - loss=12.0990 precision : [0.08708313762329713, 0.07956787224048788, 0.06995459527164564, 0.06596993893846848] recall : [0.021770784405824282, 0.03978393612024394, 0.052465946453733696, 0.06596993893846848] MAP : [0.04925473618287146, 0.03435853705816129, 0.026355383999818006, 0.0220137028501633] ndcg : [0.0867866048633476, 0.08172555748899114, 0.07478727068667125, 0.07129685388958913] 34 34-0 Epoch 35 - loss=35.9846 34-1 Epoch 35 - loss=32.3184 34-2 Epoch 35 - loss=21.9195 34-3 Epoch 35 - loss=18.4961 34-4 Epoch 35 - loss=20.8349 34-5 Epoch 35 - loss=20.8801 34-6 Epoch 35 - loss=20.5023 34-7 Epoch 35 - loss=17.0032 34-8 Epoch 35 - loss=16.0369 34-9 Epoch 35 - loss=16.1583 34-10 Epoch 35 - loss=21.9246 34-11 Epoch 35 - loss=20.0310 34-12 Epoch 35 - loss=20.6165 34-13 Epoch 35 - loss=17.2709 34-14 Epoch 35 - loss=12.0291 precision : [0.08745890089243752, 0.08013151714419851, 0.07095663065602019, 0.0659699389384685] recall : [0.02186472522310938, 0.04006575857209926, 0.053217472992014576, 0.0659699389384685] MAP : [0.04996712071395021, 0.034624609511880525, 0.026802993294303766, 0.02237471518927514] ndcg : [0.08845831624895549, 0.08312092479779142, 0.07628875319464591, 0.07203959151566604] 35 35-0 Epoch 36 - loss=35.3951 35-1 Epoch 36 - loss=30.4173 35-2 Epoch 36 - loss=21.3768 35-3 Epoch 36 - loss=16.8042 35-4 Epoch 36 - loss=22.2439 35-5 Epoch 36 - loss=18.5142 35-6 Epoch 36 - loss=18.9709 35-7 Epoch 36 - loss=16.8992 35-8 Epoch 36 - loss=16.0597 35-9 Epoch 36 - loss=17.0066 35-10 Epoch 36 - loss=23.2739 35-11 Epoch 36 - loss=21.2009 35-12 Epoch 36 - loss=21.6945 35-13 Epoch 36 - loss=19.5272 35-14 Epoch 36 - loss=10.4266 precision : [0.08708313762329707, 0.07642085486143668, 0.06860811022389232, 0.06550023485204294] recall : [0.021770784405824268, 0.03821042743071834, 0.05145608266791882, 0.06550023485204294] MAP : [0.04989040237983404, 0.03368710252223638, 0.02625956719897537, 0.02223892212604682] ndcg : [0.08806509824140023, 0.08037256039822374, 0.07420837721004717, 0.07119705511695461] 36 36-0 Epoch 37 - loss=34.8728 36-1 Epoch 37 - loss=28.9537 36-2 Epoch 37 - loss=19.2248 36-3 Epoch 37 - loss=18.5842 36-4 Epoch 37 - loss=22.2871 36-5 Epoch 37 - loss=18.2125 36-6 Epoch 37 - loss=22.6152 36-7 Epoch 37 - loss=18.3627 36-8 Epoch 37 - loss=16.7159 36-9 Epoch 37 - loss=18.1318 36-10 Epoch 37 - loss=24.0809 36-11 Epoch 37 - loss=21.0140 36-12 Epoch 37 - loss=20.2708 36-13 Epoch 37 - loss=17.5906 36-14 Epoch 37 - loss=10.3221 precision : [0.08332550493189268, 0.07543447627994308, 0.06845154219508388, 0.06561766087364936] recall : [0.02083137623297317, 0.03771723813997154, 0.05133865664631242, 0.06561766087364936] MAP : [0.04666666666666667, 0.03286823309251679, 0.025439541322585003, 0.021601714573102792] ndcg : [0.0835380815425438, 0.0779671986157911, 0.07271055517462954, 0.0700970506227838] 37 37-0 Epoch 38 - loss=36.3031 37-1 Epoch 38 - loss=30.0425 37-2 Epoch 38 - loss=22.4881 37-3 Epoch 38 - loss=20.9810 37-4 Epoch 38 - loss=19.3368 37-5 Epoch 38 - loss=20.3573 37-6 Epoch 38 - loss=20.2334 37-7 Epoch 38 - loss=18.5761 37-8 Epoch 38 - loss=15.9313 37-9 Epoch 38 - loss=19.7482 37-10 Epoch 38 - loss=20.5477 37-11 Epoch 38 - loss=19.1629 37-12 Epoch 38 - loss=18.9919 37-13 Epoch 38 - loss=19.6261 37-14 Epoch 38 - loss=10.4846 precision : [0.08529826209488002, 0.07665570690464954, 0.07114451229059035, 0.0685767966181305] recall : [0.021324565523720005, 0.03832785345232477, 0.05335838421794232, 0.0685767966181305] MAP : [0.04890558947862847, 0.03387192735243463, 0.02703540079773053, 0.02300710903800135] ndcg : [0.08747094693110266, 0.08063234004383832, 0.0760942027638195, 0.07356970316874452] 38 38-0 Epoch 39 - loss=33.6774 38-1 Epoch 39 - loss=29.2174 38-2 Epoch 39 - loss=19.6380 38-3 Epoch 39 - loss=19.6836 38-4 Epoch 39 - loss=21.4473 38-5 Epoch 39 - loss=18.9107 38-6 Epoch 39 - loss=19.4583 38-7 Epoch 39 - loss=16.3241 38-8 Epoch 39 - loss=17.6952 38-9 Epoch 39 - loss=17.2860 38-10 Epoch 39 - loss=19.3110 38-11 Epoch 39 - loss=21.2638 38-12 Epoch 39 - loss=22.1005 38-13 Epoch 39 - loss=18.5498 38-14 Epoch 39 - loss=10.2177 precision : [0.08520432127759488, 0.07839361202442409, 0.07374354156881162, 0.06869422263973696] recall : [0.02130108031939872, 0.039196806012212045, 0.055307656176608315, 0.06869422263973696] MAP : [0.04897761077188038, 0.03448026870055992, 0.02732748506820841, 0.023001477326347684] ndcg : [0.08627066278699017, 0.08119285777824427, 0.07743325346616627, 0.07344753494528174] 39 39-0 Epoch 40 - loss=31.1885 39-1 Epoch 40 - loss=27.7858 39-2 Epoch 40 - loss=22.6855 39-3 Epoch 40 - loss=19.7619 39-4 Epoch 40 - loss=21.1462 39-5 Epoch 40 - loss=19.3175 39-6 Epoch 40 - loss=16.2801 39-7 Epoch 40 - loss=20.0801 39-8 Epoch 40 - loss=18.6826 39-9 Epoch 40 - loss=17.4023 39-10 Epoch 40 - loss=21.2429 39-11 Epoch 40 - loss=21.5252 39-12 Epoch 40 - loss=20.4866 39-13 Epoch 40 - loss=20.2789 39-14 Epoch 40 - loss=10.0483 precision : [0.08558008454673526, 0.07956787224048782, 0.07289807421324561, 0.06855331141380924] recall : [0.021395021136683814, 0.03978393612024391, 0.054673555659933905, 0.06855331141380924] MAP : [0.05137779865351495, 0.03590716261453697, 0.028192012743445342, 0.023727308414443503] ndcg : [0.09009274907348612, 0.08439802670943039, 0.07882726894118136, 0.07491530334149174] 40 40-0 Epoch 41 - loss=34.9776 40-1 Epoch 41 - loss=30.4592 40-2 Epoch 41 - loss=20.0046 40-3 Epoch 41 - loss=18.8637 40-4 Epoch 41 - loss=22.1172 40-5 Epoch 41 - loss=20.9020 40-6 Epoch 41 - loss=19.9932 40-7 Epoch 41 - loss=18.8289 40-8 Epoch 41 - loss=17.1563 40-9 Epoch 41 - loss=18.1651 40-10 Epoch 41 - loss=21.9781 40-11 Epoch 41 - loss=20.3384 40-12 Epoch 41 - loss=18.3358 40-13 Epoch 41 - loss=18.5627 40-14 Epoch 41 - loss=10.8087 precision : [0.08886801315171416, 0.07834664161578155, 0.07296070142476913, 0.06751996242367296] recall : [0.02221700328792854, 0.03917332080789077, 0.054720526068576456, 0.06751996242367296] MAP : [0.053372475340535463, 0.03619701849739426, 0.02846852875739677, 0.02362929243835173] ndcg : [0.09232617960899876, 0.08371283404725836, 0.07891038272326988, 0.07426642812739448] 41 41-0 Epoch 42 - loss=35.5163 41-1 Epoch 42 - loss=27.8969 41-2 Epoch 42 - loss=19.7567 41-3 Epoch 42 - loss=18.8720 41-4 Epoch 42 - loss=20.1755 41-5 Epoch 42 - loss=19.4703 41-6 Epoch 42 - loss=19.2565 41-7 Epoch 42 - loss=17.7559 41-8 Epoch 42 - loss=17.7602 41-9 Epoch 42 - loss=17.2313 41-10 Epoch 42 - loss=21.2040 41-11 Epoch 42 - loss=20.7662 41-12 Epoch 42 - loss=18.1949 41-13 Epoch 42 - loss=18.1354 41-14 Epoch 42 - loss=11.7690 precision : [0.08595584781587574, 0.07642085486143682, 0.07042429935807121, 0.06587599812118346] recall : [0.021488961953968936, 0.03821042743071841, 0.05281822451855296, 0.06587599812118346] MAP : [0.050497886331611085, 0.03448285952865568, 0.0271063340743942, 0.022515058613490884] ndcg : [0.08841490746748319, 0.08092570968482699, 0.07589172001693956, 0.07193531786207939] 42 42-0 Epoch 43 - loss=33.2613 42-1 Epoch 43 - loss=27.0375 42-2 Epoch 43 - loss=20.2550 42-3 Epoch 43 - loss=20.1637 42-4 Epoch 43 - loss=20.7583 42-5 Epoch 43 - loss=18.8502 42-6 Epoch 43 - loss=18.4343 42-7 Epoch 43 - loss=15.9305 42-8 Epoch 43 - loss=15.8750 42-9 Epoch 43 - loss=17.1741 42-10 Epoch 43 - loss=21.8767 42-11 Epoch 43 - loss=20.8043 42-12 Epoch 43 - loss=23.6859 42-13 Epoch 43 - loss=20.2129 42-14 Epoch 43 - loss=11.2905 precision : [0.09027712541099071, 0.07759511507750066, 0.06967277281979035, 0.06651009863785799] recall : [0.02256928135274768, 0.03879755753875033, 0.05225457961484228, 0.06651009863785799] MAP : [0.05222483168936903, 0.034933794090675256, 0.026999742598615307, 0.02291482545032592] ndcg : [0.09137652133747243, 0.08229468640786868, 0.07590368150526246, 0.07275418936515136] 43 43-0 Epoch 44 - loss=35.9051 43-1 Epoch 44 - loss=26.1727 43-2 Epoch 44 - loss=20.1484 43-3 Epoch 44 - loss=19.1559 43-4 Epoch 44 - loss=19.7056 43-5 Epoch 44 - loss=17.3436 43-6 Epoch 44 - loss=18.2709 43-7 Epoch 44 - loss=17.0312 43-8 Epoch 44 - loss=15.5512 43-9 Epoch 44 - loss=17.3966 43-10 Epoch 44 - loss=20.5162 43-11 Epoch 44 - loss=20.1015 43-12 Epoch 44 - loss=20.2794 43-13 Epoch 44 - loss=17.8342 43-14 Epoch 44 - loss=10.4929 precision : [0.0901831845937056, 0.07891028651949226, 0.07330515108814785, 0.06794269610145605] recall : [0.0225457961484264, 0.03945514325974613, 0.05497886331611051, 0.06794269610145605] MAP : [0.05238296539846564, 0.03557365407412378, 0.028077054462681515, 0.023439229444633402] ndcg : [0.09203655173418353, 0.08360407689291093, 0.0787972786905793, 0.07428849652340173] 44 44-0 Epoch 45 - loss=35.1636 44-1 Epoch 45 - loss=28.3121 44-2 Epoch 45 - loss=18.6909 44-3 Epoch 45 - loss=20.0439 44-4 Epoch 45 - loss=21.5477 44-5 Epoch 45 - loss=21.9268 44-6 Epoch 45 - loss=19.0882 44-7 Epoch 45 - loss=18.0230 44-8 Epoch 45 - loss=17.9661 44-9 Epoch 45 - loss=19.3644 44-10 Epoch 45 - loss=18.0566 44-11 Epoch 45 - loss=17.2971 44-12 Epoch 45 - loss=19.8007 44-13 Epoch 45 - loss=19.9186 44-14 Epoch 45 - loss=10.0836 precision : [0.09309534992954392, 0.08069516204790916, 0.07355565993424137, 0.06909347111319855] recall : [0.02327383748238598, 0.04034758102395458, 0.055166744950680774, 0.06909347111319855] MAP : [0.0528401440425865, 0.03560101620106317, 0.02811673469963747, 0.02358610884979298] ndcg : [0.09379449685579332, 0.08484376935656104, 0.07911024873428077, 0.07519060898329205] 45 45-0 Epoch 46 - loss=30.0522 45-1 Epoch 46 - loss=27.6206 45-2 Epoch 46 - loss=21.8918 45-3 Epoch 46 - loss=20.8981 45-4 Epoch 46 - loss=19.5246 45-5 Epoch 46 - loss=21.1413 45-6 Epoch 46 - loss=18.6469 45-7 Epoch 46 - loss=16.9828 45-8 Epoch 46 - loss=15.9137 45-9 Epoch 46 - loss=16.6472 45-10 Epoch 46 - loss=20.7943 45-11 Epoch 46 - loss=19.9625 45-12 Epoch 46 - loss=20.7956 45-13 Epoch 46 - loss=19.0982 45-14 Epoch 46 - loss=10.4687 precision : [0.09112259276655674, 0.08210427430718578, 0.07496477219351819, 0.06942226397369654] recall : [0.022780648191639184, 0.04105213715359289, 0.0562235791451383, 0.06942226397369654] MAP : [0.048872710192578675, 0.034727385239362696, 0.02775996857725369, 0.02341493124634074] ndcg : [0.08825093036248402, 0.08299295575619785, 0.07803278539865749, 0.07380896213975156] 46 46-0 Epoch 47 - loss=33.0225 46-1 Epoch 47 - loss=29.2254 46-2 Epoch 47 - loss=20.6795 46-3 Epoch 47 - loss=21.2888 46-4 Epoch 47 - loss=21.5072 46-5 Epoch 47 - loss=19.6714 46-6 Epoch 47 - loss=20.4780 46-7 Epoch 47 - loss=19.0716 46-8 Epoch 47 - loss=14.9134 46-9 Epoch 47 - loss=17.4817 46-10 Epoch 47 - loss=20.2598 46-11 Epoch 47 - loss=21.0871 46-12 Epoch 47 - loss=19.5524 46-13 Epoch 47 - loss=16.9798 46-14 Epoch 47 - loss=10.5628 precision : [0.0928135274776887, 0.08318459370596451, 0.07671833411617347, 0.07038515735086898] recall : [0.023203381869422175, 0.041592296852982255, 0.05753875058712976, 0.07038515735086898] MAP : [0.05080475966807577, 0.03553367330962445, 0.02817846054576914, 0.02363881894868368] ndcg : [0.09164730884659289, 0.08540956437291065, 0.08056302519719166, 0.07566967785577233] 47 47-0 Epoch 48 - loss=31.9307 47-1 Epoch 48 - loss=27.4639 47-2 Epoch 48 - loss=20.6111 47-3 Epoch 48 - loss=18.2443 47-4 Epoch 48 - loss=20.0772 47-5 Epoch 48 - loss=20.4722 47-6 Epoch 48 - loss=19.2941 47-7 Epoch 48 - loss=17.2737 47-8 Epoch 48 - loss=16.1454 47-9 Epoch 48 - loss=14.5112 47-10 Epoch 48 - loss=20.6273 47-11 Epoch 48 - loss=20.5705 47-12 Epoch 48 - loss=19.0611 47-13 Epoch 48 - loss=16.7694 47-14 Epoch 48 - loss=11.1293 precision : [0.09431658055425043, 0.08341944574917735, 0.07665570690464998, 0.07047909816815412] recall : [0.02357914513856261, 0.04170972287458868, 0.057491780178487176, 0.07047909816815412] MAP : [0.055229372162204485, 0.03807609578981115, 0.02959783766500535, 0.02459168537754358] ndcg : [0.09677934899008425, 0.08839407838277027, 0.08270877916354868, 0.07755102175152041] 48 48-0 Epoch 49 - loss=28.5434 48-1 Epoch 49 - loss=31.8716 48-2 Epoch 49 - loss=21.4690 48-3 Epoch 49 - loss=19.7980 48-4 Epoch 49 - loss=19.9022 48-5 Epoch 49 - loss=19.1307 48-6 Epoch 49 - loss=20.1943 48-7 Epoch 49 - loss=19.9345 48-8 Epoch 49 - loss=15.8638 48-9 Epoch 49 - loss=16.2120 48-10 Epoch 49 - loss=21.6250 48-11 Epoch 49 - loss=20.0801 48-12 Epoch 49 - loss=19.9233 48-13 Epoch 49 - loss=19.3154 48-14 Epoch 49 - loss=12.4422 precision : [0.09469234382339091, 0.08219821512447113, 0.07252231094410529, 0.06730859558478147] recall : [0.023673085955847727, 0.041099107562235566, 0.0543917332080786, 0.06730859558478147] MAP : [0.05657116016909347, 0.038357731851156, 0.0294684219977785, 0.024478333038800894] ndcg : [0.09730307792683128, 0.08774286418206872, 0.0800130549448402, 0.07527068270592095] 49 49-0 Epoch 50 - loss=29.0723 49-1 Epoch 50 - loss=26.1760 49-2 Epoch 50 - loss=20.0364 49-3 Epoch 50 - loss=19.6363 49-4 Epoch 50 - loss=21.2898 49-5 Epoch 50 - loss=17.8474 49-6 Epoch 50 - loss=19.9874 49-7 Epoch 50 - loss=16.1134 49-8 Epoch 50 - loss=16.0344 49-9 Epoch 50 - loss=17.2172 49-10 Epoch 50 - loss=21.4752 49-11 Epoch 50 - loss=19.1697 49-12 Epoch 50 - loss=19.9056 49-13 Epoch 50 - loss=17.1157 49-14 Epoch 50 - loss=10.8116 precision : [0.08952559887270983, 0.07623297322686653, 0.06898387349303275, 0.06467825270079824] recall : [0.022381399718177458, 0.03811648661343327, 0.0517379051197742, 0.06467825270079824] MAP : [0.05405041490527634, 0.036040506385738885, 0.028057404210527742, 0.02339664892283565] ndcg : [0.09391198326051303, 0.08301086867580156, 0.0766260967533029, 0.07245018996007553] 50 50-0 Epoch 51 - loss=33.9100 50-1 Epoch 51 - loss=27.6670 50-2 Epoch 51 - loss=19.4751 50-3 Epoch 51 - loss=18.4359 50-4 Epoch 51 - loss=20.2481 50-5 Epoch 51 - loss=19.0688 50-6 Epoch 51 - loss=21.1738 50-7 Epoch 51 - loss=15.6010 50-8 Epoch 51 - loss=16.5068 50-9 Epoch 51 - loss=19.6860 50-10 Epoch 51 - loss=19.7668 50-11 Epoch 51 - loss=18.3145 50-12 Epoch 51 - loss=18.8588 50-13 Epoch 51 - loss=16.5764 50-14 Epoch 51 - loss=10.5560 precision : [0.09018318459370563, 0.0767966181305772, 0.0700485360889307, 0.06514795678722382] recall : [0.022545796148426406, 0.0383983090652886, 0.05253640206669766, 0.06514795678722382] MAP : [0.0527133239392516, 0.03499703639088327, 0.027522722306658427, 0.023029729617687525] ndcg : [0.0932704632245346, 0.08284588728120965, 0.07693177678137764, 0.07249861677438399] 51 51-0 Epoch 52 - loss=31.3829 51-1 Epoch 52 - loss=25.9607 51-2 Epoch 52 - loss=19.0365 51-3 Epoch 52 - loss=19.1903 51-4 Epoch 52 - loss=19.9823 51-5 Epoch 52 - loss=17.8661 51-6 Epoch 52 - loss=17.7706 51-7 Epoch 52 - loss=17.6179 51-8 Epoch 52 - loss=16.1648 51-9 Epoch 52 - loss=16.8958 51-10 Epoch 52 - loss=21.0527 51-11 Epoch 52 - loss=19.7310 51-12 Epoch 52 - loss=18.8366 51-13 Epoch 52 - loss=16.5327 51-14 Epoch 52 - loss=9.7857 precision : [0.08980742132456516, 0.08060122123062409, 0.07177078440582436, 0.06613433536871755] recall : [0.02245185533114129, 0.040300610615312045, 0.053828088304367895, 0.06613433536871755] MAP : [0.05116643181462345, 0.03522806742863107, 0.027692851830944835, 0.023066560425032075] ndcg : [0.09151031001377777, 0.08448260048146848, 0.07765774096417954, 0.07290385442061827] 52 52-0 Epoch 53 - loss=33.5549 52-1 Epoch 53 - loss=26.3068 52-2 Epoch 53 - loss=17.5218 52-3 Epoch 53 - loss=18.6995 52-4 Epoch 53 - loss=18.0452 52-5 Epoch 53 - loss=19.2348 52-6 Epoch 53 - loss=17.4770 52-7 Epoch 53 - loss=15.3999 52-8 Epoch 53 - loss=15.2904 52-9 Epoch 53 - loss=15.9636 52-10 Epoch 53 - loss=20.3839 52-11 Epoch 53 - loss=20.2730 52-12 Epoch 53 - loss=17.6887 52-13 Epoch 53 - loss=17.0367 52-14 Epoch 53 - loss=10.2274 precision : [0.08914983560356947, 0.07806481916392605, 0.07058086738687955, 0.06634570220760908] recall : [0.022287458900892367, 0.03903240958196302, 0.05293565054015932, 0.06634570220760908] MAP : [0.05287615468921246, 0.03566446353083272, 0.027825198391191814, 0.023389542869669152] ndcg : [0.09287535520462657, 0.08393343219181647, 0.07757663576933868, 0.07357875359887711] 53 53-0 Epoch 54 - loss=30.7194 53-1 Epoch 54 - loss=25.6774 53-2 Epoch 54 - loss=19.1072 53-3 Epoch 54 - loss=19.8711 53-4 Epoch 54 - loss=19.2885 53-5 Epoch 54 - loss=17.7762 53-6 Epoch 54 - loss=18.4455 53-7 Epoch 54 - loss=16.1896 53-8 Epoch 54 - loss=15.0365 53-9 Epoch 54 - loss=16.9257 53-10 Epoch 54 - loss=17.4125 53-11 Epoch 54 - loss=18.6865 53-12 Epoch 54 - loss=16.7241 53-13 Epoch 54 - loss=15.8400 53-14 Epoch 54 - loss=10.1940 precision : [0.09093471113198642, 0.07970878346641544, 0.071269766713637, 0.06505401596993889] recall : [0.022733677782996606, 0.03985439173320772, 0.053452325035227434, 0.06505401596993889] MAP : [0.05414122436198529, 0.03671257464939945, 0.02833942400170676, 0.02341895437336617] ndcg : [0.09441270158453742, 0.08533544682276542, 0.07838513881710749, 0.07302079286802422] 54 54-0 Epoch 55 - loss=27.8138 54-1 Epoch 55 - loss=25.2779 54-2 Epoch 55 - loss=20.0691 54-3 Epoch 55 - loss=18.9521 54-4 Epoch 55 - loss=19.2255 54-5 Epoch 55 - loss=18.8162 54-6 Epoch 55 - loss=17.6609 54-7 Epoch 55 - loss=18.3984 54-8 Epoch 55 - loss=13.8270 54-9 Epoch 55 - loss=14.1997 54-10 Epoch 55 - loss=18.0136 54-11 Epoch 55 - loss=20.5849 54-12 Epoch 55 - loss=19.8364 54-13 Epoch 55 - loss=16.9899 54-14 Epoch 55 - loss=9.6484 precision : [0.09271958666040359, 0.08013151714419854, 0.07230311570377329, 0.06728511038046024] recall : [0.023179896665100896, 0.04006575857209927, 0.054227336777829635, 0.06728511038046024] MAP : [0.0557022076092062, 0.03688405391904687, 0.02869992653693922, 0.023971366806200014] ndcg : [0.09535285335704827, 0.08566601512745597, 0.07918368056856412, 0.07467333444104556] 55 55-0 Epoch 56 - loss=30.0554 55-1 Epoch 56 - loss=26.8037 55-2 Epoch 56 - loss=19.7466 55-3 Epoch 56 - loss=18.1810 55-4 Epoch 56 - loss=17.9986 55-5 Epoch 56 - loss=16.7348 55-6 Epoch 56 - loss=14.6244 55-7 Epoch 56 - loss=16.6340 55-8 Epoch 56 - loss=15.2341 55-9 Epoch 56 - loss=14.2794 55-10 Epoch 56 - loss=16.4018 55-11 Epoch 56 - loss=15.7688 55-12 Epoch 56 - loss=16.9845 55-13 Epoch 56 - loss=18.0077 55-14 Epoch 56 - loss=10.6788 precision : [0.08896195396899911, 0.07670267731329199, 0.07051824017535628, 0.06665100986378568] recall : [0.02224048849224978, 0.03835133865664599, 0.05288868013151682, 0.06665100986378568] MAP : [0.05571786441208705, 0.036954174029091826, 0.028772068267136377, 0.024029423154445693] ndcg : [0.0935812615677511, 0.08351707209837694, 0.07781391841911257, 0.07401040754274787] 56 56-0 Epoch 57 - loss=25.1247 56-1 Epoch 57 - loss=25.9667 56-2 Epoch 57 - loss=18.8376 56-3 Epoch 57 - loss=17.5956 56-4 Epoch 57 - loss=18.5957 56-5 Epoch 57 - loss=17.3161 56-6 Epoch 57 - loss=16.7911 56-7 Epoch 57 - loss=15.8307 56-8 Epoch 57 - loss=15.7764 56-9 Epoch 57 - loss=15.6141 56-10 Epoch 57 - loss=16.6479 56-11 Epoch 57 - loss=17.8698 56-12 Epoch 57 - loss=20.0678 56-13 Epoch 57 - loss=16.7508 56-14 Epoch 57 - loss=9.2816 precision : [0.09178017848755238, 0.08013151714419858, 0.07305464224205417, 0.06869422263973693] recall : [0.022945044621888094, 0.04006575857209929, 0.05479098168154038, 0.06869422263973693] MAP : [0.057012682010333486, 0.03821413660187733, 0.029809266373380976, 0.025020706769651024] ndcg : [0.09683758970597303, 0.0869409684408763, 0.08065590333003043, 0.07647542082280076] 57 57-0 Epoch 58 - loss=27.2875 57-1 Epoch 58 - loss=22.7842 57-2 Epoch 58 - loss=16.9737 57-3 Epoch 58 - loss=17.9574 57-4 Epoch 58 - loss=18.1642 57-5 Epoch 58 - loss=18.0020 57-6 Epoch 58 - loss=15.9301 57-7 Epoch 58 - loss=16.9187 57-8 Epoch 58 - loss=15.9450 57-9 Epoch 58 - loss=15.2002 57-10 Epoch 58 - loss=18.9943 57-11 Epoch 58 - loss=18.5894 57-12 Epoch 58 - loss=17.8048 57-13 Epoch 58 - loss=17.2983 57-14 Epoch 58 - loss=9.3485 precision : [0.09008924377642041, 0.07613903240958138, 0.06929700955064974, 0.0653593236261154] recall : [0.022522310944105103, 0.03806951620479069, 0.05197275716298707, 0.0653593236261154] MAP : [0.056182871457648345, 0.036848546526799225, 0.028541368691673997, 0.023879311290955482] ndcg : [0.09521230263247239, 0.08370358926228592, 0.0774149026221865, 0.07343579372649539] 58 58-0 Epoch 59 - loss=27.3674 58-1 Epoch 59 - loss=24.0383 58-2 Epoch 59 - loss=18.2016 58-3 Epoch 59 - loss=17.4901 58-4 Epoch 59 - loss=17.2555 58-5 Epoch 59 - loss=15.8574 58-6 Epoch 59 - loss=17.2204 58-7 Epoch 59 - loss=14.7263 58-8 Epoch 59 - loss=15.4423 58-9 Epoch 59 - loss=15.6387 58-10 Epoch 59 - loss=18.0264 58-11 Epoch 59 - loss=16.6040 58-12 Epoch 59 - loss=19.6820 58-13 Epoch 59 - loss=15.6250 58-14 Epoch 59 - loss=10.7359 precision : [0.093189290746829, 0.07900422733677717, 0.07227180209801158, 0.06794269610145603] recall : [0.02329732268670725, 0.039502113668388586, 0.05420385157350834, 0.06794269610145603] MAP : [0.057188038202599024, 0.03805870555518277, 0.029577125377970845, 0.024649848815993185] ndcg : [0.09895417176447818, 0.08705570269987252, 0.08070866215644484, 0.0764024908860571] 59 59-0 Epoch 60 - loss=21.1292 59-1 Epoch 60 - loss=24.0207 59-2 Epoch 60 - loss=17.1098 59-3 Epoch 60 - loss=16.7266 59-4 Epoch 60 - loss=18.9163 59-5 Epoch 60 - loss=15.5024 59-6 Epoch 60 - loss=17.9535 59-7 Epoch 60 - loss=15.4580 59-8 Epoch 60 - loss=13.6326 59-9 Epoch 60 - loss=15.9429 59-10 Epoch 60 - loss=16.4607 59-11 Epoch 60 - loss=16.3167 59-12 Epoch 60 - loss=15.2043 59-13 Epoch 60 - loss=17.1139 59-14 Epoch 60 - loss=9.6451 precision : [0.09084077031470134, 0.079755753875058, 0.07227180209801154, 0.06766087364960054] recall : [0.022710192578675334, 0.039877876937529, 0.054203851573508315, 0.06766087364960054] MAP : [0.057134805072804135, 0.038544793367480075, 0.029840577024701026, 0.024940948674722616] ndcg : [0.09689802141652729, 0.0871545648665597, 0.08043687997483329, 0.07598904343419688] 60 60-0 Epoch 61 - loss=25.3332 60-1 Epoch 61 - loss=21.8188 60-2 Epoch 61 - loss=17.3657 60-3 Epoch 61 - loss=18.0817 60-4 Epoch 61 - loss=17.6235 60-5 Epoch 61 - loss=17.1245 60-6 Epoch 61 - loss=15.9564 60-7 Epoch 61 - loss=15.2316 60-8 Epoch 61 - loss=15.2122 60-9 Epoch 61 - loss=14.7837 60-10 Epoch 61 - loss=16.0709 60-11 Epoch 61 - loss=17.6873 60-12 Epoch 61 - loss=16.0509 60-13 Epoch 61 - loss=14.7373 60-14 Epoch 61 - loss=7.5232 precision : [0.08961953968999492, 0.08050728041333884, 0.07480820416470954, 0.06996242367308585] recall : [0.02240488492249873, 0.04025364020666942, 0.05610615312353179, 0.06996242367308585] MAP : [0.05724596837325818, 0.038274676239683295, 0.030036788794421482, 0.025167285440689028] ndcg : [0.09561506620771303, 0.08712580539777447, 0.08184240643856648, 0.07742101268687454] 61 61-0 Epoch 62 - loss=23.3919 61-1 Epoch 62 - loss=23.7142 61-2 Epoch 62 - loss=16.0891 61-3 Epoch 62 - loss=16.4288 61-4 Epoch 62 - loss=18.0214 61-5 Epoch 62 - loss=14.2893 61-6 Epoch 62 - loss=15.2894 61-7 Epoch 62 - loss=13.4758 61-8 Epoch 62 - loss=14.5416 61-9 Epoch 62 - loss=15.9500 61-10 Epoch 62 - loss=18.9642 61-11 Epoch 62 - loss=16.4824 61-12 Epoch 62 - loss=17.7881 61-13 Epoch 62 - loss=17.5817 61-14 Epoch 62 - loss=8.7671 precision : [0.08980742132456514, 0.07937999060591754, 0.07321121027086257, 0.06925786754344758] recall : [0.022451855331141284, 0.03968999530295877, 0.05490840770314663, 0.06925786754344758] MAP : [0.05501330828244873, 0.03720787015291478, 0.02925802013166973, 0.024572224238172655] ndcg : [0.09263715026401756, 0.08443087076296854, 0.0791668637233644, 0.07553071052052833] 62 62-0 Epoch 63 - loss=20.4138 62-1 Epoch 63 - loss=22.7129 62-2 Epoch 63 - loss=15.6466 62-3 Epoch 63 - loss=13.9407 62-4 Epoch 63 - loss=16.0936 62-5 Epoch 63 - loss=15.5527 62-6 Epoch 63 - loss=15.2137 62-7 Epoch 63 - loss=13.4911 62-8 Epoch 63 - loss=18.7011 62-9 Epoch 63 - loss=15.5970 62-10 Epoch 63 - loss=17.8360 62-11 Epoch 63 - loss=16.4361 62-12 Epoch 63 - loss=15.3005 62-13 Epoch 63 - loss=15.5451 62-14 Epoch 63 - loss=8.1206 precision : [0.08708313762329703, 0.07778299671207076, 0.07227180209801151, 0.06726162517613894] recall : [0.021770784405824258, 0.03889149835603538, 0.054203851573508224, 0.06726162517613894] MAP : [0.054011272898074204, 0.03723730121452057, 0.029163895704525107, 0.02429811994843834] ndcg : [0.09164338402487084, 0.08355894721689654, 0.07855099815038835, 0.07415270464697182] 63 63-0 Epoch 64 - loss=21.1620 63-1 Epoch 64 - loss=22.7019 63-2 Epoch 64 - loss=16.4030 63-3 Epoch 64 - loss=15.0750 63-4 Epoch 64 - loss=18.1630 63-5 Epoch 64 - loss=17.2921 63-6 Epoch 64 - loss=15.3530 63-7 Epoch 64 - loss=15.5375 63-8 Epoch 64 - loss=15.1202 63-9 Epoch 64 - loss=14.8497 63-10 Epoch 64 - loss=17.1354 63-11 Epoch 64 - loss=17.5599 63-12 Epoch 64 - loss=18.2238 63-13 Epoch 64 - loss=13.7302 63-14 Epoch 64 - loss=8.8960 precision : [0.0883983090652886, 0.07923907937999, 0.07277281979019867, 0.06815406294034757] recall : [0.02209957726632215, 0.039619539689995, 0.05457961484264884, 0.06815406294034757] MAP : [0.055827462032253014, 0.03807553661827969, 0.029885600630081603, 0.025017792985765674] ndcg : [0.09263497539585812, 0.08479607426527747, 0.07920415459910107, 0.0750421328668419] 64 64-0 Epoch 65 - loss=24.6308 64-1 Epoch 65 - loss=21.6066 64-2 Epoch 65 - loss=17.4787 64-3 Epoch 65 - loss=15.7143 64-4 Epoch 65 - loss=16.9177 64-5 Epoch 65 - loss=15.8733 64-6 Epoch 65 - loss=15.3834 64-7 Epoch 65 - loss=15.1083 64-8 Epoch 65 - loss=14.7898 64-9 Epoch 65 - loss=13.8633 64-10 Epoch 65 - loss=15.6944 64-11 Epoch 65 - loss=17.2020 64-12 Epoch 65 - loss=15.4023 64-13 Epoch 65 - loss=12.6907 64-14 Epoch 65 - loss=8.4789 precision : [0.08990136214185034, 0.08027242837012621, 0.07314858305933916, 0.0674260216063879] recall : [0.022475340535462584, 0.04013621418506311, 0.05486143729450412, 0.0674260216063879] MAP : [0.05493345858775639, 0.03762176892050072, 0.029261391323392262, 0.02434174448428713] ndcg : [0.09180436545729091, 0.08442074135644649, 0.07864951617298702, 0.07390578323663555] 65 65-0 Epoch 66 - loss=21.0502 65-1 Epoch 66 - loss=19.4201 65-2 Epoch 66 - loss=14.9924 65-3 Epoch 66 - loss=16.2090 65-4 Epoch 66 - loss=16.5838 65-5 Epoch 66 - loss=14.2217 65-6 Epoch 66 - loss=14.1212 65-7 Epoch 66 - loss=13.6959 65-8 Epoch 66 - loss=14.0387 65-9 Epoch 66 - loss=15.4786 65-10 Epoch 66 - loss=17.3229 65-11 Epoch 66 - loss=15.6976 65-12 Epoch 66 - loss=18.8301 65-13 Epoch 66 - loss=16.4200 65-14 Epoch 66 - loss=8.2163 precision : [0.0889619539689992, 0.08069516204790923, 0.0738687959918583, 0.06820103334899012] recall : [0.0222404884922498, 0.040347581023954616, 0.055401596993893486, 0.06820103334899012] MAP : [0.054230468138406145, 0.037861224809322504, 0.029555183348043846, 0.024547828532308847] ndcg : [0.09084893920399331, 0.08453473031203212, 0.07909279558328598, 0.07443968354020879] 66 66-0 Epoch 67 - loss=19.6752 66-1 Epoch 67 - loss=20.2449 66-2 Epoch 67 - loss=16.0197 66-3 Epoch 67 - loss=16.1341 66-4 Epoch 67 - loss=14.9897 66-5 Epoch 67 - loss=14.4243 66-6 Epoch 67 - loss=14.0440 66-7 Epoch 67 - loss=12.1076 66-8 Epoch 67 - loss=12.8280 66-9 Epoch 67 - loss=15.1118 66-10 Epoch 67 - loss=15.5905 66-11 Epoch 67 - loss=16.7053 66-12 Epoch 67 - loss=17.4431 66-13 Epoch 67 - loss=15.0519 66-14 Epoch 67 - loss=8.3345 precision : [0.08717707844058221, 0.07778299671207091, 0.07080006262721147, 0.06580554250821964] recall : [0.021794269610145554, 0.038891498356035455, 0.05310004697040832, 0.06580554250821964] MAP : [0.05557851886644747, 0.038119729808316, 0.02976460155887117, 0.02465593802123601] ndcg : [0.09171237909380321, 0.08361448419631909, 0.0776076034037048, 0.07314091815442726] 67 67-0 Epoch 68 - loss=20.8586 67-1 Epoch 68 - loss=19.4212 67-2 Epoch 68 - loss=18.4601 67-3 Epoch 68 - loss=17.2452 67-4 Epoch 68 - loss=16.7029 67-5 Epoch 68 - loss=14.4567 67-6 Epoch 68 - loss=16.8012 67-7 Epoch 68 - loss=12.8832 67-8 Epoch 68 - loss=13.3701 67-9 Epoch 68 - loss=12.8580 67-10 Epoch 68 - loss=17.0455 67-11 Epoch 68 - loss=15.4698 67-12 Epoch 68 - loss=14.0472 67-13 Epoch 68 - loss=15.2757 67-14 Epoch 68 - loss=9.2895 precision : [0.08219821512447151, 0.07458900892437716, 0.06885861906998592, 0.06420854861437277] recall : [0.020549553781117877, 0.03729450446218858, 0.051643964302489166, 0.06420854861437277] MAP : [0.050923751369970245, 0.03517805885466759, 0.02768200633630413, 0.02319282719220752] ndcg : [0.08525719846224021, 0.07888020942360693, 0.07405647566379443, 0.07007039431490694] 68 68-0 Epoch 69 - loss=21.4331 68-1 Epoch 69 - loss=19.3001 68-2 Epoch 69 - loss=17.4565 68-3 Epoch 69 - loss=14.6358 68-4 Epoch 69 - loss=17.1886 68-5 Epoch 69 - loss=11.9981 68-6 Epoch 69 - loss=16.0466 68-7 Epoch 69 - loss=14.7417 68-8 Epoch 69 - loss=13.6856 68-9 Epoch 69 - loss=12.7720 68-10 Epoch 69 - loss=16.5777 68-11 Epoch 69 - loss=14.7762 68-12 Epoch 69 - loss=14.8773 68-13 Epoch 69 - loss=15.7521 68-14 Epoch 69 - loss=7.5329 precision : [0.08764678252700778, 0.07674964772193468, 0.06907781431031793, 0.06493658994833242] recall : [0.021911695631751944, 0.03837482386096734, 0.05180836073273806, 0.06493658994833242] MAP : [0.053497729763582275, 0.036507619644068685, 0.02831880929814232, 0.023734798323247385] ndcg : [0.09028910226345761, 0.08164561510350311, 0.07540268447899641, 0.07158093194100992] 69 69-0 Epoch 70 - loss=19.8960 69-1 Epoch 70 - loss=18.6554 69-2 Epoch 70 - loss=15.2037 69-3 Epoch 70 - loss=14.0811 69-4 Epoch 70 - loss=16.9819 69-5 Epoch 70 - loss=15.2726 69-6 Epoch 70 - loss=14.8197 69-7 Epoch 70 - loss=13.3753 69-8 Epoch 70 - loss=12.8880 69-9 Epoch 70 - loss=12.0176 69-10 Epoch 70 - loss=15.6111 69-11 Epoch 70 - loss=14.5910 69-12 Epoch 70 - loss=13.2971 69-13 Epoch 70 - loss=15.1726 69-14 Epoch 70 - loss=8.8983 precision : [0.08914983560356948, 0.07895725692813484, 0.07033035854078605, 0.06561766087364941] recall : [0.02228745890089237, 0.03947862846406742, 0.052747768905589174, 0.06561766087364941] MAP : [0.0567793956474088, 0.03877489245267545, 0.02996383537482645, 0.024857431947396095] ndcg : [0.09527568506173299, 0.08602518779704087, 0.07862037850201854, 0.07407412061552653] 70 70-0 Epoch 71 - loss=18.7311 70-1 Epoch 71 - loss=17.3917 70-2 Epoch 71 - loss=15.3820 70-3 Epoch 71 - loss=13.2404 70-4 Epoch 71 - loss=15.4669 70-5 Epoch 71 - loss=14.0690 70-6 Epoch 71 - loss=15.4359 70-7 Epoch 71 - loss=14.2560 70-8 Epoch 71 - loss=13.7903 70-9 Epoch 71 - loss=13.3273 70-10 Epoch 71 - loss=15.5957 70-11 Epoch 71 - loss=15.1511 70-12 Epoch 71 - loss=14.1684 70-13 Epoch 71 - loss=13.6964 70-14 Epoch 71 - loss=8.1316 precision : [0.08558008454673531, 0.07825270079849646, 0.07045561296383276, 0.0661108501643963] recall : [0.021395021136683828, 0.03912635039924823, 0.052841709722874275, 0.0661108501643963] MAP : [0.05500704556129639, 0.038145619450222545, 0.02980447374763955, 0.024994112230705304] ndcg : [0.09233665979804445, 0.08483395900749185, 0.07807919605704837, 0.07390719982727142] 71 71-0 Epoch 72 - loss=19.9122 71-1 Epoch 72 - loss=20.7804 71-2 Epoch 72 - loss=15.7627 71-3 Epoch 72 - loss=15.6314 71-4 Epoch 72 - loss=15.3730 71-5 Epoch 72 - loss=13.7056 71-6 Epoch 72 - loss=12.7888 71-7 Epoch 72 - loss=13.8864 71-8 Epoch 72 - loss=12.9029 71-9 Epoch 72 - loss=12.4780 71-10 Epoch 72 - loss=15.2589 71-11 Epoch 72 - loss=15.6850 71-12 Epoch 72 - loss=13.7192 71-13 Epoch 72 - loss=11.3300 71-14 Epoch 72 - loss=8.3100 precision : [0.08586190699859066, 0.0763738844527943, 0.07073743541568807, 0.06554720526068558] recall : [0.021465476749647664, 0.03818694222639715, 0.05305307656176577, 0.06554720526068558] MAP : [0.0564944418349773, 0.037870003802366416, 0.02974762151370888, 0.024803393166622573] ndcg : [0.09283321660895268, 0.0837164797616448, 0.07826102140415266, 0.07353872925136351] 72 72-0 Epoch 73 - loss=19.4306 72-1 Epoch 73 - loss=18.3905 72-2 Epoch 73 - loss=15.4421 72-3 Epoch 73 - loss=14.8394 72-4 Epoch 73 - loss=16.8969 72-5 Epoch 73 - loss=14.0908 72-6 Epoch 73 - loss=13.2302 72-7 Epoch 73 - loss=13.4620 72-8 Epoch 73 - loss=12.0135 72-9 Epoch 73 - loss=15.3013 72-10 Epoch 73 - loss=16.2968 72-11 Epoch 73 - loss=14.8751 72-12 Epoch 73 - loss=14.0443 72-13 Epoch 73 - loss=12.6245 72-14 Epoch 73 - loss=7.6902 precision : [0.08586190699859074, 0.0751996242367304, 0.06995459527164556, 0.06491310474401113] recall : [0.021465476749647685, 0.0375998121183652, 0.052465946453733876, 0.06491310474401113] MAP : [0.05641615782057305, 0.03764887010072543, 0.029682274999325253, 0.024721843104331467] ndcg : [0.09225033870370959, 0.08263748184086302, 0.07744096103056415, 0.07282122613672519] 73 73-0 Epoch 74 - loss=18.7764 73-1 Epoch 74 - loss=17.8157 73-2 Epoch 74 - loss=14.8690 73-3 Epoch 74 - loss=13.6687 73-4 Epoch 74 - loss=13.3577 73-5 Epoch 74 - loss=14.5298 73-6 Epoch 74 - loss=13.1420 73-7 Epoch 74 - loss=13.4440 73-8 Epoch 74 - loss=11.9504 73-9 Epoch 74 - loss=13.0064 73-10 Epoch 74 - loss=15.5636 73-11 Epoch 74 - loss=14.8455 73-12 Epoch 74 - loss=15.0265 73-13 Epoch 74 - loss=13.2895 73-14 Epoch 74 - loss=7.9651 precision : [0.08576796618130564, 0.07595115077501127, 0.06845154219508384, 0.06352747768905566] recall : [0.02144199154532641, 0.037975575387505636, 0.05133865664631253, 0.06352747768905566] MAP : [0.05521214967903554, 0.037511537572599105, 0.029024907733221497, 0.023999887102449824] ndcg : [0.09044379407917445, 0.08205039477910073, 0.07560961588680033, 0.07111590669735489] 74 74-0 Epoch 75 - loss=19.1593 74-1 Epoch 75 - loss=17.7009 74-2 Epoch 75 - loss=15.0107 74-3 Epoch 75 - loss=13.6764 74-4 Epoch 75 - loss=14.6044 74-5 Epoch 75 - loss=15.6614 74-6 Epoch 75 - loss=16.0736 74-7 Epoch 75 - loss=15.9295 74-8 Epoch 75 - loss=12.7937 74-9 Epoch 75 - loss=12.6261 74-10 Epoch 75 - loss=13.7675 74-11 Epoch 75 - loss=14.9402 74-12 Epoch 75 - loss=13.4708 74-13 Epoch 75 - loss=14.1141 74-14 Epoch 75 - loss=8.5240 precision : [0.08379520901831829, 0.07313292625645804, 0.06704242993580731, 0.062963832785345] recall : [0.02094880225457957, 0.03656646312822902, 0.050281822451854995, 0.062963832785345] MAP : [0.055024268044465315, 0.0363935300126, 0.028347238760578358, 0.023649012801125125] ndcg : [0.0899478504232916, 0.08047569437979647, 0.07474816154707088, 0.07073739493338022] 75 75-0 Epoch 76 - loss=16.9472 75-1 Epoch 76 - loss=17.3557 75-2 Epoch 76 - loss=15.0754 75-3 Epoch 76 - loss=13.3828 75-4 Epoch 76 - loss=14.3582 75-5 Epoch 76 - loss=12.1760 75-6 Epoch 76 - loss=13.1950 75-7 Epoch 76 - loss=11.3661 75-8 Epoch 76 - loss=12.1812 75-9 Epoch 76 - loss=12.6500 75-10 Epoch 76 - loss=14.5739 75-11 Epoch 76 - loss=13.3707 75-12 Epoch 76 - loss=16.2489 75-13 Epoch 76 - loss=15.7981 75-14 Epoch 76 - loss=9.1335 precision : [0.087834664161578, 0.07548144668858575, 0.06954751839674346, 0.06561766087364952] recall : [0.0219586660403945, 0.037740723344292876, 0.0521606387975572, 0.06561766087364952] MAP : [0.056755910443087525, 0.037599551171650744, 0.029159792419538783, 0.02451326967734982] ndcg : [0.09349276560525695, 0.08288331983803585, 0.07723783657826262, 0.073330282951494] 76 76-0 Epoch 77 - loss=16.6068 76-1 Epoch 77 - loss=16.0766 76-2 Epoch 77 - loss=12.6496 76-3 Epoch 77 - loss=16.5962 76-4 Epoch 77 - loss=15.3888 76-5 Epoch 77 - loss=12.1552 76-6 Epoch 77 - loss=14.4086 76-7 Epoch 77 - loss=13.0306 76-8 Epoch 77 - loss=11.8998 76-9 Epoch 77 - loss=13.6837 76-10 Epoch 77 - loss=13.1649 76-11 Epoch 77 - loss=12.8612 76-12 Epoch 77 - loss=14.1952 76-13 Epoch 77 - loss=12.1261 76-14 Epoch 77 - loss=7.2100 precision : [0.08717707844058223, 0.07623297322686656, 0.06976671363707544, 0.06498356035697496] recall : [0.021794269610145557, 0.03811648661343328, 0.05232503522780614, 0.06498356035697496] MAP : [0.05600594958509472, 0.03759675531399346, 0.0292457896121588, 0.024376788512667506] ndcg : [0.09344614550141946, 0.08357764887370464, 0.0775379140423561, 0.07304870338831237] 77 77-0 Epoch 78 - loss=16.0239 77-1 Epoch 78 - loss=13.6255 77-2 Epoch 78 - loss=13.8926 77-3 Epoch 78 - loss=12.9607 77-4 Epoch 78 - loss=14.4460 77-5 Epoch 78 - loss=14.1541 77-6 Epoch 78 - loss=15.2146 77-7 Epoch 78 - loss=12.8751 77-8 Epoch 78 - loss=11.5893 77-9 Epoch 78 - loss=12.0401 77-10 Epoch 78 - loss=14.3575 77-11 Epoch 78 - loss=13.8928 77-12 Epoch 78 - loss=12.2017 77-13 Epoch 78 - loss=13.4933 77-14 Epoch 78 - loss=8.3269 precision : [0.0837952090183185, 0.07552841709722825, 0.06892124628150942, 0.06456082667919198] recall : [0.020948802254579624, 0.03776420854861413, 0.051690934711131675, 0.06456082667919198] MAP : [0.05479567872240489, 0.036797494165977024, 0.028740999706241607, 0.023975992587771618] ndcg : [0.09077805690138391, 0.08252700897056464, 0.07651064588551908, 0.07233382802205977] 78 78-0 Epoch 79 - loss=17.3986 78-1 Epoch 79 - loss=14.5583 78-2 Epoch 79 - loss=13.7972 78-3 Epoch 79 - loss=14.1665 78-4 Epoch 79 - loss=14.2666 78-5 Epoch 79 - loss=12.2621 78-6 Epoch 79 - loss=11.5513 78-7 Epoch 79 - loss=14.3166 78-8 Epoch 79 - loss=13.7523 78-9 Epoch 79 - loss=12.0917 78-10 Epoch 79 - loss=13.1372 78-11 Epoch 79 - loss=14.2305 78-12 Epoch 79 - loss=12.2941 78-13 Epoch 79 - loss=13.9568 78-14 Epoch 79 - loss=7.8685 precision : [0.08285580084546726, 0.07482386096759007, 0.06857679661813067, 0.06460779708783457] recall : [0.020713950211366815, 0.037411930483795035, 0.051432597463597664, 0.06460779708783457] MAP : [0.05189134178800688, 0.03577624191997137, 0.02814890135698027, 0.023688245196163457] ndcg : [0.08793330433569428, 0.08050956642056231, 0.07502243234195939, 0.07128736587384607] 79 79-0 Epoch 80 - loss=15.9523 79-1 Epoch 80 - loss=15.3309 79-2 Epoch 80 - loss=12.6650 79-3 Epoch 80 - loss=14.4937 79-4 Epoch 80 - loss=15.3643 79-5 Epoch 80 - loss=14.9440 79-6 Epoch 80 - loss=14.8930 79-7 Epoch 80 - loss=13.0816 79-8 Epoch 80 - loss=11.6150 79-9 Epoch 80 - loss=9.8027 79-10 Epoch 80 - loss=13.3439 79-11 Epoch 80 - loss=13.6506 79-12 Epoch 80 - loss=12.8593 79-13 Epoch 80 - loss=13.5804 79-14 Epoch 80 - loss=8.0332 precision : [0.08680131517144184, 0.07566932832315597, 0.07058086738687969, 0.06460779708783447] recall : [0.02170032879286046, 0.037834664161577984, 0.05293565054015938, 0.06460779708783447] MAP : [0.05533114138093002, 0.037182931102611706, 0.02942897802925985, 0.02435904266123598] ndcg : [0.09206346605698623, 0.08255014410499516, 0.07758981024392234, 0.0724225896921399] 80 80-0 Epoch 81 - loss=13.9302 80-1 Epoch 81 - loss=13.6800 80-2 Epoch 81 - loss=14.4780 80-3 Epoch 81 - loss=11.0587 80-4 Epoch 81 - loss=13.2671 80-5 Epoch 81 - loss=13.3485 80-6 Epoch 81 - loss=15.2323 80-7 Epoch 81 - loss=13.4952 80-8 Epoch 81 - loss=12.4714 80-9 Epoch 81 - loss=12.7795 80-10 Epoch 81 - loss=13.5979 80-11 Epoch 81 - loss=15.6055 80-12 Epoch 81 - loss=12.1069 80-13 Epoch 81 - loss=13.4788 80-14 Epoch 81 - loss=8.4199 precision : [0.08069516204790975, 0.07332080789102817, 0.0666353530609051, 0.06275246594645359] recall : [0.020173790511977437, 0.036660403945514085, 0.04997651479567839, 0.06275246594645359] MAP : [0.05231094410521371, 0.035565918867938605, 0.027832993511715916, 0.023341622876454055] ndcg : [0.08612436406347754, 0.07902361926294657, 0.07326199255711281, 0.06955233997460918] 81 81-0 Epoch 82 - loss=15.6319 81-1 Epoch 82 - loss=17.2896 81-2 Epoch 82 - loss=12.8586 81-3 Epoch 82 - loss=12.9820 81-4 Epoch 82 - loss=13.4380 81-5 Epoch 82 - loss=11.8575 81-6 Epoch 82 - loss=11.6808 81-7 Epoch 82 - loss=12.4680 81-8 Epoch 82 - loss=10.9308 81-9 Epoch 82 - loss=12.3435 81-10 Epoch 82 - loss=13.5120 81-11 Epoch 82 - loss=13.4460 81-12 Epoch 82 - loss=12.1208 81-13 Epoch 82 - loss=12.5411 81-14 Epoch 82 - loss=6.2252 precision : [0.08013151714419908, 0.0709253170502579, 0.06525755440739017, 0.062024424612493856] recall : [0.02003287928604977, 0.03546265852512895, 0.04894316580554221, 0.062024424612493856] MAP : [0.05110693596367622, 0.03453022135737025, 0.027128045310290498, 0.022939776767298848] ndcg : [0.08473354382420219, 0.07672286457018676, 0.07162203306142596, 0.06840035769537173] 82 82-0 Epoch 83 - loss=15.7079 82-1 Epoch 83 - loss=15.8079 82-2 Epoch 83 - loss=14.1122 82-3 Epoch 83 - loss=13.2910 82-4 Epoch 83 - loss=13.1853 82-5 Epoch 83 - loss=12.4166 82-6 Epoch 83 - loss=13.1691 82-7 Epoch 83 - loss=11.8037 82-8 Epoch 83 - loss=11.3632 82-9 Epoch 83 - loss=12.1904 82-10 Epoch 83 - loss=13.1793 82-11 Epoch 83 - loss=13.1452 82-12 Epoch 83 - loss=13.3860 82-13 Epoch 83 - loss=13.0406 82-14 Epoch 83 - loss=7.3769 precision : [0.08435885392202894, 0.071441991545326, 0.06726162517613914, 0.06303428839830884] recall : [0.021089713480507234, 0.035720995772663, 0.05044621888210392, 0.06303428839830884] MAP : [0.05284327540316267, 0.03526586742415771, 0.02798989626138522, 0.023454946147796578] ndcg : [0.08846819641357571, 0.07796207189124855, 0.07369986248522908, 0.06978909212641217] 83 83-0 Epoch 84 - loss=14.8794 83-1 Epoch 84 - loss=13.8170 83-2 Epoch 84 - loss=12.1922 83-3 Epoch 84 - loss=13.3615 83-4 Epoch 84 - loss=14.0955 83-5 Epoch 84 - loss=13.9567 83-6 Epoch 84 - loss=11.4339 83-7 Epoch 84 - loss=13.3613 83-8 Epoch 84 - loss=9.2968 83-9 Epoch 84 - loss=10.6813 83-10 Epoch 84 - loss=12.0799 83-11 Epoch 84 - loss=13.4977 83-12 Epoch 84 - loss=12.4475 83-13 Epoch 84 - loss=11.5285 83-14 Epoch 84 - loss=6.9204 precision : [0.08285580084546719, 0.07289807421324523, 0.06710505714733059, 0.06305777360263007] recall : [0.020713950211366797, 0.03644903710662262, 0.05032879286049751, 0.06305777360263007] MAP : [0.05285423516517927, 0.036038157865306765, 0.028255705987035248, 0.023631629757758937] ndcg : [0.08805516620016858, 0.0792797995570717, 0.07393313236564293, 0.07008123445437499] 84 84-0 Epoch 85 - loss=15.7088 84-1 Epoch 85 - loss=15.2520 84-2 Epoch 85 - loss=12.8376 84-3 Epoch 85 - loss=13.1460 84-4 Epoch 85 - loss=13.4314 84-5 Epoch 85 - loss=13.1725 84-6 Epoch 85 - loss=12.5990 84-7 Epoch 85 - loss=11.2419 84-8 Epoch 85 - loss=10.0617 84-9 Epoch 85 - loss=11.9307 84-10 Epoch 85 - loss=14.2530 84-11 Epoch 85 - loss=13.0821 84-12 Epoch 85 - loss=12.2263 84-13 Epoch 85 - loss=11.5992 84-14 Epoch 85 - loss=7.6226 precision : [0.08492249882573953, 0.07219351808360694, 0.06547674964772213, 0.062118365429778895] recall : [0.021230624706434883, 0.03609675904180347, 0.04910756223579112, 0.062118365429778895] MAP : [0.05471113198684829, 0.03653643561698987, 0.028421907146660548, 0.023767325116388325] ndcg : [0.09033877013159078, 0.07960641103397892, 0.07342701150659135, 0.06985268523884461] 85 85-0 Epoch 86 - loss=14.5019 85-1 Epoch 86 - loss=13.5035 85-2 Epoch 86 - loss=12.7974 85-3 Epoch 86 - loss=13.0088 85-4 Epoch 86 - loss=13.3779 85-5 Epoch 86 - loss=12.9184 85-6 Epoch 86 - loss=13.0552 85-7 Epoch 86 - loss=10.0638 85-8 Epoch 86 - loss=11.2318 85-9 Epoch 86 - loss=11.8425 85-10 Epoch 86 - loss=11.8200 85-11 Epoch 86 - loss=12.9670 85-12 Epoch 86 - loss=11.3399 85-13 Epoch 86 - loss=12.9865 85-14 Epoch 86 - loss=6.5743 precision : [0.0817285110380459, 0.07064349459840262, 0.0645686550806327, 0.061296383278534226] recall : [0.020432127759511476, 0.03532174729920131, 0.048426491310474135, 0.061296383278534226] MAP : [0.05324878659777673, 0.03566276737718729, 0.027829031084080403, 0.02326901241603052] ndcg : [0.08694007361707373, 0.0773582738343938, 0.07176730489890831, 0.06839264892322258] 86 86-0 Epoch 87 - loss=13.6267 86-1 Epoch 87 - loss=13.8946 86-2 Epoch 87 - loss=13.6243 86-3 Epoch 87 - loss=11.6309 86-4 Epoch 87 - loss=16.0986 86-5 Epoch 87 - loss=12.1186 86-6 Epoch 87 - loss=13.4200 86-7 Epoch 87 - loss=11.0746 86-8 Epoch 87 - loss=11.7385 86-9 Epoch 87 - loss=10.6809 86-10 Epoch 87 - loss=12.5271 86-11 Epoch 87 - loss=13.8483 86-12 Epoch 87 - loss=12.1824 86-13 Epoch 87 - loss=12.4861 86-14 Epoch 87 - loss=6.3429 precision : [0.08154062940347569, 0.06946923438233875, 0.06597776733990926, 0.06204790981681506] recall : [0.02038515735086892, 0.034734617191169374, 0.04948332550493154, 0.06204790981681506] MAP : [0.05267574761233756, 0.035197853526881234, 0.02793968196269746, 0.02339121418096507] ndcg : [0.08651249949736751, 0.0763610799635504, 0.07245753946133573, 0.06873710285632106] 87 87-0 Epoch 88 - loss=12.4682 87-1 Epoch 88 - loss=12.7904 87-2 Epoch 88 - loss=11.9860 87-3 Epoch 88 - loss=11.1614 87-4 Epoch 88 - loss=11.4253 87-5 Epoch 88 - loss=12.0259 87-6 Epoch 88 - loss=12.3874 87-7 Epoch 88 - loss=11.6462 87-8 Epoch 88 - loss=11.7646 87-9 Epoch 88 - loss=9.6963 87-10 Epoch 88 - loss=11.6380 87-11 Epoch 88 - loss=13.6177 87-12 Epoch 88 - loss=11.8448 87-13 Epoch 88 - loss=12.9091 87-14 Epoch 88 - loss=7.3026 precision : [0.07571629873179897, 0.0671676843588536, 0.06272115234069221, 0.05861906998590848] recall : [0.018929074682949742, 0.0335838421794268, 0.047040864255518657, 0.05861906998590848] MAP : [0.049484891185219974, 0.0336822004518106, 0.02641291358294646, 0.022016836524832398] ndcg : [0.08098644031010171, 0.07326180720259119, 0.06890005756530358, 0.06511175728012786] 88 88-0 Epoch 89 - loss=13.8287 88-1 Epoch 89 - loss=11.9257 88-2 Epoch 89 - loss=11.9894 88-3 Epoch 89 - loss=12.6588 88-4 Epoch 89 - loss=13.1382 88-5 Epoch 89 - loss=10.4770 88-6 Epoch 89 - loss=11.3676 88-7 Epoch 89 - loss=10.9134 88-8 Epoch 89 - loss=11.7854 88-9 Epoch 89 - loss=11.8594 88-10 Epoch 89 - loss=11.8373 88-11 Epoch 89 - loss=13.2552 88-12 Epoch 89 - loss=12.1015 88-13 Epoch 89 - loss=13.2365 88-14 Epoch 89 - loss=6.8809 precision : [0.07881634570220752, 0.06777829967120672, 0.06203225301393469, 0.05934711131986805] recall : [0.01970408642555188, 0.03388914983560336, 0.0465241897604506, 0.05934711131986805] MAP : [0.05036323782683576, 0.033871069956086394, 0.026353870891212366, 0.022283742854946834] ndcg : [0.08356819533051942, 0.07424622518979605, 0.06893319916881707, 0.06599298602300577] 89 89-0 Epoch 90 - loss=13.0729 89-1 Epoch 90 - loss=10.4357 89-2 Epoch 90 - loss=13.1759 89-3 Epoch 90 - loss=11.5793 89-4 Epoch 90 - loss=12.0705 89-5 Epoch 90 - loss=10.8255 89-6 Epoch 90 - loss=11.9509 89-7 Epoch 90 - loss=10.2062 89-8 Epoch 90 - loss=10.6497 89-9 Epoch 90 - loss=11.1202 89-10 Epoch 90 - loss=11.2615 89-11 Epoch 90 - loss=10.6485 89-12 Epoch 90 - loss=11.0414 89-13 Epoch 90 - loss=10.9748 89-14 Epoch 90 - loss=6.1399 precision : [0.08276186002818214, 0.06961014560826631, 0.06450602786910926, 0.06103804603100013] recall : [0.020690465007045536, 0.034805072804133155, 0.048379520901831535, 0.06103804603100013] MAP : [0.05254892750900266, 0.03474697488201481, 0.027263504983091644, 0.02295789947478646] ndcg : [0.08734995091477532, 0.07651370724332678, 0.07153085130688398, 0.06802976889848854] 90 90-0 Epoch 91 - loss=13.7319 90-1 Epoch 91 - loss=11.3835 90-2 Epoch 91 - loss=12.5543 90-3 Epoch 91 - loss=11.4740 90-4 Epoch 91 - loss=13.5910 90-5 Epoch 91 - loss=10.4322 90-6 Epoch 91 - loss=13.7268 90-7 Epoch 91 - loss=12.6624 90-8 Epoch 91 - loss=10.8343 90-9 Epoch 91 - loss=11.5790 90-10 Epoch 91 - loss=12.9811 90-11 Epoch 91 - loss=12.1628 90-12 Epoch 91 - loss=11.6482 90-13 Epoch 91 - loss=10.4569 90-14 Epoch 91 - loss=6.6814 precision : [0.07787693752935648, 0.06848285580084504, 0.06328479724440286, 0.059957726632221306] recall : [0.01946923438233912, 0.03424142790042252, 0.047463597933301765, 0.059957726632221306] MAP : [0.04963676217316425, 0.033383956995981415, 0.026517178522814967, 0.0222974062739876] ndcg : [0.0823431354611199, 0.07425585407466163, 0.06945909929394747, 0.06620622793383098] 91 91-0 Epoch 92 - loss=13.3062 91-1 Epoch 92 - loss=12.3378 91-2 Epoch 92 - loss=12.1990 91-3 Epoch 92 - loss=12.1521 91-4 Epoch 92 - loss=14.1049 91-5 Epoch 92 - loss=11.0214 91-6 Epoch 92 - loss=10.3553 91-7 Epoch 92 - loss=10.6065 91-8 Epoch 92 - loss=11.0561 91-9 Epoch 92 - loss=11.6306 91-10 Epoch 92 - loss=11.7456 91-11 Epoch 92 - loss=12.9244 91-12 Epoch 92 - loss=12.2493 91-13 Epoch 92 - loss=11.3187 91-14 Epoch 92 - loss=6.5613 precision : [0.07534053546265851, 0.0646782527007981, 0.06031000469704096, 0.05671676843588507] recall : [0.018835133865664627, 0.03233912635039905, 0.045232503522780375, 0.05671676843588507] MAP : [0.04702520745263817, 0.0315066690524652, 0.02494419972109028, 0.02081591153370263] ndcg : [0.07883409734937642, 0.07017612591607404, 0.06603567400642461, 0.06267938084677085] 92 92-0 Epoch 93 - loss=11.1470 92-1 Epoch 93 - loss=11.1353 92-2 Epoch 93 - loss=11.9834 92-3 Epoch 93 - loss=12.7260 92-4 Epoch 93 - loss=11.0448 92-5 Epoch 93 - loss=11.7007 92-6 Epoch 93 - loss=11.0834 92-7 Epoch 93 - loss=13.3217 92-8 Epoch 93 - loss=9.8921 92-9 Epoch 93 - loss=9.5510 92-10 Epoch 93 - loss=12.3383 92-11 Epoch 93 - loss=12.5139 92-12 Epoch 93 - loss=12.4059 92-13 Epoch 93 - loss=10.9852 92-14 Epoch 93 - loss=6.4105 precision : [0.0745890089243776, 0.06524189760450883, 0.05962110537028353, 0.0569046500704553] recall : [0.0186472522310944, 0.03262094880225441, 0.04471582902771232, 0.0569046500704553] MAP : [0.0475606701111633, 0.03221950092076912, 0.02500296095880877, 0.020962242167633913] ndcg : [0.0793617368118619, 0.07123054046308255, 0.06608593306953642, 0.06319218228689173] 93 93-0 Epoch 94 - loss=12.7001 93-1 Epoch 94 - loss=9.4794 93-2 Epoch 94 - loss=10.7737 93-3 Epoch 94 - loss=10.1610 93-4 Epoch 94 - loss=12.9403 93-5 Epoch 94 - loss=10.9069 93-6 Epoch 94 - loss=10.0660 93-7 Epoch 94 - loss=10.2308 93-8 Epoch 94 - loss=10.8194 93-9 Epoch 94 - loss=10.9738 93-10 Epoch 94 - loss=12.0051 93-11 Epoch 94 - loss=11.4148 93-12 Epoch 94 - loss=12.3146 93-13 Epoch 94 - loss=10.2269 93-14 Epoch 94 - loss=6.9595 precision : [0.0773132926256459, 0.06824800375763229, 0.06272115234069219, 0.058501643964302213] recall : [0.019328323156411475, 0.034124001878816146, 0.04704086425551873, 0.058501643964302213] MAP : [0.04806168780335055, 0.03300845467355566, 0.02605024066273479, 0.02167651529806832] ndcg : [0.08099002102875728, 0.07350467047375644, 0.06861636379866679, 0.06479025612995287] 94 94-0 Epoch 95 - loss=13.4976 94-1 Epoch 95 - loss=10.3086 94-2 Epoch 95 - loss=10.1101 94-3 Epoch 95 - loss=10.2346 94-4 Epoch 95 - loss=11.7254 94-5 Epoch 95 - loss=11.4914 94-6 Epoch 95 - loss=12.3768 94-7 Epoch 95 - loss=10.6660 94-8 Epoch 95 - loss=10.2309 94-9 Epoch 95 - loss=12.8443 94-10 Epoch 95 - loss=11.3111 94-11 Epoch 95 - loss=12.1681 94-12 Epoch 95 - loss=10.3742 94-13 Epoch 95 - loss=12.2462 94-14 Epoch 95 - loss=6.1285 precision : [0.07224048849224994, 0.06430248943165769, 0.05905746046657292, 0.05544856740253609] recall : [0.018060122123062485, 0.03215124471582884, 0.04429309534992931, 0.05544856740253609] MAP : [0.044535775794582746, 0.030733316185406367, 0.024269945300945766, 0.020352191836559452] ndcg : [0.07571554655100975, 0.06902341542221914, 0.06443754234867542, 0.06112259623141727] 95 95-0 Epoch 96 - loss=11.6616 95-1 Epoch 96 - loss=11.9674 95-2 Epoch 96 - loss=12.4413 95-3 Epoch 96 - loss=13.1118 95-4 Epoch 96 - loss=12.3893 95-5 Epoch 96 - loss=12.9405 95-6 Epoch 96 - loss=9.8941 95-7 Epoch 96 - loss=10.5191 95-8 Epoch 96 - loss=9.4678 95-9 Epoch 96 - loss=9.3447 95-10 Epoch 96 - loss=10.1955 95-11 Epoch 96 - loss=10.6692 95-12 Epoch 96 - loss=11.5561 95-13 Epoch 96 - loss=9.4647 95-14 Epoch 96 - loss=6.3632 precision : [0.06895255988727109, 0.061766087364959796, 0.05811805229372178, 0.054837952090182863] recall : [0.01723813997181777, 0.030883043682479898, 0.04358853922029101, 0.054837952090182863] MAP : [0.04255205886957883, 0.029177104535253903, 0.023385825680330142, 0.019693461365228006] ndcg : [0.07299885590170511, 0.06654005579557085, 0.06301244443979193, 0.05999572298589766] 96 96-0 Epoch 97 - loss=11.6490 96-1 Epoch 97 - loss=10.2392 96-2 Epoch 97 - loss=10.2988 96-3 Epoch 97 - loss=10.8713 96-4 Epoch 97 - loss=11.2248 96-5 Epoch 97 - loss=12.1276 96-6 Epoch 97 - loss=11.3698 96-7 Epoch 97 - loss=10.4277 96-8 Epoch 97 - loss=10.5815 96-9 Epoch 97 - loss=8.6404 96-10 Epoch 97 - loss=10.2536 96-11 Epoch 97 - loss=10.2734 96-12 Epoch 97 - loss=12.1241 96-13 Epoch 97 - loss=9.3419 96-14 Epoch 97 - loss=6.2443 precision : [0.06782527007984987, 0.06068576796618103, 0.05783622984186654, 0.05457961484264882] recall : [0.016956317519962467, 0.030342883983090516, 0.04337717238139949, 0.05457961484264882] MAP : [0.040377328949428526, 0.027934327167535244, 0.022701315611132426, 0.019212979306349354] ndcg : [0.07037060794009643, 0.06450370686339357, 0.061729195975978146, 0.058886505232987524] 97 97-0 Epoch 98 - loss=11.5752 97-1 Epoch 98 - loss=9.7380 97-2 Epoch 98 - loss=10.5889 97-3 Epoch 98 - loss=11.4657 97-4 Epoch 98 - loss=12.4627 97-5 Epoch 98 - loss=11.1574 97-6 Epoch 98 - loss=10.3689 97-7 Epoch 98 - loss=8.6124 97-8 Epoch 98 - loss=9.7055 97-9 Epoch 98 - loss=11.0682 97-10 Epoch 98 - loss=11.2989 97-11 Epoch 98 - loss=11.6119 97-12 Epoch 98 - loss=11.9827 97-13 Epoch 98 - loss=11.5627 97-14 Epoch 98 - loss=6.1166 precision : [0.07411930483795212, 0.06411460779708743, 0.05827462032253037, 0.054744011272897776] recall : [0.01852982620948803, 0.032057303898543714, 0.043705965241897335, 0.054744011272897776] MAP : [0.04579614842649131, 0.031058884490072842, 0.024309724337906582, 0.020366226719773388] ndcg : [0.0771836423901911, 0.06912627825597518, 0.06405913543467517, 0.060726511381960155] 98 98-0 Epoch 99 - loss=12.7383 98-1 Epoch 99 - loss=11.4575 98-2 Epoch 99 - loss=9.9953 98-3 Epoch 99 - loss=10.8069 98-4 Epoch 99 - loss=13.0526 98-5 Epoch 99 - loss=11.3954 98-6 Epoch 99 - loss=10.9950 98-7 Epoch 99 - loss=10.1876 98-8 Epoch 99 - loss=8.7921 98-9 Epoch 99 - loss=10.2377 98-10 Epoch 99 - loss=13.1636 98-11 Epoch 99 - loss=9.6126 98-12 Epoch 99 - loss=10.5077 98-13 Epoch 99 - loss=11.8348 98-14 Epoch 99 - loss=5.8028 precision : [0.07712541099107555, 0.0641615782057301, 0.05858775638014734, 0.054861437294504156] recall : [0.019281352747768887, 0.03208078910286505, 0.04394081728511013, 0.054861437294504156] MAP : [0.05067167684358854, 0.03305365437234859, 0.02564787429747505, 0.021417658583785137] ndcg : [0.0820799977301542, 0.07132697719088889, 0.06595447497094675, 0.06223720654633749] 99 99-0 Epoch 100 - loss=11.4867 99-1 Epoch 100 - loss=9.1462 99-2 Epoch 100 - loss=12.2338 99-3 Epoch 100 - loss=10.2687 99-4 Epoch 100 - loss=10.7331 99-5 Epoch 100 - loss=11.7895 99-6 Epoch 100 - loss=10.2036 99-7 Epoch 100 - loss=9.7152 99-8 Epoch 100 - loss=9.3876 99-9 Epoch 100 - loss=8.9078 99-10 Epoch 100 - loss=11.6751 99-11 Epoch 100 - loss=10.6178 99-12 Epoch 100 - loss=10.2436 99-13 Epoch 100 - loss=10.3937 99-14 Epoch 100 - loss=5.5074 precision : [0.08125880695162041, 0.06782527007984926, 0.061593862533270864, 0.057069046500704275] recall : [0.020314701737905103, 0.03391263503992463, 0.046195396899952786, 0.057069046500704275] MAP : [0.05376232973226867, 0.034892937290776645, 0.027151384878017097, 0.022513834210962872] ndcg : [0.08762606387652228, 0.07608115909706506, 0.07001780726991405, 0.06559261109922071]

retagnn / RetaGNN

no data files #3