search

siqueira-hc / Efficient-Facial-Feature-Learning-with-Wide-Ensemble-based-Convolutional-Neural-Networks

Efficient Facial Feature Learning with Wide Ensemble-based Convolutional Neural Networks
MIT License
193 stars 41 forks source link

Not able to get same performance #16

Open darshangera opened 4 years ago

darshangera commented 4 years ago

Hi, Thanks for the reply. I have used your model using code provided on cropped dataset with data augumentation as mentioned by you. I have used 5000 images per class as well as only 8 emotions. I did not use automatically annotated data. Below is the log. I am not able to get same performance. Could you please have a look and suggest?

python mymain_affectnet_discrete.py Processing... Starting: ESR_9-AffectNet_Discrete Running on cuda

[Branch 1, Epochs 1--50] Loss: 2.0843 Acc: [0.14715203] Validation - [Branch 1, Epochs 1--50] Loss: 2.0767 Acc: [0.16154039 0.16154039] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 2--50] Loss: 2.0369 Acc: [0.18504514] [Branch 1, Epochs 3--50] Loss: 1.9416 Acc: [0.24256384] Validation - [Branch 1, Epochs 3--50] Loss: 1.8283 Acc: [0.30257564 0.30257564] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 4--50] Loss: 1.7862 Acc: [0.31986792] [Branch 1, Epochs 5--50] Loss: 1.6777 Acc: [0.36638884] Validation - [Branch 1, Epochs 5--50] Loss: 1.5865 Acc: [0.40235059 0.40235059] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 6--50] Loss: 1.5984 Acc: [0.398823] [Branch 1, Epochs 7--50] Loss: 1.5499 Acc: [0.41860837] Validation - [Branch 1, Epochs 7--50] Loss: 1.5098 Acc: [0.4156039 0.4156039] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 8--50] Loss: 1.5158 Acc: [0.43429287] [Branch 1, Epochs 9--50] Loss: 1.4847 Acc: [0.44252124] Validation - [Branch 1, Epochs 9--50] Loss: 1.4875 Acc: [0.43210803 0.43210803] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 10--50] Loss: 1.4507 Acc: [0.45724709] [Branch 1, Epochs 11--50] Loss: 1.3985 Acc: [0.47681943] Validation - [Branch 1, Epochs 11--50] Loss: 1.4046 Acc: [0.4736184 0.4736184] [Branch 1, Epochs 11--50] Loss: 1.3985 Acc: [0.47681943] [376/1905] Validation - [Branch 1, Epochs 11--50] Loss: 1.4046 Acc: [0.4736184 0.4736184] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 12--50] Loss: 1.3768 Acc: [0.48664554] [Branch 1, Epochs 13--50] Loss: 1.3670 Acc: [0.48912204] Validation - [Branch 1, Epochs 13--50] Loss: 1.3871 Acc: [0.47911978 0.47911978] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 14--50] Loss: 1.3567 Acc: [0.49298325] [Branch 1, Epochs 15--50] Loss: 1.3478 Acc: [0.49511357] Validation - [Branch 1, Epochs 15--50] Loss: 1.3665 Acc: [0.48712178 0.48712178] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 16--50] Loss: 1.3354 Acc: [0.49897478] [Branch 1, Epochs 17--50] Loss: 1.3307 Acc: [0.50139802] Validation - [Branch 1, Epochs 17--50] Loss: 1.3565 Acc: [0.48937234 0.48937234] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 18--50] Loss: 1.3174 Acc: [0.50696349] [Branch 1, Epochs 19--50] Loss: 1.3133 Acc: [0.50880089] Validation - [Branch 1, Epochs 19--50] Loss: 1.3385 Acc: [0.50212553 0.50212553] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 20--50] Loss: 1.3048 Acc: [0.51375389] [Branch 1, Epochs 21--50] Loss: 1.2644 Acc: [0.53079647] Validation - [Branch 1, Epochs 21--50] Loss: 1.3290 Acc: [0.50587647 0.50587647] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 22--50] Loss: 1.2547 Acc: [0.53202141] [Branch 1, Epochs 23--50] Loss: 1.2461 Acc: [0.53423162] Validation - [Branch 1, Epochs 23--50] Loss: 1.3102 Acc: [0.51987997 0.51987997] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 24--50] Loss: 1.2389 Acc: [0.53423162] [Branch 1, Epochs 25--50] Loss: 1.2345 Acc: [0.53630868] Validation - [Branch 1, Epochs 25--50] Loss: 1.3159 Acc: [0.51237809 0.51237809] [Branch 1, Epochs 26--50] Loss: 1.2314 Acc: [0.5420073] [Branch 1, Epochs 27--50] Loss: 1.2234 Acc: [0.54554896] Validation - [Branch 1, Epochs 27--50] Loss: 1.3205 Acc: [0.51112778 0.51112778] [Branch 1, Epochs 28--50] Loss: 1.2144 Acc: [0.54775917] [Branch 1, Epochs 29--50] Loss: 1.2127 Acc: [0.54805209] Validation - [Branch 1, Epochs 29--50] Loss: 1.3223 Acc: [0.51012753 0.51012753] [Branch 1, Epochs 30--50] Loss: 1.2092 Acc: [0.54941017] [Branch 1, Epochs 31--50] Loss: 1.1804 Acc: [0.56014167] Validation - [Branch 1, Epochs 31--50] Loss: 1.3035 Acc: [0.52288072 0.52288072] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 32--50] Loss: 1.1699 Acc: [0.56578702] [Branch 1, Epochs 33--50] Loss: 1.1673 Acc: [0.56394962] [Branch 1, Epochs 32--50] Loss: 1.1699 Acc: [0.56578702] [336/1905] [Branch 1, Epochs 33--50] Loss: 1.1673 Acc: [0.56394962] Validation - [Branch 1, Epochs 33--50] Loss: 1.3089 Acc: [0.51862966 0.51862966] [Branch 1, Epochs 34--50] Loss: 1.1631 Acc: [0.56844992] [Branch 1, Epochs 35--50] Loss: 1.1580 Acc: [0.57169867] Validation - [Branch 1, Epochs 35--50] Loss: 1.3021 Acc: [0.52388097 0.52388097] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 36--50] Loss: 1.1573 Acc: [0.56999441] [Branch 1, Epochs 37--50] Loss: 1.1505 Acc: [0.5722845] Validation - [Branch 1, Epochs 37--50] Loss: 1.3056 Acc: [0.52313078 0.52313078] [Branch 1, Epochs 38--50] Loss: 1.1440 Acc: [0.57295023] [Branch 1, Epochs 39--50] Loss: 1.1456 Acc: [0.57215136] Validation - [Branch 1, Epochs 39--50] Loss: 1.3046 Acc: [0.51712928 0.51712928] [Branch 1, Epochs 40--50] Loss: 1.1369 Acc: [0.5755865] [Branch 1, Epochs 41--50] Loss: 1.1149 Acc: [0.58442734] Validation - [Branch 1, Epochs 41--50] Loss: 1.3026 Acc: [0.52063016 0.52063016] [Branch 1, Epochs 42--50] Loss: 1.1087 Acc: [0.58980641] [Branch 1, Epochs 43--50] Loss: 1.1016 Acc: [0.59084494] Validation - [Branch 1, Epochs 43--50] Loss: 1.3011 Acc: [0.52163041 0.52163041] [Branch 1, Epochs 44--50] Loss: 1.0988 Acc: [0.59220302] [Branch 1, Epochs 45--50] Loss: 1.0945 Acc: [0.59278886] Validation - [Branch 1, Epochs 45--50] Loss: 1.3202 Acc: [0.52138035 0.52138035] [Branch 1, Epochs 46--50] Loss: 1.0870 Acc: [0.59611749] [Branch 1, Epochs 47--50] Loss: 1.0898 Acc: [0.59654355] Validation - [Branch 1, Epochs 47--50] Loss: 1.3171 Acc: [0.52263066 0.52263066] [Branch 1, Epochs 48--50] Loss: 1.0858 Acc: [0.59390728] [Branch 1, Epochs 49--50] Loss: 1.0787 Acc: [0.59936623] Validation - [Branch 1, Epochs 49--50] Loss: 1.3089 Acc: [0.52013003 0.52013003] [Branch 1, Epochs 50--50] Loss: 1.0772 Acc: [0.59798152] Validation - [Branch 1, Epochs 50--50] Loss: 1.3153 Acc: [0.52213053 0.52213053]

[Branch 2, Epochs 1--20] Loss: 2.8556 Acc: [0.57417517 0.34820121] Validation - [Branch 2, Epochs 1--20] Loss: 1.5449 Acc: [0.52313078 0.41260315 0.49087272] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 2--20] Loss: 2.6831 Acc: [0.57284371 0.42233643] [Branch 2, Epochs 3--20] Loss: 2.6027 Acc: [0.57505392 0.44806008] Validation - [Branch 2, Epochs 3--20] Loss: 1.4284 Acc: [0.52088022 0.46786697 0.48162041] [Branch 2, Epochs 4--20] Loss: 2.5601 Acc: [0.57697121 0.46220009] [Branch 2, Epochs 5--20] Loss: 2.5298 Acc: [0.58256331 0.47855032] Validation - [Branch 2, Epochs 5--20] Loss: 1.3916 Acc: [0.52363091 0.47036759 0.48962241] [Branch 2, Epochs 5--20] Loss: 2.5298 Acc: [0.58256331 0.47855032] [296/1905] Validation - [Branch 2, Epochs 5--20] Loss: 1.3916 Acc: [0.52363091 0.47036759 0.48962241] [Branch 2, Epochs 6--20] Loss: 2.4971 Acc: [0.58421431 0.48579341] [Branch 2, Epochs 7--20] Loss: 2.4818 Acc: [0.58043299 0.49282348] Validation - [Branch 2, Epochs 7--20] Loss: 1.3955 Acc: [0.52213053 0.47786947 0.48787197] [Branch 2, Epochs 8--20] Loss: 2.4578 Acc: [0.58128512 0.49817591] [Branch 2, Epochs 9--20] Loss: 2.4418 Acc: [0.58424094 0.50637765] Validation - [Branch 2, Epochs 9--20] Loss: 1.3681 Acc: [0.51787947 0.48287072 0.49762441] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 10--20] Loss: 2.4272 Acc: [0.58626475 0.51058504] [Branch 2, Epochs 11--20] Loss: 2.3619 Acc: [0.59515884 0.52456528] Validation - [Branch 2, Epochs 11--20] Loss: 1.3298 Acc: [0.52538135 0.50512628 0.50387597] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 12--20] Loss: 2.3347 Acc: [0.59856736 0.53076985] [Branch 2, Epochs 13--20] Loss: 2.3250 Acc: [0.59963252 0.5332996 ] Validation - [Branch 2, Epochs 13--20] Loss: 1.3215 Acc: [0.52538135 0.50612653 0.50837709] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 14--20] Loss: 2.3155 Acc: [0.60248183 0.54040955] [Branch 2, Epochs 15--20] Loss: 2.3073 Acc: [0.60298778 0.54030304] Validation - [Branch 2, Epochs 15--20] Loss: 1.3224 Acc: [0.52738185 0.51037759 0.50912728] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 16--20] Loss: 2.2925 Acc: [0.60360024 0.54296594] [Branch 2, Epochs 17--20] Loss: 2.2781 Acc: [0.60700876 0.54853141] Validation - [Branch 2, Epochs 17--20] Loss: 1.3141 Acc: [0.52738185 0.51337834 0.51262816] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 18--20] Loss: 2.2750 Acc: [0.6034671 0.54637446] [Branch 2, Epochs 19--20] Loss: 2.2736 Acc: [0.60442574 0.55100791] Validation - [Branch 2, Epochs 19--20] Loss: 1.3040 Acc: [0.52188047 0.51562891 0.51387847] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 20--20] Loss: 2.2551 Acc: [0.60746145 0.55500226] Validation - [Branch 2, Epochs 20--20] Loss: 1.3045 Acc: [0.52338085 0.52063016 0.51787947] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 3, Epochs 1--20] Loss: 3.9443 Acc: [0.59483929 0.56679892 0.34974569] Validation - [Branch 3, Epochs 1--20] Loss: 1.5626 Acc: [0.51637909 0.51837959 0.40460115 0.51112778] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 2--20] Loss: 3.7673 Acc: [0.59683647 0.5679706 0.42880729] [Branch 3, Epochs 3--20] Loss: 3.6904 Acc: [0.59718265 0.57263068 0.45479722] Validation - [Branch 3, Epochs 3--20] Loss: 1.4270 Acc: [0.51762941 0.52263066 0.46236559 0.51962991] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 Validation - [Branch 3, Epochs 3--20] Loss: 1.4270 Acc: [0.51762941 0.52263066 0.46236559 0.51962991] [256/1905] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 4--20] Loss: 3.6386 Acc: [0.60005858 0.57492078 0.46486299] [Branch 3, Epochs 5--20] Loss: 3.5984 Acc: [0.60133678 0.57771683 0.48076053] Validation - [Branch 3, Epochs 5--20] Loss: 1.4172 Acc: [0.51512878 0.52538135 0.47136784 0.51937984] [Branch 3, Epochs 6--20] Loss: 3.5676 Acc: [0.60397305 0.5787021 0.48749767] [Branch 3, Epochs 7--20] Loss: 3.5401 Acc: [0.60101723 0.57683807 0.4951402 ] Validation - [Branch 3, Epochs 7--20] Loss: 1.3566 Acc: [0.51912978 0.52388097 0.49112278 0.52513128] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 8--20] Loss: 3.5394 Acc: [0.6026416 0.58037973 0.49748356] [Branch 3, Epochs 9--20] Loss: 3.4995 Acc: [0.60461215 0.58176444 0.50749607] Validation - [Branch 3, Epochs 9--20] Loss: 1.3423 Acc: [0.5243811 0.52713178 0.50012503 0.52563141] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 10--20] Loss: 3.4847 Acc: [0.60879291 0.5828296 0.51202301] [Branch 3, Epochs 11--20] Loss: 3.3727 Acc: [0.62032328 0.59169707 0.53047693] Validation - [Branch 3, Epochs 11--20] Loss: 1.3051 Acc: [0.52488122 0.52813203 0.50862716 0.53063266] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 12--20] Loss: 3.3554 Acc: [0.62354539 0.59361436 0.53279365] [Branch 3, Epochs 13--20] Loss: 3.3369 Acc: [0.62711368 0.59382739 0.53726733] Validation - [Branch 3, Epochs 13--20] Loss: 1.3160 Acc: [0.52663166 0.5223806 0.51612903 0.52538135] [Branch 3, Epochs 14--20] Loss: 3.3301 Acc: [0.62671424 0.59281549 0.54147472] [Branch 3, Epochs 15--20] Loss: 3.3026 Acc: [0.63062871 0.60061779 0.54799883] Validation - [Branch 3, Epochs 15--20] Loss: 1.3099 Acc: [0.52388097 0.5283821 0.51537884 0.53288322] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 16--20] Loss: 3.2814 Acc: [0.63211994 0.59803478 0.54602828] [Branch 3, Epochs 17--20] Loss: 3.2807 Acc: [0.63241286 0.59917983 0.54496312] Validation - [Branch 3, Epochs 17--20] Loss: 1.3079 Acc: [0.51162791 0.52388097 0.51037759 0.52563141] [Branch 3, Epochs 18--20] Loss: 3.2613 Acc: [0.63422363 0.60013847 0.55047533] [Branch 3, Epochs 19--20] Loss: 3.2556 Acc: [0.63417037 0.60389316 0.5506351 ] Validation - [Branch 3, Epochs 19--20] Loss: 1.2951 Acc: [0.5223806 0.52463116 0.51412853 0.52613153] [Branch 3, Epochs 20--20] Loss: 3.2297 Acc: [0.6354752 0.60261497 0.55561473] Validation - [Branch 3, Epochs 20--20] Loss: 1.3062 Acc: [0.51512878 0.52888222 0.51987997 0.53113278] [Branch 4, Epochs 1--20] Loss: 5.0308 Acc: [0.61233457 0.58786249 0.55348441 0.36183527] Validation - [Branch 4, Epochs 1--20] Loss: 1.5703 Acc: [0.51837959 0.52313078 0.51962991 0.40135034 0.52463116] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 2--20] Loss: 4.8597 Acc: [0.61257423 0.58935371 0.55904988 0.42744921] [Branch 4, Epochs 3--20] Loss: 4.7687 Acc: [0.61499747 0.59137752 0.56040796 0.45085612] Validation - [Branch 4, Epochs 3--20] Loss: 1.4133 Acc: [0.52663166 0.51962991 0.52813203 0.46811703 0.53138285] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 Validation - [Branch 4, Epochs 3--20] Loss: 1.4133 Acc: [0.52663166 0.51962991 0.52813203 0.46811703 0.53138285] [216/1905] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 4--20] Loss: 4.7225 Acc: [0.61558331 0.59212313 0.56070088 0.46893724] [Branch 4, Epochs 5--20] Loss: 4.6684 Acc: [0.62032328 0.59332144 0.56331052 0.48126648] Validation - [Branch 4, Epochs 5--20] Loss: 1.3839 Acc: [0.51912978 0.52313078 0.52013003 0.48587147 0.52538135] [Branch 4, Epochs 6--20] Loss: 4.6497 Acc: [0.62069608 0.59260246 0.56488163 0.48635262] [Branch 4, Epochs 7--20] Loss: 4.5978 Acc: [0.62250686 0.59723591 0.56834341 0.50006657] Validation - [Branch 4, Epochs 7--20] Loss: 1.3538 Acc: [0.51262816 0.51987997 0.52588147 0.49387347 0.5223806 ] [Branch 4, Epochs 8--20] Loss: 4.5726 Acc: [0.62101563 0.59819455 0.56722499 0.50608473] [Branch 4, Epochs 9--20] Loss: 4.5632 Acc: [0.62133518 0.59510558 0.56895588 0.50624451] Validation - [Branch 4, Epochs 9--20] Loss: 1.3453 Acc: [0.51637909 0.52588147 0.52613153 0.50487622 0.52863216] [Branch 4, Epochs 10--20] Loss: 4.5453 Acc: [0.62378505 0.59862062 0.56930205 0.51069156] [Branch 4, Epochs 11--20] Loss: 4.3955 Acc: [0.6430911 0.60911245 0.5772375 0.53132905] Validation - [Branch 4, Epochs 11--20] Loss: 1.2991 Acc: [0.52313078 0.53388347 0.52863216 0.52113028 0.53313328] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 12--20] Loss: 4.3437 Acc: [0.6505206 0.61539691 0.58213725 0.54080899] [Branch 4, Epochs 13--20] Loss: 4.3351 Acc: [0.64918915 0.61161558 0.58248342 0.54206055] Validation - [Branch 4, Epochs 13--20] Loss: 1.2922 Acc: [0.5263816 0.52938235 0.5403851 0.52213053 0.53463366] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 14--20] Loss: 4.3096 Acc: [0.65054723 0.61723431 0.58328229 0.54421751] [Branch 4, Epochs 15--20] Loss: 4.2922 Acc: [0.65286395 0.61824621 0.5836551 0.54765265] Validation - [Branch 4, Epochs 15--20] Loss: 1.2925 Acc: [0.52563141 0.53588397 0.53538385 0.52888222 0.54338585] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 16--20] Loss: 4.2899 Acc: [0.65297047 0.61752723 0.58477352 0.55119431] [Branch 4, Epochs 17--20] Loss: 4.2592 Acc: [0.65685831 0.61912497 0.58445397 0.54999601] Validation - [Branch 4, Epochs 17--20] Loss: 1.3040 Acc: [0.51387847 0.5323831 0.52688172 0.52213053 0.53513378] [Branch 4, Epochs 18--20] Loss: 4.2520 Acc: [0.65225148 0.617687 0.58567891 0.55478923] [Branch 4, Epochs 19--20] Loss: 4.2215 Acc: [0.65747077 0.62112215 0.58629137 0.55766517] Validation - [Branch 4, Epochs 19--20] Loss: 1.2809 Acc: [0.52938235 0.5343836 0.53113278 0.53263316 0.53863466] [Branch 4, Epochs 20--20] Loss: 4.2053 Acc: [0.66269006 0.62298618 0.5910846 0.5595292 ] Validation - [Branch 4, Epochs 20--20] Loss: 1.2914 Acc: [0.52113028 0.53313328 0.53188297 0.52463116 0.53713428] [Branch 5, Epochs 1--20] Loss: 6.0309 Acc: [0.63555508 0.60921897 0.57630549 0.55966234 0.35499161] Validation - [Branch 5, Epochs 1--20] Loss: 1.5767 Acc: [0.51787947 0.5223806 0.53188297 0.52263066 0.4016004 0.53263316] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5 [Branch 5, Epochs 2--20] Loss: 5.8757 Acc: [0.63305195 0.6049317 0.57784997 0.5611802 0.42811493] [Branch 5, Epochs 3--20] Loss: 5.7799 Acc: [0.63395734 0.60751471 0.58059276 0.56464197 0.45839214] Validation - [Branch 5, Epochs 3--20] Loss: 1.4232 Acc: [0.51612903 0.52938235 0.52938235 0.5243811 0.46636659 0.53938485] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5 [Branch 5, Epochs 4--20] Loss: 5.7299 Acc: [0.63558171 0.60730168 0.58027321 0.56552073 0.47213272] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5 [176/1905] [Branch 5, Epochs 4--20] Loss: 5.7299 Acc: [0.63558171 0.60730168 0.58027321 0.56552073 0.47213272] [Branch 5, Epochs 5--20] Loss: 5.6929 Acc: [0.63600778 0.6051181 0.57982052 0.56837004 0.48251804] Validation - [Branch 5, Epochs 5--20] Loss: 1.3597 Acc: [0.51862966 0.52713178 0.5243811 0.52813203 0.48712178 0.53463366] [Branch 5, Epochs 6--20] Loss: 5.6363 Acc: [0.64178628 0.61201502 0.58109871 0.57015418 0.4916518 ] [Branch 5, Epochs 7--20] Loss: 5.6173 Acc: [0.64210582 0.61294703 0.58213725 0.57183181 0.49921444] Validation - [Branch 5, Epochs 7--20] Loss: 1.3467 Acc: [0.52088022 0.5263816 0.52363091 0.52688172 0.48787197 0.53113278] [Branch 5, Epochs 8--20] Loss: 5.5779 Acc: [0.64128032 0.61555668 0.58485341 0.57268394 0.50533912] [Branch 5, Epochs 9--20] Loss: 5.5449 Acc: [0.64282481 0.6141986 0.58578542 0.57369584 0.51223604] Validation - [Branch 5, Epochs 9--20] Loss: 1.3328 Acc: [0.51412853 0.52213053 0.52538135 0.52613153 0.49887472 0.52863216] [Branch 5, Epochs 10--20] Loss: 5.5140 Acc: [0.64660613 0.61955103 0.58751631 0.57784997 0.51841397] [Branch 5, Epochs 11--20] Loss: 5.3430 Acc: [0.66407477 0.62852502 0.596224 0.58456049 0.53561633] Validation - [Branch 5, Epochs 11--20] Loss: 1.3023 Acc: [0.51987997 0.52913228 0.52663166 0.53213303 0.51262816 0.53888472] [Branch 5, Epochs 12--20] Loss: 5.2921 Acc: [0.67232977 0.634197 0.59995207 0.58554576 0.54256651] [Branch 5, Epochs 13--20] Loss: 5.2358 Acc: [0.678774 0.63787181 0.60184273 0.58687721 0.54600165] Validation - [Branch 5, Epochs 13--20] Loss: 1.2879 Acc: [0.51637909 0.52663166 0.5303826 0.54113528 0.53338335 0.54788697] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5 [Branch 5, Epochs 14--20] Loss: 5.2167 Acc: [0.67675019 0.63880382 0.60170958 0.59143078 0.55023567] [Branch 5, Epochs 15--20] Loss: 5.2310 Acc: [0.67901366 0.63757889 0.60189599 0.58815541 0.5498096 ] Validation - [Branch 5, Epochs 15--20] Loss: 1.2831 Acc: [0.51212803 0.52863216 0.53063266 0.53938485 0.52813203 0.53963491] [Branch 5, Epochs 16--20] Loss: 5.1916 Acc: [0.67997231 0.63928315 0.60495833 0.58972652 0.55377733] [Branch 5, Epochs 17--20] Loss: 5.1638 Acc: [0.68021197 0.64026842 0.60477192 0.59459963 0.55886347] Validation - [Branch 5, Epochs 17--20] Loss: 1.3018 Acc: [0.51912978 0.52813203 0.52763191 0.53413353 0.52488122 0.53913478] [Branch 5, Epochs 18--20] Loss: 5.1331 Acc: [0.68311453 0.64476873 0.60836684 0.59342796 0.55998189] [Branch 5, Epochs 19--20] Loss: 5.1474 Acc: [0.68047826 0.6434639 0.60581045 0.5925492 0.55785157] Validation - [Branch 5, Epochs 19--20] Loss: 1.2865 Acc: [0.51887972 0.52613153 0.53013253 0.53688422 0.52663166 0.54188547] [Branch 5, Epochs 20--20] Loss: 5.0974 Acc: [0.68497856 0.64567411 0.61001784 0.59198999 0.56141986] Validation - [Branch 5, Epochs 20--20] Loss: 1.2754 Acc: [0.51962991 0.5283821 0.52863216 0.5403851 0.53713428 0.54613653] [Branch 6, Epochs 1--20] Loss: 7.0396 Acc: [0.65475461 0.62170799 0.59177696 0.58072591 0.55577451 0.35587037] Validation - [Branch 6, Epochs 1--20] Loss: 1.5182 Acc: [0.51437859 0.52513128 0.53088272 0.5323831 0.53513378 0.42635659 0.53763441] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6 [Branch 6, Epochs 2--20] Loss: 6.8991 Acc: [0.64945544 0.61606263 0.58956675 0.57667829 0.55838415 0.4295529 ] [Branch 6, Epochs 3--20] Loss: 6.7781 Acc: [0.65137273 0.62303944 0.59294863 0.58195084 0.56179267 0.45897798] Validation - [Branch 6, Epochs 3--20] Loss: 1.4170 Acc: [0.51312828 0.51987997 0.52738185 0.53313328 0.52813203 0.46186547 0.53113278] [Branch 6, Epochs 4--20] Loss: 6.6972 Acc: [0.6579501 0.62586211 0.59712939 0.58381487 0.56389636 0.47809762] [Branch 6, Epochs 5--20] Loss: 6.6734 Acc: [0.65374271 0.62322584 0.59353447 0.58341544 0.56432242 0.48619285] Validation - [Branch 6, Epochs 5--20] Loss: 1.3944 Acc: [0.51312828 0.51962991 0.52463116 0.52563141 0.52488122 0.48387097 [Branch 6, Epochs 5--20] Loss: 6.6734 Acc: [0.65374271 0.62322584 0.59353447 0.58341544 0.56432242 0.48619285] [136/1905] Validation - [Branch 6, Epochs 5--20] Loss: 1.3944 Acc: [0.51312828 0.51962991 0.52463116 0.52563141 0.52488122 0.48387097 0.53088272] [Branch 6, Epochs 6--20] Loss: 6.6213 Acc: [0.65653876 0.62599526 0.59569142 0.58669081 0.56658589 0.49732378] [Branch 6, Epochs 7--20] Loss: 6.5620 Acc: [0.66588555 0.62828536 0.59806141 0.5875962 0.56935531 0.50406093] Validation - [Branch 6, Epochs 7--20] Loss: 1.3493 Acc: [0.51612903 0.52463116 0.52888222 0.53013253 0.53213303 0.50412603 0.53713428] [Branch 6, Epochs 8--20] Loss: 6.5500 Acc: [0.66178468 0.63140095 0.59891354 0.5892472 0.57058025 0.51173009] [Branch 6, Epochs 9--20] Loss: 6.5129 Acc: [0.66282321 0.63097489 0.59917983 0.58855484 0.5694352 0.51199638] Validation - [Branch 6, Epochs 9--20] Loss: 1.3136 Acc: [0.51887972 0.52313078 0.53338335 0.53738435 0.5363841 0.50787697 0.54063516] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6 [Branch 6, Epochs 10--20] Loss: 6.4833 Acc: [0.663915 0.63150747 0.6018161 0.587969 0.57121934 0.52131654] [Branch 6, Epochs 11--20] Loss: 6.2488 Acc: [0.68836045 0.65139936 0.61654195 0.60056454 0.58144489 0.54043618] Validation - [Branch 6, Epochs 11--20] Loss: 1.3046 Acc: [0.51887972 0.53163291 0.53263316 0.53688422 0.5343836 0.51662916 0.5403851 ] [Branch 6, Epochs 12--20] Loss: 6.1712 Acc: [0.69560355 0.65941469 0.61819295 0.60605012 0.58288286 0.54701355] [Branch 6, Epochs 13--20] Loss: 6.1441 Acc: [0.70037014 0.6591484 0.6197907 0.60607674 0.58298938 0.55031555] Validation - [Branch 6, Epochs 13--20] Loss: 1.2922 Acc: [0.52188047 0.53163291 0.52713178 0.53613403 0.53113278 0.52188047 0.53888472] [Branch 6, Epochs 14--20] Loss: 6.0805 Acc: [0.70337922 0.66287647 0.62426437 0.61049716 0.58362847 0.55470934] [Branch 6, Epochs 15--20] Loss: 6.0863 Acc: [0.70052992 0.66098581 0.62202753 0.60762123 0.58730328 0.55588102] Validation - [Branch 6, Epochs 15--20] Loss: 1.2885 Acc: [0.51787947 0.51987997 0.52413103 0.53338335 0.53113278 0.52163041 0.54013503] [Branch 6, Epochs 16--20] Loss: 6.0771 Acc: [0.70258035 0.66271669 0.62711368 0.60791415 0.5854925 0.55420339] [Branch 6, Epochs 17--20] Loss: 6.0211 Acc: [0.70660134 0.6624504 0.62479695 0.61302692 0.58586531 0.56381647] Validation - [Branch 6, Epochs 17--20] Loss: 1.3007 Acc: [0.51512878 0.51912978 0.52213053 0.53013253 0.53988497 0.52188047 0.54213553] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6 [Branch 6, Epochs 18--20] Loss: 6.0235 Acc: [0.70516337 0.66513994 0.62540942 0.60980481 0.58975315 0.56317738] [Branch 6, Epochs 19--20] Loss: 5.9821 Acc: [0.70753335 0.66463398 0.62935052 0.61555668 0.59175033 0.56818363] Validation - [Branch 6, Epochs 19--20] Loss: 1.2859 Acc: [0.51237809 0.52538135 0.53863466 0.53588397 0.53888472 0.52538135 0.5483871 ] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6 [Branch 6, Epochs 20--20] Loss: 5.9601 Acc: [0.70628179 0.66865497 0.63132107 0.61451815 0.58956675 0.56685218] Validation - [Branch 6, Epochs 20--20] Loss: 1.2731 Acc: [0.51912978 0.53063266 0.52513128 0.53138285 0.53063266 0.52888222 0.53988497] [Branch 7, Epochs 1--20] Loss: 7.8431 Acc: [0.67925332 0.64743163 0.61012436 0.59806141 0.58243017 0.57958086 [Branch 7, Epochs 1--20] Loss: 7.8431 Acc: [0.67925332 0.64743163 0.61012436 0.59806141 0.58243017 0.57958086 [96/1905] 0.36071685] Validation - [Branch 7, Epochs 1--20] Loss: 1.5718 Acc: [0.51262816 0.52063016 0.52088022 0.53538385 0.53538385 0.52913228 0.4136034 0.53538385] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7 [Branch 7, Epochs 2--20] Loss: 7.6890 Acc: [0.67352808 0.64538119 0.61145581 0.60072431 0.5828296 0.58109871 0.43474556] [Branch 7, Epochs 3--20] Loss: 7.5777 Acc: [0.67571166 0.65038745 0.61390568 0.60381328 0.58501318 0.58533273 0.46496951] Validation - [Branch 7, Epochs 3--20] Loss: 1.4135 Acc: [0.52488122 0.52113028 0.52513128 0.5403851 0.53413353 0.53113278 0.4656164 0.54488622] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7 [Branch 7, Epochs 4--20] Loss: 7.5092 Acc: [0.68015871 0.64977498 0.6166751 0.60266823 0.58780923 0.58682396 0.47815088] [Branch 7, Epochs 5--20] Loss: 7.4739 Acc: [0.68031848 0.64679253 0.61286715 0.60296115 0.58474689 0.58432083 0.48970788] Validation - [Branch 7, Epochs 5--20] Loss: 1.3716 Acc: [0.51812953 0.51787947 0.52488122 0.53113278 0.53338335 0.53063266 0.48412103 0.5423856 ] [Branch 7, Epochs 6--20] Loss: 7.3876 Acc: [0.68415306 0.65283732 0.62082923 0.60655607 0.58884776 0.58807552 0.50225015] [Branch 7, Epochs 7--20] Loss: 7.3576 Acc: [0.68433947 0.65358294 0.61656858 0.60810055 0.58826192 0.58935371 0.50667057] Validation - [Branch 7, Epochs 7--20] Loss: 1.3330 Acc: [0.51312828 0.52338085 0.5303826 0.53213303 0.53413353 0.52788197 0.50012503 0.54088522] [Branch 7, Epochs 8--20] Loss: 7.2918 Acc: [0.69176897 0.65528719 0.62317258 0.60983144 0.59105797 0.5927356 0.51362075] [Branch 7, Epochs 9--20] Loss: 7.2797 Acc: [0.68809416 0.65435518 0.62330573 0.61156233 0.59230954 0.59558491 0.52179586] Validation - [Branch 7, Epochs 9--20] Loss: 1.3294 Acc: [0.50262566 0.51787947 0.52863216 0.53338335 0.53538385 0.5383846 0.50162541 0.54488622] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7 [Branch 7, Epochs 10--20] Loss: 7.2314 Acc: [0.6934466 0.66130536 0.62551594 0.61467792 0.59324155 0.59715602 0.52523101] [Branch 7, Epochs 11--20] Loss: 6.9503 Acc: [0.71493622 0.67616435 0.64128032 0.62703379 0.6042926 0.60527787 0.54738636] Validation - [Branch 7, Epochs 11--20] Loss: 1.2938 Acc: [0.51212803 0.51787947 0.52813203 0.52788197 0.53513378 0.53463366 0.52263066 0.5423856 ] [Branch 7, Epochs 12--20] Loss: 6.8322 Acc: [0.72659974 0.68844034 0.65020105 0.62908423 0.6069555 0.60913908 0.55122094] [Branch 7, Epochs 13--20] Loss: 6.8261 Acc: [0.72540143 0.6839134 0.64809736 0.6323596 0.60650281 0.60852662 0.55281868] Validation - [Branch 7, Epochs 13--20] Loss: 1.2952 Acc: [0.51887972 0.52488122 0.52488122 0.53163291 0.54488622 0.53588397 Validation - [Branch 7, Epochs 13--20] Loss: 1.2952 Acc: [0.51887972 0.52488122 0.52488122 0.53163291 0.54488622 0.53588397 0.51962991 0.55288822] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7 [Branch 7, Epochs 14--20] Loss: 6.7826 Acc: [0.72992837 0.6880409 0.64958858 0.63185365 0.60748808 0.61134929 0.55707933] [Branch 7, Epochs 15--20] Loss: 6.7051 Acc: [0.7344553 0.69203526 0.65563337 0.63803158 0.61148244 0.61134929 0.56235188] Validation - [Branch 7, Epochs 15--20] Loss: 1.2900 Acc: [0.51112778 0.52588147 0.52288072 0.52713178 0.5363841 0.5343836 0.52013003 0.54463616] [Branch 7, Epochs 16--20] Loss: 6.7301 Acc: [0.73067398 0.69203526 0.65230474 0.63606103 0.61166884 0.60977818 0.56349692] [Branch 7, Epochs 17--20] Loss: 6.6841 Acc: [0.73536069 0.69408569 0.65326339 0.64221234 0.61465129 0.61126941 0.56642612] Validation - [Branch 7, Epochs 17--20] Loss: 1.3045 Acc: [0.51062766 0.51462866 0.52988247 0.53688422 0.53463366 0.52913228 0.51737934 0.54363591] [Branch 7, Epochs 18--20] Loss: 6.6579 Acc: [0.7385828 0.69563018 0.65470136 0.63859079 0.61222805 0.61555668 0.56685218] [Branch 7, Epochs 19--20] Loss: 6.5918 Acc: [0.74031369 0.69797353 0.66117221 0.64141347 0.61387905 0.61640881 0.57207147] Validation - [Branch 7, Epochs 19--20] Loss: 1.2908 Acc: [0.51537884 0.51437859 0.52788197 0.54288572 0.53013253 0.53713428 0.52938235 0.54913728] [Branch 7, Epochs 20--20] Loss: 6.5987 Acc: [0.73914201 0.70055655 0.66103906 0.64362368 0.61912497 0.61797992 0.5737491 ] Validation - [Branch 7, Epochs 20--20] Loss: 1.2965 Acc: [0.50787697 0.51537884 0.52513128 0.5343836 0.53488372 0.53613403 0.52588147 0.54538635] [Branch 8, Epochs 1--20] Loss: 8.7097 Acc: [0.70132879 0.66625835 0.63422363 0.61917823 0.59949937 0.60019173 0.56576039 0.35927889] Validation - [Branch 8, Epochs 1--20] Loss: 1.5464 Acc: [0.51237809 0.51937984 0.52513128 0.52588147 0.52863216 0.52963241 0.52613153 0.40985246 0.53863466] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [Branch 8, Epochs 2--20] Loss: 8.5017 Acc: [0.69741432 0.66798924 0.63347802 0.61917823 0.59617075 0.59963252 0.56927542 0.43740846] [Branch 8, Epochs 3--20] Loss: 8.4253 Acc: [0.70015711 0.6653796 0.63094826 0.61939126 0.59835433 0.60045802 0.56999441 0.46739275] Validation - [Branch 8, Epochs 3--20] Loss: 1.4408 Acc: [0.50862716 0.51687922 0.5223806 0.52988247 0.52988247 0.52713178 0.52788197 0.46261565 0.54013503] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [Branch 8, Epochs 4--20] Loss: 8.3522 Acc: [0.6997843 0.66737677 0.63526216 0.62189439 0.60184273 0.60173621 Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [16/1905] [Branch 8, Epochs 4--20] Loss: 8.3522 Acc: [0.6997843 0.66737677 0.63526216 0.62189439 0.60184273 0.60173621 0.57350944 0.48033446] [Branch 8, Epochs 5--20] Loss: 8.3245 Acc: [0.69999734 0.66490027 0.63369105 0.62042979 0.60146992 0.60434586 0.57137912 0.49564615] Validation - [Branch 8, Epochs 5--20] Loss: 1.3778 Acc: [0.51387847 0.51112778 0.52613153 0.52763191 0.53263316 0.53788447 0.52588147 0.48362091 0.54463616] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [Branch 8, Epochs 6--20] Loss: 8.2452 Acc: [0.70385855 0.67059889 0.63571486 0.6224536 0.60277475 0.60690224 0.57502729 0.50411419] [Branch 8, Epochs 7--20] Loss: 8.2005 Acc: [0.70479056 0.67174394 0.6385109 0.62620829 0.60426597 0.60607674 0.57617234 0.50928022] Validation - [Branch 8, Epochs 7--20] Loss: 1.3490 Acc: [0.50712678 0.51762941 0.5283821 0.52663166 0.5323831 0.52588147 0.52513128 0.49737434 0.54188547] [Branch 8, Epochs 8--20] Loss: 8.1161 Acc: [0.70811919 0.67544537 0.64269166 0.62495673 0.60770112 0.6084201 0.58021996 0.51415333] [Branch 8, Epochs 9--20] Loss: 8.0926 Acc: [0.70870503 0.67778873 0.64165313 0.62743323 0.60884616 0.60921897 0.57713099 0.52435225] Validation - [Branch 8, Epochs 9--20] Loss: 1.3282 Acc: [0.51487872 0.51762941 0.52613153 0.52738185 0.52788197 0.53188297 0.53563391 0.51162791 0.5403851 ] [Branch 8, Epochs 10--20] Loss: 8.0606 Acc: [0.71131468 0.67741592 0.64514153 0.6302559 0.60876628 0.60983144 0.58413442 0.53047693] [Branch 8, Epochs 11--20] Loss: 7.7395 Acc: [0.73658563 0.70279339 0.66018694 0.64572737 0.62120203 0.62192102 0.58682396 0.54554896] Validation - [Branch 8, Epochs 11--20] Loss: 1.3089 Acc: [0.52388097 0.52188047 0.53313328 0.52488122 0.53938485 0.52713178 0.52613153 0.51587897 0.54713678] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [Branch 8, Epochs 12--20] Loss: 7.5885 Acc: [0.74702421 0.70822571 0.67201023 0.65139936 0.62748649 0.62620829