search

siqueira-hc / Efficient-Facial-Feature-Learning-with-Wide-Ensemble-based-Convolutional-Neural-Networks

Efficient Facial Feature Learning with Wide Ensemble-based Convolutional Neural Networks
MIT License
193 stars 41 forks source link

Alignment of Affectnet faces #15

Closed darshangera closed 4 years ago

darshangera commented 4 years ago

Hi, Your work is awesome. I have a query: Did you align the images based landmarks coordinates provided and then used the cropped faces? I have been trying to train my model without alignment but accuracy is 41% or so. Thanks.

siqueira-hc commented 4 years ago

Dear Darshangera,

Thank you for your kind message and interest.

In AffectNet, I have just cropped the faces based on the landmarks provided as metadata.

In order to improve performance on facial expression recognition, I applied data augmentation as follows:

    # Define transforms
    data_transforms = [transforms.ColorJitter(brightness=0.5, contrast=0.5),
                       transforms.RandomHorizontalFlip(p=0.5),
                       transforms.RandomAffine(degrees=30,
                                               translate=(.1, .1),
                                               scale=(1.0, 1.25),
                                               resample=Image.BILINEAR)]

Training the model with transforms.RandomAffine transformation yields the network to develop certain spatial invariances including not aligned faces.

Nevertheless, an accuracy of 59.3% was achieved after adding 9 convolutional branches to the ensemble with shared representations (ESR-9).

Details are explained in the AAAI paper that is available in the media folder in this repository.

Please, let me know if you have any further question.

Best, Henrique Siqueira

darshangera commented 4 years ago

Hi, Thanks for the reply. I have used your model using code provided on cropped dataset with data augumentation as mentioned by you. I have used 5000 images per class as well as only 8 emotions. I did not use automatically annotated data. Below is the log. I am not able to get same performance. Could you please have a look and suggest?

python mymain_affectnet_discrete.py Processing... Starting: ESR_9-AffectNet_Discrete Running on cuda

[Branch 1, Epochs 1--50] Loss: 2.0843 Acc: [0.14715203] Validation - [Branch 1, Epochs 1--50] Loss: 2.0767 Acc: [0.16154039 0.16154039] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 2--50] Loss: 2.0369 Acc: [0.18504514] [Branch 1, Epochs 3--50] Loss: 1.9416 Acc: [0.24256384] Validation - [Branch 1, Epochs 3--50] Loss: 1.8283 Acc: [0.30257564 0.30257564] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 4--50] Loss: 1.7862 Acc: [0.31986792] [Branch 1, Epochs 5--50] Loss: 1.6777 Acc: [0.36638884] Validation - [Branch 1, Epochs 5--50] Loss: 1.5865 Acc: [0.40235059 0.40235059] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 6--50] Loss: 1.5984 Acc: [0.398823] [Branch 1, Epochs 7--50] Loss: 1.5499 Acc: [0.41860837] Validation - [Branch 1, Epochs 7--50] Loss: 1.5098 Acc: [0.4156039 0.4156039] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 8--50] Loss: 1.5158 Acc: [0.43429287] [Branch 1, Epochs 9--50] Loss: 1.4847 Acc: [0.44252124] Validation - [Branch 1, Epochs 9--50] Loss: 1.4875 Acc: [0.43210803 0.43210803] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 10--50] Loss: 1.4507 Acc: [0.45724709] [Branch 1, Epochs 11--50] Loss: 1.3985 Acc: [0.47681943] Validation - [Branch 1, Epochs 11--50] Loss: 1.4046 Acc: [0.4736184 0.4736184] [Branch 1, Epochs 11--50] Loss: 1.3985 Acc: [0.47681943] [376/1905] Validation - [Branch 1, Epochs 11--50] Loss: 1.4046 Acc: [0.4736184 0.4736184] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 12--50] Loss: 1.3768 Acc: [0.48664554] [Branch 1, Epochs 13--50] Loss: 1.3670 Acc: [0.48912204] Validation - [Branch 1, Epochs 13--50] Loss: 1.3871 Acc: [0.47911978 0.47911978] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 14--50] Loss: 1.3567 Acc: [0.49298325] [Branch 1, Epochs 15--50] Loss: 1.3478 Acc: [0.49511357] Validation - [Branch 1, Epochs 15--50] Loss: 1.3665 Acc: [0.48712178 0.48712178] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 16--50] Loss: 1.3354 Acc: [0.49897478] [Branch 1, Epochs 17--50] Loss: 1.3307 Acc: [0.50139802] Validation - [Branch 1, Epochs 17--50] Loss: 1.3565 Acc: [0.48937234 0.48937234] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 18--50] Loss: 1.3174 Acc: [0.50696349] [Branch 1, Epochs 19--50] Loss: 1.3133 Acc: [0.50880089] Validation - [Branch 1, Epochs 19--50] Loss: 1.3385 Acc: [0.50212553 0.50212553] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 20--50] Loss: 1.3048 Acc: [0.51375389] [Branch 1, Epochs 21--50] Loss: 1.2644 Acc: [0.53079647] Validation - [Branch 1, Epochs 21--50] Loss: 1.3290 Acc: [0.50587647 0.50587647] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 22--50] Loss: 1.2547 Acc: [0.53202141] [Branch 1, Epochs 23--50] Loss: 1.2461 Acc: [0.53423162] Validation - [Branch 1, Epochs 23--50] Loss: 1.3102 Acc: [0.51987997 0.51987997] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 24--50] Loss: 1.2389 Acc: [0.53423162] [Branch 1, Epochs 25--50] Loss: 1.2345 Acc: [0.53630868] Validation - [Branch 1, Epochs 25--50] Loss: 1.3159 Acc: [0.51237809 0.51237809] [Branch 1, Epochs 26--50] Loss: 1.2314 Acc: [0.5420073] [Branch 1, Epochs 27--50] Loss: 1.2234 Acc: [0.54554896] Validation - [Branch 1, Epochs 27--50] Loss: 1.3205 Acc: [0.51112778 0.51112778] [Branch 1, Epochs 28--50] Loss: 1.2144 Acc: [0.54775917] [Branch 1, Epochs 29--50] Loss: 1.2127 Acc: [0.54805209] Validation - [Branch 1, Epochs 29--50] Loss: 1.3223 Acc: [0.51012753 0.51012753] [Branch 1, Epochs 30--50] Loss: 1.2092 Acc: [0.54941017] [Branch 1, Epochs 31--50] Loss: 1.1804 Acc: [0.56014167] Validation - [Branch 1, Epochs 31--50] Loss: 1.3035 Acc: [0.52288072 0.52288072] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 32--50] Loss: 1.1699 Acc: [0.56578702] [Branch 1, Epochs 33--50] Loss: 1.1673 Acc: [0.56394962] [Branch 1, Epochs 32--50] Loss: 1.1699 Acc: [0.56578702] [336/1905] [Branch 1, Epochs 33--50] Loss: 1.1673 Acc: [0.56394962] Validation - [Branch 1, Epochs 33--50] Loss: 1.3089 Acc: [0.51862966 0.51862966] [Branch 1, Epochs 34--50] Loss: 1.1631 Acc: [0.56844992] [Branch 1, Epochs 35--50] Loss: 1.1580 Acc: [0.57169867] Validation - [Branch 1, Epochs 35--50] Loss: 1.3021 Acc: [0.52388097 0.52388097] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1 [Branch 1, Epochs 36--50] Loss: 1.1573 Acc: [0.56999441] [Branch 1, Epochs 37--50] Loss: 1.1505 Acc: [0.5722845] Validation - [Branch 1, Epochs 37--50] Loss: 1.3056 Acc: [0.52313078 0.52313078] [Branch 1, Epochs 38--50] Loss: 1.1440 Acc: [0.57295023] [Branch 1, Epochs 39--50] Loss: 1.1456 Acc: [0.57215136] Validation - [Branch 1, Epochs 39--50] Loss: 1.3046 Acc: [0.51712928 0.51712928] [Branch 1, Epochs 40--50] Loss: 1.1369 Acc: [0.5755865] [Branch 1, Epochs 41--50] Loss: 1.1149 Acc: [0.58442734] Validation - [Branch 1, Epochs 41--50] Loss: 1.3026 Acc: [0.52063016 0.52063016] [Branch 1, Epochs 42--50] Loss: 1.1087 Acc: [0.58980641] [Branch 1, Epochs 43--50] Loss: 1.1016 Acc: [0.59084494] Validation - [Branch 1, Epochs 43--50] Loss: 1.3011 Acc: [0.52163041 0.52163041] [Branch 1, Epochs 44--50] Loss: 1.0988 Acc: [0.59220302] [Branch 1, Epochs 45--50] Loss: 1.0945 Acc: [0.59278886] Validation - [Branch 1, Epochs 45--50] Loss: 1.3202 Acc: [0.52138035 0.52138035] [Branch 1, Epochs 46--50] Loss: 1.0870 Acc: [0.59611749] [Branch 1, Epochs 47--50] Loss: 1.0898 Acc: [0.59654355] Validation - [Branch 1, Epochs 47--50] Loss: 1.3171 Acc: [0.52263066 0.52263066] [Branch 1, Epochs 48--50] Loss: 1.0858 Acc: [0.59390728] [Branch 1, Epochs 49--50] Loss: 1.0787 Acc: [0.59936623] Validation - [Branch 1, Epochs 49--50] Loss: 1.3089 Acc: [0.52013003 0.52013003] [Branch 1, Epochs 50--50] Loss: 1.0772 Acc: [0.59798152] Validation - [Branch 1, Epochs 50--50] Loss: 1.3153 Acc: [0.52213053 0.52213053]

[Branch 2, Epochs 1--20] Loss: 2.8556 Acc: [0.57417517 0.34820121] Validation - [Branch 2, Epochs 1--20] Loss: 1.5449 Acc: [0.52313078 0.41260315 0.49087272] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 2--20] Loss: 2.6831 Acc: [0.57284371 0.42233643] [Branch 2, Epochs 3--20] Loss: 2.6027 Acc: [0.57505392 0.44806008] Validation - [Branch 2, Epochs 3--20] Loss: 1.4284 Acc: [0.52088022 0.46786697 0.48162041] [Branch 2, Epochs 4--20] Loss: 2.5601 Acc: [0.57697121 0.46220009] [Branch 2, Epochs 5--20] Loss: 2.5298 Acc: [0.58256331 0.47855032] Validation - [Branch 2, Epochs 5--20] Loss: 1.3916 Acc: [0.52363091 0.47036759 0.48962241] [Branch 2, Epochs 5--20] Loss: 2.5298 Acc: [0.58256331 0.47855032] [296/1905] Validation - [Branch 2, Epochs 5--20] Loss: 1.3916 Acc: [0.52363091 0.47036759 0.48962241] [Branch 2, Epochs 6--20] Loss: 2.4971 Acc: [0.58421431 0.48579341] [Branch 2, Epochs 7--20] Loss: 2.4818 Acc: [0.58043299 0.49282348] Validation - [Branch 2, Epochs 7--20] Loss: 1.3955 Acc: [0.52213053 0.47786947 0.48787197] [Branch 2, Epochs 8--20] Loss: 2.4578 Acc: [0.58128512 0.49817591] [Branch 2, Epochs 9--20] Loss: 2.4418 Acc: [0.58424094 0.50637765] Validation - [Branch 2, Epochs 9--20] Loss: 1.3681 Acc: [0.51787947 0.48287072 0.49762441] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 10--20] Loss: 2.4272 Acc: [0.58626475 0.51058504] [Branch 2, Epochs 11--20] Loss: 2.3619 Acc: [0.59515884 0.52456528] Validation - [Branch 2, Epochs 11--20] Loss: 1.3298 Acc: [0.52538135 0.50512628 0.50387597] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 12--20] Loss: 2.3347 Acc: [0.59856736 0.53076985] [Branch 2, Epochs 13--20] Loss: 2.3250 Acc: [0.59963252 0.5332996 ] Validation - [Branch 2, Epochs 13--20] Loss: 1.3215 Acc: [0.52538135 0.50612653 0.50837709] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 14--20] Loss: 2.3155 Acc: [0.60248183 0.54040955] [Branch 2, Epochs 15--20] Loss: 2.3073 Acc: [0.60298778 0.54030304] Validation - [Branch 2, Epochs 15--20] Loss: 1.3224 Acc: [0.52738185 0.51037759 0.50912728] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 16--20] Loss: 2.2925 Acc: [0.60360024 0.54296594] [Branch 2, Epochs 17--20] Loss: 2.2781 Acc: [0.60700876 0.54853141] Validation - [Branch 2, Epochs 17--20] Loss: 1.3141 Acc: [0.52738185 0.51337834 0.51262816] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 18--20] Loss: 2.2750 Acc: [0.6034671 0.54637446] [Branch 2, Epochs 19--20] Loss: 2.2736 Acc: [0.60442574 0.55100791] Validation - [Branch 2, Epochs 19--20] Loss: 1.3040 Acc: [0.52188047 0.51562891 0.51387847] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 2, Epochs 20--20] Loss: 2.2551 Acc: [0.60746145 0.55500226] Validation - [Branch 2, Epochs 20--20] Loss: 1.3045 Acc: [0.52338085 0.52063016 0.51787947] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2 [Branch 3, Epochs 1--20] Loss: 3.9443 Acc: [0.59483929 0.56679892 0.34974569] Validation - [Branch 3, Epochs 1--20] Loss: 1.5626 Acc: [0.51637909 0.51837959 0.40460115 0.51112778] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 2--20] Loss: 3.7673 Acc: [0.59683647 0.5679706 0.42880729] [Branch 3, Epochs 3--20] Loss: 3.6904 Acc: [0.59718265 0.57263068 0.45479722] Validation - [Branch 3, Epochs 3--20] Loss: 1.4270 Acc: [0.51762941 0.52263066 0.46236559 0.51962991] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 Validation - [Branch 3, Epochs 3--20] Loss: 1.4270 Acc: [0.51762941 0.52263066 0.46236559 0.51962991] [256/1905] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 4--20] Loss: 3.6386 Acc: [0.60005858 0.57492078 0.46486299] [Branch 3, Epochs 5--20] Loss: 3.5984 Acc: [0.60133678 0.57771683 0.48076053] Validation - [Branch 3, Epochs 5--20] Loss: 1.4172 Acc: [0.51512878 0.52538135 0.47136784 0.51937984] [Branch 3, Epochs 6--20] Loss: 3.5676 Acc: [0.60397305 0.5787021 0.48749767] [Branch 3, Epochs 7--20] Loss: 3.5401 Acc: [0.60101723 0.57683807 0.4951402 ] Validation - [Branch 3, Epochs 7--20] Loss: 1.3566 Acc: [0.51912978 0.52388097 0.49112278 0.52513128] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 8--20] Loss: 3.5394 Acc: [0.6026416 0.58037973 0.49748356] [Branch 3, Epochs 9--20] Loss: 3.4995 Acc: [0.60461215 0.58176444 0.50749607] Validation - [Branch 3, Epochs 9--20] Loss: 1.3423 Acc: [0.5243811 0.52713178 0.50012503 0.52563141] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 10--20] Loss: 3.4847 Acc: [0.60879291 0.5828296 0.51202301] [Branch 3, Epochs 11--20] Loss: 3.3727 Acc: [0.62032328 0.59169707 0.53047693] Validation - [Branch 3, Epochs 11--20] Loss: 1.3051 Acc: [0.52488122 0.52813203 0.50862716 0.53063266] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 12--20] Loss: 3.3554 Acc: [0.62354539 0.59361436 0.53279365] [Branch 3, Epochs 13--20] Loss: 3.3369 Acc: [0.62711368 0.59382739 0.53726733] Validation - [Branch 3, Epochs 13--20] Loss: 1.3160 Acc: [0.52663166 0.5223806 0.51612903 0.52538135] [Branch 3, Epochs 14--20] Loss: 3.3301 Acc: [0.62671424 0.59281549 0.54147472] [Branch 3, Epochs 15--20] Loss: 3.3026 Acc: [0.63062871 0.60061779 0.54799883] Validation - [Branch 3, Epochs 15--20] Loss: 1.3099 Acc: [0.52388097 0.5283821 0.51537884 0.53288322] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3 [Branch 3, Epochs 16--20] Loss: 3.2814 Acc: [0.63211994 0.59803478 0.54602828] [Branch 3, Epochs 17--20] Loss: 3.2807 Acc: [0.63241286 0.59917983 0.54496312] Validation - [Branch 3, Epochs 17--20] Loss: 1.3079 Acc: [0.51162791 0.52388097 0.51037759 0.52563141] [Branch 3, Epochs 18--20] Loss: 3.2613 Acc: [0.63422363 0.60013847 0.55047533] [Branch 3, Epochs 19--20] Loss: 3.2556 Acc: [0.63417037 0.60389316 0.5506351 ] Validation - [Branch 3, Epochs 19--20] Loss: 1.2951 Acc: [0.5223806 0.52463116 0.51412853 0.52613153] [Branch 3, Epochs 20--20] Loss: 3.2297 Acc: [0.6354752 0.60261497 0.55561473] Validation - [Branch 3, Epochs 20--20] Loss: 1.3062 Acc: [0.51512878 0.52888222 0.51987997 0.53113278] [Branch 4, Epochs 1--20] Loss: 5.0308 Acc: [0.61233457 0.58786249 0.55348441 0.36183527] Validation - [Branch 4, Epochs 1--20] Loss: 1.5703 Acc: [0.51837959 0.52313078 0.51962991 0.40135034 0.52463116] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 2--20] Loss: 4.8597 Acc: [0.61257423 0.58935371 0.55904988 0.42744921] [Branch 4, Epochs 3--20] Loss: 4.7687 Acc: [0.61499747 0.59137752 0.56040796 0.45085612] Validation - [Branch 4, Epochs 3--20] Loss: 1.4133 Acc: [0.52663166 0.51962991 0.52813203 0.46811703 0.53138285] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 Validation - [Branch 4, Epochs 3--20] Loss: 1.4133 Acc: [0.52663166 0.51962991 0.52813203 0.46811703 0.53138285] [216/1905] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 4--20] Loss: 4.7225 Acc: [0.61558331 0.59212313 0.56070088 0.46893724] [Branch 4, Epochs 5--20] Loss: 4.6684 Acc: [0.62032328 0.59332144 0.56331052 0.48126648] Validation - [Branch 4, Epochs 5--20] Loss: 1.3839 Acc: [0.51912978 0.52313078 0.52013003 0.48587147 0.52538135] [Branch 4, Epochs 6--20] Loss: 4.6497 Acc: [0.62069608 0.59260246 0.56488163 0.48635262] [Branch 4, Epochs 7--20] Loss: 4.5978 Acc: [0.62250686 0.59723591 0.56834341 0.50006657] Validation - [Branch 4, Epochs 7--20] Loss: 1.3538 Acc: [0.51262816 0.51987997 0.52588147 0.49387347 0.5223806 ] [Branch 4, Epochs 8--20] Loss: 4.5726 Acc: [0.62101563 0.59819455 0.56722499 0.50608473] [Branch 4, Epochs 9--20] Loss: 4.5632 Acc: [0.62133518 0.59510558 0.56895588 0.50624451] Validation - [Branch 4, Epochs 9--20] Loss: 1.3453 Acc: [0.51637909 0.52588147 0.52613153 0.50487622 0.52863216] [Branch 4, Epochs 10--20] Loss: 4.5453 Acc: [0.62378505 0.59862062 0.56930205 0.51069156] [Branch 4, Epochs 11--20] Loss: 4.3955 Acc: [0.6430911 0.60911245 0.5772375 0.53132905] Validation - [Branch 4, Epochs 11--20] Loss: 1.2991 Acc: [0.52313078 0.53388347 0.52863216 0.52113028 0.53313328] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 12--20] Loss: 4.3437 Acc: [0.6505206 0.61539691 0.58213725 0.54080899] [Branch 4, Epochs 13--20] Loss: 4.3351 Acc: [0.64918915 0.61161558 0.58248342 0.54206055] Validation - [Branch 4, Epochs 13--20] Loss: 1.2922 Acc: [0.5263816 0.52938235 0.5403851 0.52213053 0.53463366] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 14--20] Loss: 4.3096 Acc: [0.65054723 0.61723431 0.58328229 0.54421751] [Branch 4, Epochs 15--20] Loss: 4.2922 Acc: [0.65286395 0.61824621 0.5836551 0.54765265] Validation - [Branch 4, Epochs 15--20] Loss: 1.2925 Acc: [0.52563141 0.53588397 0.53538385 0.52888222 0.54338585] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4 [Branch 4, Epochs 16--20] Loss: 4.2899 Acc: [0.65297047 0.61752723 0.58477352 0.55119431] [Branch 4, Epochs 17--20] Loss: 4.2592 Acc: [0.65685831 0.61912497 0.58445397 0.54999601] Validation - [Branch 4, Epochs 17--20] Loss: 1.3040 Acc: [0.51387847 0.5323831 0.52688172 0.52213053 0.53513378] [Branch 4, Epochs 18--20] Loss: 4.2520 Acc: [0.65225148 0.617687 0.58567891 0.55478923] [Branch 4, Epochs 19--20] Loss: 4.2215 Acc: [0.65747077 0.62112215 0.58629137 0.55766517] Validation - [Branch 4, Epochs 19--20] Loss: 1.2809 Acc: [0.52938235 0.5343836 0.53113278 0.53263316 0.53863466] [Branch 4, Epochs 20--20] Loss: 4.2053 Acc: [0.66269006 0.62298618 0.5910846 0.5595292 ] Validation - [Branch 4, Epochs 20--20] Loss: 1.2914 Acc: [0.52113028 0.53313328 0.53188297 0.52463116 0.53713428] [Branch 5, Epochs 1--20] Loss: 6.0309 Acc: [0.63555508 0.60921897 0.57630549 0.55966234 0.35499161] Validation - [Branch 5, Epochs 1--20] Loss: 1.5767 Acc: [0.51787947 0.5223806 0.53188297 0.52263066 0.4016004 0.53263316] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5 [Branch 5, Epochs 2--20] Loss: 5.8757 Acc: [0.63305195 0.6049317 0.57784997 0.5611802 0.42811493] [Branch 5, Epochs 3--20] Loss: 5.7799 Acc: [0.63395734 0.60751471 0.58059276 0.56464197 0.45839214] Validation - [Branch 5, Epochs 3--20] Loss: 1.4232 Acc: [0.51612903 0.52938235 0.52938235 0.5243811 0.46636659 0.53938485] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5 [Branch 5, Epochs 4--20] Loss: 5.7299 Acc: [0.63558171 0.60730168 0.58027321 0.56552073 0.47213272] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5 [176/1905] [Branch 5, Epochs 4--20] Loss: 5.7299 Acc: [0.63558171 0.60730168 0.58027321 0.56552073 0.47213272] [Branch 5, Epochs 5--20] Loss: 5.6929 Acc: [0.63600778 0.6051181 0.57982052 0.56837004 0.48251804] Validation - [Branch 5, Epochs 5--20] Loss: 1.3597 Acc: [0.51862966 0.52713178 0.5243811 0.52813203 0.48712178 0.53463366] [Branch 5, Epochs 6--20] Loss: 5.6363 Acc: [0.64178628 0.61201502 0.58109871 0.57015418 0.4916518 ] [Branch 5, Epochs 7--20] Loss: 5.6173 Acc: [0.64210582 0.61294703 0.58213725 0.57183181 0.49921444] Validation - [Branch 5, Epochs 7--20] Loss: 1.3467 Acc: [0.52088022 0.5263816 0.52363091 0.52688172 0.48787197 0.53113278] [Branch 5, Epochs 8--20] Loss: 5.5779 Acc: [0.64128032 0.61555668 0.58485341 0.57268394 0.50533912] [Branch 5, Epochs 9--20] Loss: 5.5449 Acc: [0.64282481 0.6141986 0.58578542 0.57369584 0.51223604] Validation - [Branch 5, Epochs 9--20] Loss: 1.3328 Acc: [0.51412853 0.52213053 0.52538135 0.52613153 0.49887472 0.52863216] [Branch 5, Epochs 10--20] Loss: 5.5140 Acc: [0.64660613 0.61955103 0.58751631 0.57784997 0.51841397] [Branch 5, Epochs 11--20] Loss: 5.3430 Acc: [0.66407477 0.62852502 0.596224 0.58456049 0.53561633] Validation - [Branch 5, Epochs 11--20] Loss: 1.3023 Acc: [0.51987997 0.52913228 0.52663166 0.53213303 0.51262816 0.53888472] [Branch 5, Epochs 12--20] Loss: 5.2921 Acc: [0.67232977 0.634197 0.59995207 0.58554576 0.54256651] [Branch 5, Epochs 13--20] Loss: 5.2358 Acc: [0.678774 0.63787181 0.60184273 0.58687721 0.54600165] Validation - [Branch 5, Epochs 13--20] Loss: 1.2879 Acc: [0.51637909 0.52663166 0.5303826 0.54113528 0.53338335 0.54788697] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5 [Branch 5, Epochs 14--20] Loss: 5.2167 Acc: [0.67675019 0.63880382 0.60170958 0.59143078 0.55023567] [Branch 5, Epochs 15--20] Loss: 5.2310 Acc: [0.67901366 0.63757889 0.60189599 0.58815541 0.5498096 ] Validation - [Branch 5, Epochs 15--20] Loss: 1.2831 Acc: [0.51212803 0.52863216 0.53063266 0.53938485 0.52813203 0.53963491] [Branch 5, Epochs 16--20] Loss: 5.1916 Acc: [0.67997231 0.63928315 0.60495833 0.58972652 0.55377733] [Branch 5, Epochs 17--20] Loss: 5.1638 Acc: [0.68021197 0.64026842 0.60477192 0.59459963 0.55886347] Validation - [Branch 5, Epochs 17--20] Loss: 1.3018 Acc: [0.51912978 0.52813203 0.52763191 0.53413353 0.52488122 0.53913478] [Branch 5, Epochs 18--20] Loss: 5.1331 Acc: [0.68311453 0.64476873 0.60836684 0.59342796 0.55998189] [Branch 5, Epochs 19--20] Loss: 5.1474 Acc: [0.68047826 0.6434639 0.60581045 0.5925492 0.55785157] Validation - [Branch 5, Epochs 19--20] Loss: 1.2865 Acc: [0.51887972 0.52613153 0.53013253 0.53688422 0.52663166 0.54188547] [Branch 5, Epochs 20--20] Loss: 5.0974 Acc: [0.68497856 0.64567411 0.61001784 0.59198999 0.56141986] Validation - [Branch 5, Epochs 20--20] Loss: 1.2754 Acc: [0.51962991 0.5283821 0.52863216 0.5403851 0.53713428 0.54613653] [Branch 6, Epochs 1--20] Loss: 7.0396 Acc: [0.65475461 0.62170799 0.59177696 0.58072591 0.55577451 0.35587037] Validation - [Branch 6, Epochs 1--20] Loss: 1.5182 Acc: [0.51437859 0.52513128 0.53088272 0.5323831 0.53513378 0.42635659 0.53763441] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6 [Branch 6, Epochs 2--20] Loss: 6.8991 Acc: [0.64945544 0.61606263 0.58956675 0.57667829 0.55838415 0.4295529 ] [Branch 6, Epochs 3--20] Loss: 6.7781 Acc: [0.65137273 0.62303944 0.59294863 0.58195084 0.56179267 0.45897798] Validation - [Branch 6, Epochs 3--20] Loss: 1.4170 Acc: [0.51312828 0.51987997 0.52738185 0.53313328 0.52813203 0.46186547 0.53113278] [Branch 6, Epochs 4--20] Loss: 6.6972 Acc: [0.6579501 0.62586211 0.59712939 0.58381487 0.56389636 0.47809762] [Branch 6, Epochs 5--20] Loss: 6.6734 Acc: [0.65374271 0.62322584 0.59353447 0.58341544 0.56432242 0.48619285] Validation - [Branch 6, Epochs 5--20] Loss: 1.3944 Acc: [0.51312828 0.51962991 0.52463116 0.52563141 0.52488122 0.48387097 [Branch 6, Epochs 5--20] Loss: 6.6734 Acc: [0.65374271 0.62322584 0.59353447 0.58341544 0.56432242 0.48619285] [136/1905] Validation - [Branch 6, Epochs 5--20] Loss: 1.3944 Acc: [0.51312828 0.51962991 0.52463116 0.52563141 0.52488122 0.48387097 0.53088272] [Branch 6, Epochs 6--20] Loss: 6.6213 Acc: [0.65653876 0.62599526 0.59569142 0.58669081 0.56658589 0.49732378] [Branch 6, Epochs 7--20] Loss: 6.5620 Acc: [0.66588555 0.62828536 0.59806141 0.5875962 0.56935531 0.50406093] Validation - [Branch 6, Epochs 7--20] Loss: 1.3493 Acc: [0.51612903 0.52463116 0.52888222 0.53013253 0.53213303 0.50412603 0.53713428] [Branch 6, Epochs 8--20] Loss: 6.5500 Acc: [0.66178468 0.63140095 0.59891354 0.5892472 0.57058025 0.51173009] [Branch 6, Epochs 9--20] Loss: 6.5129 Acc: [0.66282321 0.63097489 0.59917983 0.58855484 0.5694352 0.51199638] Validation - [Branch 6, Epochs 9--20] Loss: 1.3136 Acc: [0.51887972 0.52313078 0.53338335 0.53738435 0.5363841 0.50787697 0.54063516] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6 [Branch 6, Epochs 10--20] Loss: 6.4833 Acc: [0.663915 0.63150747 0.6018161 0.587969 0.57121934 0.52131654] [Branch 6, Epochs 11--20] Loss: 6.2488 Acc: [0.68836045 0.65139936 0.61654195 0.60056454 0.58144489 0.54043618] Validation - [Branch 6, Epochs 11--20] Loss: 1.3046 Acc: [0.51887972 0.53163291 0.53263316 0.53688422 0.5343836 0.51662916 0.5403851 ] [Branch 6, Epochs 12--20] Loss: 6.1712 Acc: [0.69560355 0.65941469 0.61819295 0.60605012 0.58288286 0.54701355] [Branch 6, Epochs 13--20] Loss: 6.1441 Acc: [0.70037014 0.6591484 0.6197907 0.60607674 0.58298938 0.55031555] Validation - [Branch 6, Epochs 13--20] Loss: 1.2922 Acc: [0.52188047 0.53163291 0.52713178 0.53613403 0.53113278 0.52188047 0.53888472] [Branch 6, Epochs 14--20] Loss: 6.0805 Acc: [0.70337922 0.66287647 0.62426437 0.61049716 0.58362847 0.55470934] [Branch 6, Epochs 15--20] Loss: 6.0863 Acc: [0.70052992 0.66098581 0.62202753 0.60762123 0.58730328 0.55588102] Validation - [Branch 6, Epochs 15--20] Loss: 1.2885 Acc: [0.51787947 0.51987997 0.52413103 0.53338335 0.53113278 0.52163041 0.54013503] [Branch 6, Epochs 16--20] Loss: 6.0771 Acc: [0.70258035 0.66271669 0.62711368 0.60791415 0.5854925 0.55420339] [Branch 6, Epochs 17--20] Loss: 6.0211 Acc: [0.70660134 0.6624504 0.62479695 0.61302692 0.58586531 0.56381647] Validation - [Branch 6, Epochs 17--20] Loss: 1.3007 Acc: [0.51512878 0.51912978 0.52213053 0.53013253 0.53988497 0.52188047 0.54213553] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6 [Branch 6, Epochs 18--20] Loss: 6.0235 Acc: [0.70516337 0.66513994 0.62540942 0.60980481 0.58975315 0.56317738] [Branch 6, Epochs 19--20] Loss: 5.9821 Acc: [0.70753335 0.66463398 0.62935052 0.61555668 0.59175033 0.56818363] Validation - [Branch 6, Epochs 19--20] Loss: 1.2859 Acc: [0.51237809 0.52538135 0.53863466 0.53588397 0.53888472 0.52538135 0.5483871 ] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6 [Branch 6, Epochs 20--20] Loss: 5.9601 Acc: [0.70628179 0.66865497 0.63132107 0.61451815 0.58956675 0.56685218] Validation - [Branch 6, Epochs 20--20] Loss: 1.2731 Acc: [0.51912978 0.53063266 0.52513128 0.53138285 0.53063266 0.52888222 0.53988497] [Branch 7, Epochs 1--20] Loss: 7.8431 Acc: [0.67925332 0.64743163 0.61012436 0.59806141 0.58243017 0.57958086 [Branch 7, Epochs 1--20] Loss: 7.8431 Acc: [0.67925332 0.64743163 0.61012436 0.59806141 0.58243017 0.57958086 [96/1905] 0.36071685] Validation - [Branch 7, Epochs 1--20] Loss: 1.5718 Acc: [0.51262816 0.52063016 0.52088022 0.53538385 0.53538385 0.52913228 0.4136034 0.53538385] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7 [Branch 7, Epochs 2--20] Loss: 7.6890 Acc: [0.67352808 0.64538119 0.61145581 0.60072431 0.5828296 0.58109871 0.43474556] [Branch 7, Epochs 3--20] Loss: 7.5777 Acc: [0.67571166 0.65038745 0.61390568 0.60381328 0.58501318 0.58533273 0.46496951] Validation - [Branch 7, Epochs 3--20] Loss: 1.4135 Acc: [0.52488122 0.52113028 0.52513128 0.5403851 0.53413353 0.53113278 0.4656164 0.54488622] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7 [Branch 7, Epochs 4--20] Loss: 7.5092 Acc: [0.68015871 0.64977498 0.6166751 0.60266823 0.58780923 0.58682396 0.47815088] [Branch 7, Epochs 5--20] Loss: 7.4739 Acc: [0.68031848 0.64679253 0.61286715 0.60296115 0.58474689 0.58432083 0.48970788] Validation - [Branch 7, Epochs 5--20] Loss: 1.3716 Acc: [0.51812953 0.51787947 0.52488122 0.53113278 0.53338335 0.53063266 0.48412103 0.5423856 ] [Branch 7, Epochs 6--20] Loss: 7.3876 Acc: [0.68415306 0.65283732 0.62082923 0.60655607 0.58884776 0.58807552 0.50225015] [Branch 7, Epochs 7--20] Loss: 7.3576 Acc: [0.68433947 0.65358294 0.61656858 0.60810055 0.58826192 0.58935371 0.50667057] Validation - [Branch 7, Epochs 7--20] Loss: 1.3330 Acc: [0.51312828 0.52338085 0.5303826 0.53213303 0.53413353 0.52788197 0.50012503 0.54088522] [Branch 7, Epochs 8--20] Loss: 7.2918 Acc: [0.69176897 0.65528719 0.62317258 0.60983144 0.59105797 0.5927356 0.51362075] [Branch 7, Epochs 9--20] Loss: 7.2797 Acc: [0.68809416 0.65435518 0.62330573 0.61156233 0.59230954 0.59558491 0.52179586] Validation - [Branch 7, Epochs 9--20] Loss: 1.3294 Acc: [0.50262566 0.51787947 0.52863216 0.53338335 0.53538385 0.5383846 0.50162541 0.54488622] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7 [Branch 7, Epochs 10--20] Loss: 7.2314 Acc: [0.6934466 0.66130536 0.62551594 0.61467792 0.59324155 0.59715602 0.52523101] [Branch 7, Epochs 11--20] Loss: 6.9503 Acc: [0.71493622 0.67616435 0.64128032 0.62703379 0.6042926 0.60527787 0.54738636] Validation - [Branch 7, Epochs 11--20] Loss: 1.2938 Acc: [0.51212803 0.51787947 0.52813203 0.52788197 0.53513378 0.53463366 0.52263066 0.5423856 ] [Branch 7, Epochs 12--20] Loss: 6.8322 Acc: [0.72659974 0.68844034 0.65020105 0.62908423 0.6069555 0.60913908 0.55122094] [Branch 7, Epochs 13--20] Loss: 6.8261 Acc: [0.72540143 0.6839134 0.64809736 0.6323596 0.60650281 0.60852662 0.55281868] Validation - [Branch 7, Epochs 13--20] Loss: 1.2952 Acc: [0.51887972 0.52488122 0.52488122 0.53163291 0.54488622 0.53588397 Validation - [Branch 7, Epochs 13--20] Loss: 1.2952 Acc: [0.51887972 0.52488122 0.52488122 0.53163291 0.54488622 0.53588397 0.51962991 0.55288822] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7 [Branch 7, Epochs 14--20] Loss: 6.7826 Acc: [0.72992837 0.6880409 0.64958858 0.63185365 0.60748808 0.61134929 0.55707933] [Branch 7, Epochs 15--20] Loss: 6.7051 Acc: [0.7344553 0.69203526 0.65563337 0.63803158 0.61148244 0.61134929 0.56235188] Validation - [Branch 7, Epochs 15--20] Loss: 1.2900 Acc: [0.51112778 0.52588147 0.52288072 0.52713178 0.5363841 0.5343836 0.52013003 0.54463616] [Branch 7, Epochs 16--20] Loss: 6.7301 Acc: [0.73067398 0.69203526 0.65230474 0.63606103 0.61166884 0.60977818 0.56349692] [Branch 7, Epochs 17--20] Loss: 6.6841 Acc: [0.73536069 0.69408569 0.65326339 0.64221234 0.61465129 0.61126941 0.56642612] Validation - [Branch 7, Epochs 17--20] Loss: 1.3045 Acc: [0.51062766 0.51462866 0.52988247 0.53688422 0.53463366 0.52913228 0.51737934 0.54363591] [Branch 7, Epochs 18--20] Loss: 6.6579 Acc: [0.7385828 0.69563018 0.65470136 0.63859079 0.61222805 0.61555668 0.56685218] [Branch 7, Epochs 19--20] Loss: 6.5918 Acc: [0.74031369 0.69797353 0.66117221 0.64141347 0.61387905 0.61640881 0.57207147] Validation - [Branch 7, Epochs 19--20] Loss: 1.2908 Acc: [0.51537884 0.51437859 0.52788197 0.54288572 0.53013253 0.53713428 0.52938235 0.54913728] [Branch 7, Epochs 20--20] Loss: 6.5987 Acc: [0.73914201 0.70055655 0.66103906 0.64362368 0.61912497 0.61797992 0.5737491 ] Validation - [Branch 7, Epochs 20--20] Loss: 1.2965 Acc: [0.50787697 0.51537884 0.52513128 0.5343836 0.53488372 0.53613403 0.52588147 0.54538635] [Branch 8, Epochs 1--20] Loss: 8.7097 Acc: [0.70132879 0.66625835 0.63422363 0.61917823 0.59949937 0.60019173 0.56576039 0.35927889] Validation - [Branch 8, Epochs 1--20] Loss: 1.5464 Acc: [0.51237809 0.51937984 0.52513128 0.52588147 0.52863216 0.52963241 0.52613153 0.40985246 0.53863466] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [Branch 8, Epochs 2--20] Loss: 8.5017 Acc: [0.69741432 0.66798924 0.63347802 0.61917823 0.59617075 0.59963252 0.56927542 0.43740846] [Branch 8, Epochs 3--20] Loss: 8.4253 Acc: [0.70015711 0.6653796 0.63094826 0.61939126 0.59835433 0.60045802 0.56999441 0.46739275] Validation - [Branch 8, Epochs 3--20] Loss: 1.4408 Acc: [0.50862716 0.51687922 0.5223806 0.52988247 0.52988247 0.52713178 0.52788197 0.46261565 0.54013503] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [Branch 8, Epochs 4--20] Loss: 8.3522 Acc: [0.6997843 0.66737677 0.63526216 0.62189439 0.60184273 0.60173621 Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [16/1905] [Branch 8, Epochs 4--20] Loss: 8.3522 Acc: [0.6997843 0.66737677 0.63526216 0.62189439 0.60184273 0.60173621 0.57350944 0.48033446] [Branch 8, Epochs 5--20] Loss: 8.3245 Acc: [0.69999734 0.66490027 0.63369105 0.62042979 0.60146992 0.60434586 0.57137912 0.49564615] Validation - [Branch 8, Epochs 5--20] Loss: 1.3778 Acc: [0.51387847 0.51112778 0.52613153 0.52763191 0.53263316 0.53788447 0.52588147 0.48362091 0.54463616] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [Branch 8, Epochs 6--20] Loss: 8.2452 Acc: [0.70385855 0.67059889 0.63571486 0.6224536 0.60277475 0.60690224 0.57502729 0.50411419] [Branch 8, Epochs 7--20] Loss: 8.2005 Acc: [0.70479056 0.67174394 0.6385109 0.62620829 0.60426597 0.60607674 0.57617234 0.50928022] Validation - [Branch 8, Epochs 7--20] Loss: 1.3490 Acc: [0.50712678 0.51762941 0.5283821 0.52663166 0.5323831 0.52588147 0.52513128 0.49737434 0.54188547] [Branch 8, Epochs 8--20] Loss: 8.1161 Acc: [0.70811919 0.67544537 0.64269166 0.62495673 0.60770112 0.6084201 0.58021996 0.51415333] [Branch 8, Epochs 9--20] Loss: 8.0926 Acc: [0.70870503 0.67778873 0.64165313 0.62743323 0.60884616 0.60921897 0.57713099 0.52435225] Validation - [Branch 8, Epochs 9--20] Loss: 1.3282 Acc: [0.51487872 0.51762941 0.52613153 0.52738185 0.52788197 0.53188297 0.53563391 0.51162791 0.5403851 ] [Branch 8, Epochs 10--20] Loss: 8.0606 Acc: [0.71131468 0.67741592 0.64514153 0.6302559 0.60876628 0.60983144 0.58413442 0.53047693] [Branch 8, Epochs 11--20] Loss: 7.7395 Acc: [0.73658563 0.70279339 0.66018694 0.64572737 0.62120203 0.62192102 0.58682396 0.54554896] Validation - [Branch 8, Epochs 11--20] Loss: 1.3089 Acc: [0.52388097 0.52188047 0.53313328 0.52488122 0.53938485 0.52713178 0.52613153 0.51587897 0.54713678] Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [Branch 8, Epochs 12--20] Loss: 7.5885 Acc: [0.74702421 0.70822571 0.67201023 0.65139936 0.62748649 0.62620829