tdeboissiere / DeepLearningImplementations

Implementation of recent Deep Learning papers
MIT License
1.81k stars 652 forks source link

reverse learning!!! #52

Closed bhralzz closed 6 years ago

bhralzz commented 6 years ago

Dear Thibault de Boissiere I tested your code on my own data-set with 130000 sample of 256321 images(256 H, 32 W, 1 C) with 5 class the learning process seems done in a very strange form whats wrong?

the .json file content:

{ "batch_size": 64, "learning_rate": [ 0.0010000000474974513, 0.0010000000474974513, 0.0010000000474974513, 0.0010000000474974513, 0.0010000000474974513, 0.0010000000474974513, 0.0010000000474974513, 0.0010000000474974513, 0.0010000000474974513, 0.0010000000474974513, 0.0010000000474974513 ], "nb_epoch": 30, "optimizer": { "beta_1": 0.8999999761581421, "beta_2": 0.9990000128746033, "decay": 0.0, "epsilon": 1e-08, "lr": 0.0010000000474974513 }, "test_loss": [ [ 0.6066114468840254, 0.8129256968527756 ], [ 0.4871855918467968, 0.8482972138437325 ], [ 0.45037036715277207, 0.8587461300309598 ], [ 0.41322950868414654, 0.8722910219670819 ], [ 0.4041474326845293, 0.8754643962848297 ], [ 0.40550520608299656, 0.8729102170135215 ], [ 0.39118199866991665, 0.8778637773850385 ], [ 0.38647653761293865, 0.8809597523957953 ], [ 0.3755317733199235, 0.8863003097082439 ], [ 0.3637650244376239, 0.8899380805691698 ], [ 0.36609122125725996, 0.886377709052142 ] ], "train_loss": [ [ 0.7174626588821411, 0.7964333891868591 ], [ 0.523139476776123, 0.8357153534889221 ], [ 0.46472862362861633, 0.8522512912750244 ], [ 0.4307743310928345, 0.864177942276001 ], [ 0.4081457853317261, 0.8720802068710327 ], [ 0.3938981592655182, 0.8766551613807678 ], [ 0.38517263531684875, 0.8790456652641296 ], [ 0.3747204840183258, 0.8830181360244751 ], [ 0.3687455356121063, 0.8850733637809753 ], [ 0.36394041776657104, 0.8867501020431519 ], [ 0.3598470687866211, 0.8877047896385193 ] ] }