Conjugate Gradient / Line Gradient do not work in Weka Cross Validation

Waikato / wekaDeeplearning4j

Weka package for the Deeplearning4j java library

https://deeplearning.cms.waikato.ac.nz/

GNU General Public License v3.0

185 stars 202 forks source link

Conjugate Gradient / Line Gradient do not work in Weka Cross Validation #18

Open braun-steven opened 6 years ago

braun-steven commented 6 years ago

Choosing CONJUGATE_GRADIENT or LINE_GRADIENT_DESCENT as optimization algorithm in NeuralNetworkConfiguration while performing a cross validation results in the following behavior:

First validation works properly (loss is reduced in each epoch)
Second and further validations' loss is static and does not reduce

TODO: Inspect weights/updates