Optimizer: Is LBFGS implemented?

nitishsrivastava / deepnet

Implementation of some deep learning algorithms.

BSD 3-Clause "New" or "Revised" License

895 stars 438 forks source link

Open parthg opened 10 years ago

parthg commented 10 years ago

Is LBFGS implemented or it just calls GRADIENT_DESCENT inherently?

Because: With GRADIENT_DESCENT and LBFGS the computed errors are exactly same which I thought to improve with LBFGS or at least change a bit.

Is it true or I am specifying it wrongly. I set the "optimizer: LBFGS" in the trainer file of AE.

Thanks in advance.

nitishsrivastava commented 10 years ago

It's not implemented.

parthg commented 10 years ago

Any pointer on where can I add CG by Carl Rasmussen's (minimize.m) as optimizer?