DylanMuir
commented
7 years ago Hi,
Finally taking a look at this. I can’t reproduce the errors I’m afraid. Your test function works as expected for me when I use the code you provided:
fun = @testFunk; x0 = [0,0]; [x, fval, exitflag, output] = fmin_adam(fun, x0);
Iteration Func-count f(x) Improvement Step-size
5000 10002 0.17 0.00032 0.00038Finished optimization. Reason: Number of function evaluations reached MaxFunEvals [10000].
Also, when I call options = optimset(@fmin_adam);
I get an options structure containing many many fields, including GradObj, DerivativeCheck, etc.
Could you please let me know what version of matlab you are using, and on what platform?
tordbb
amrossetto
Hi,
I started to try out your package “Adam stochastic gradient descent optimization” on matlab file exchange. https://se.mathworks.com/matlabcentral/fileexchange/61616-adam-stochastic-gradient-descent-optimization
Quite an impressive piece of work! You might want to know that I have no extensions to Matlab. I tried to apply it on a simple function handle with two inputs, but it failed:
function [value, gradients] = testFunk(x0)
x = x0(1); y = x0(2);
value = (y-3)^2 + (x-4)^2; gradients = [2x-8, 2y-6];
(and its application…)
fun = @testFunk; x0 = [0,0]; [x, fval, exitflag, output] = fmin_adam(fun, x0);
As I tried to debug fmin_adam, I realized that the parameter “options” is not properly set with all the required fields:
Reference to non-existent field 'GradObj'. … Reference to non-existent field 'DerivativeCheck'. ... Reference to non-existent field 'UseParallel'. …
So when I apply the following line of code from line
options = optimset(@fmin_adam);
results in the following struct:
options =
struct with fields:
If you wish more feedback on how your code performs, you might wish to add the support for the function to be called with few inputs.