doomie / HessianFree

An implementation of the Hessian-free optimization algorithm in Theano
61 stars 23 forks source link

What's the theory Support for this code? #3

Open appleyuchi opened 5 years ago

appleyuchi commented 5 years ago

def gauss_vect_mult(v): Jv = T.Rop(output, params, v) HJv = T.Rop(T.grad(opt_cost,output), output, Jv) JHJv = T.Lop(output, params, HJv) if not isinstance(JHJv,list): JHJv = [JHJv] JHJv = [a+ridge*b for a,b in zip(JHJv,v)] return JHJv Could you tell me What the theory Support for this code is?

Thanks@doomie