Originally, Arnoldi algorithm is defined as one of the ihvp method in dattri/func/ihvp.py, but funcitonal-wise, it is closer to a projection method with approximation on the inverse-Hessian. Thus, we move it to dattri/func/projection.py.
2. Summary of the change
re-open arnoldi pr (#100)
fix mnist_lr and mnist_mlp loss definition
fix corresponding test files
3. What tests have been added/updated for the change?
[x] Unit test: Typically, this should be included if you implemented a new function/fixed a bug.
Description
1. Motivation and Context
Originally, Arnoldi algorithm is defined as one of the ihvp method in
dattri/func/ihvp.py
, but funcitonal-wise, it is closer to a projection method with approximation on the inverse-Hessian. Thus, we move it todattri/func/projection.py
.2. Summary of the change
mnist_lr
andmnist_mlp
loss definition3. What tests have been added/updated for the change?