[dattri.func] Re-define Arnoldi algorithm as a projection method

tingwl0122 commented 1 month ago

Description

1. Motivation and Context

Originally, Arnoldi algorithm is defined as one of the ihvp method in dattri/func/ihvp.py, but funcitonal-wise, it is closer to a projection method with approximation on the inverse-Hessian. Thus, we move it to dattri/func/projection.py.

2. Summary of the change

Re-name dattri/func/random_projection.py as dattri/func/projection.py
Define a new class of projector named ArnoldiProjector to take care of the Arnoldi algorithm.

3. What tests have been added/updated for the change?

[x] Unit test: Typically, this should be included if you implemented a new function/fixed a bug.

tingwl0122 commented 1 month ago

The projector LGTM, so we still need another PR to make this support IFAttributorArnoldi right?

Yes, or do you think it is better to include that in this PR?

tingwl0122 commented 1 month ago

The projector LGTM, so we still need another PR to make this support IFAttributorArnoldi right?

Yes, or do you think it is better to include that in this PR?

probably not, I will do this in the next PR.

tingwl0122 commented 1 month ago

Closed since commit history is too messy, a new PR (#108) will replace this.

TRAIS-Lab / dattri