Closed sx-liu closed 2 months ago
To complete the proposal in the issue #76.
The implementation is basically the same as originally designed.
Specifically,
ihvp_at_x_ekfac
dattri.func.ihvp
manual
MLPCache
dattri.func.ihvp._check_input_size
Thanks for the PR. I will also take a look later.
@sleepymalc could you also take a look at this PR?
Description
1. Motivation and Context
To complete the proposal in the issue #76.
2. Summary of the change
The implementation is basically the same as originally designed.
Specifically,
ihvp_at_x_ekfac
and its helper functions todattri.func.ihvp
.manual
and classMLPCache
todattri.func.ihvp
.dattri.func.ihvp._check_input_size
to support the EK-FAC method.3. What tests have been added/updated for the change?