- Adding feature to BlockDiagonalCurvature to return undamped diagonal.

google-deepmind / kfac-jax

Second Order Optimization and Curvature Estimation with K-FAC in JAX.

Apache License 2.0

235 stars 18 forks source link

Closed copybara-service[bot] closed 2 months ago

copybara-service[bot] commented 2 months ago

Adding feature to BlockDiagonalCurvature to return undamped diagonal.
Adding support for complex-valued "tangents" to curvature estimation for NaiveFull blocks.