Adds a custom Pad module which is the nn.Module equivalent of torch.nn.functional.pad. This can be useful for implementing certain ResNets for CIFAR10. This PR also adds support for some second-order extensions.
Add Pad module
Implement jac_t_mat_prod
Support {Batch}DiagGGN{Exact, MC}, {Batch}DiagHessian, SqrtGGN{Exact, MC} extensions
Adds a custom
Pad
module which is thenn.Module
equivalent oftorch.nn.functional.pad
. This can be useful for implementing certain ResNets for CIFAR10. This PR also adds support for some second-order extensions.Pad
modulejac_t_mat_prod
{Batch}DiagGGN{Exact, MC}
,{Batch}DiagHessian
,SqrtGGN{Exact, MC}
extensions