Implementation of Jacobian evaluation (and adjoint thereof) for invertible networks
Main contributions:
added Jacobian functionalities for most of the layers and networks already implemented, except for layers and networks requiring a "link" function (invertible_layer_slim_additive, invertible_layer_slim_affine, invertible_network_irim) and Flux blocks that requires forward-mode AD;
Jacobians can be wrapped around an abstract linear algebra framework, see /examples/jacobian/jacobian_linear_algebra.jl;
composition functionalities to string networks/layers together, see /examples/utils/composition_of_networks.jl
Jacobians also work together with Composition.
new layers/networks: layer_resnet (as a Flux block), invertible_network_hint_multiscale (previously only had a conditional version)
utilities for Parameter or Array{Parameter, 1} direct manipulation, see /examples/utils/parameter_algebra.jl
Implementation of Jacobian evaluation (and adjoint thereof) for invertible networks
Main contributions:
added Jacobian functionalities for most of the layers and networks already implemented, except for layers and networks requiring a "link" function (
invertible_layer_slim_additive,invertible_layer_slim_affine,invertible_network_irim) and Flux blocks that requires forward-mode AD;Jacobians can be wrapped around an abstract linear algebra framework, see
/examples/jacobian/jacobian_linear_algebra.jl;composition functionalities to string networks/layers together, see
/examples/utils/composition_of_networks.jlJacobians also work together with Composition.new layers/networks: layer_resnet (as a Flux block), invertible_network_hint_multiscale (previously only had a conditional version)
utilities for
ParameterorArray{Parameter, 1}direct manipulation, see/examples/utils/parameter_algebra.jl