search

jhjacobsen / invertible-resnet

Official Code for Invertible Residual Networks
MIT License
517 stars 78 forks source link

Wether the Lipschitz constant of Actnorm layer should less than 1 #12

Closed Archer666 closed 4 years ago

Archer666 commented 4 years ago

Hello, this is a great work! But I have a question: To ensure the network reversible，Lipschitz constant must less than 1, and you divide the spectrum norm of conv and fc layer. But, in Actnorm layer, the Lipschitz constant are not linited to less than 1. Wether it should be limited as the conv and fc layer?

jhjacobsen commented 4 years ago

The Actnorm layer has a closed form inverse, so it is not necessary to constrain it.