search

deel-ai / deel-lip

Build and train Lipschitz constrained networks: TensorFlow implementation of k-Lipschitz layers
https://deel-ai.github.io/deel-lip/
MIT License
89 stars 10 forks source link

Lipschitz constant estimator #30

Open thib-s opened 3 years ago

thib-s commented 3 years ago

The function evaluate_lip_const in the deel.lip.utils module use a sampled method. Although this is acceptable in a low dimensional space (as done in tests) the measured constant can be heavily underestimated in high dimensional space.

There is a need of building a module to evaluate accurately the lipschitz constant of a layer. Especially for Dense and Conv layers.

cofri commented 1 year ago

Do we consider this issue solved with PR #81?