ApolloResearch / rib

Library for methods related to the Local Interaction Basis (LIB)
MIT License
3 stars 0 forks source link

Allow for analytic integrated gradients for linear layers #206

Closed danbraunai-apollo closed 9 months ago

danbraunai-apollo commented 10 months ago

We have some analytic expressions for integrated gradients of some modules. To speed things up, we should be able to optionally use these analytic formulas instead of numerical methods for the node layers which are of the type in which we have analytic expressions.

danbraunai-apollo commented 9 months ago

Merge with #211