ApolloResearch / rib

Library for methods related to the Local Interaction Basis (LIB)
MIT License
2 stars 0 forks source link

[WIP] Add CIFAR model to repo and tests #298

Closed nix-apollo closed 4 months ago

nix-apollo commented 8 months ago

Lambda fix

Description

The lambda matrix will permute directions to sort them by lambda value. In some circumstances this will permute the constant direction away from the 0th index. This PR fixes that.

I also added a cifar model to the sample MLP folder so we can run rib_build tests on it.

Motivation and Context

Fixes a bug that breaks our constant direction invariant.

How Has This Been Tested?

Adds a test on CIFAR that would have caught this on main.

Does this PR introduce a breaking change?

No.