search

ApolloResearch / rib

Library for methods related to the Local Interaction Basis (LIB)
MIT License
3 stars 0 forks source link

PCA basis beats RIB in some Mod Add layers #275

Open stefan-apollo opened 6 months ago

stefan-apollo commented 6 months ago

See OP report results here image

stefan-apollo commented 6 months ago

Specifically embedding layer in seed0 model. Seems to be just by 1 though, so lower confidence that something is terribly wrong

stefan-apollo commented 6 months ago

Let's see if this is going to be fixed by fixing the Lambdas (and using the new basis), via #244