ApolloResearch / rib

Library for methods related to the Local Interaction Basis (LIB)
MIT License
3 stars 0 forks source link

Remove epsilon from script configs #225

Closed danbraunai-apollo closed 9 months ago

danbraunai-apollo commented 9 months ago

Remove epsilon from script configs

Description

Related Issue

Closes #224

Motivation and Context

We previously allowed the user to set the layer norm epsilon in the build script. This was for debugging the relationship between epsilon and the n_intervals in the integrad. This is no longer needed.

Does this PR introduce a breaking change?

Yes. Some people may have had with an "eps" set in their rib build and/or ablation configs. They will need to delete these. Easy and obvious fix.

nix-apollo commented 9 months ago

Looks good from a quick glance