ApolloResearch / rib

Library for methods related to the Local Interaction Basis (LIB)
MIT License
3 stars 0 forks source link

Add return_set_frac and return_set_n_samples to modadd #234

Closed danbraunai-apollo closed 9 months ago

danbraunai-apollo commented 9 months ago

We can add parameters for return_set_frac and return_set_n_sampels to modular arithmetic. Pseudocode will be something like:

This could be handled inside of create_modular_arithmetic_dataset by sampling from raw_dataset.

Once implemented, use a small sample of the dataset in all of the modular addition tests where it makes sense (which is probably all of them?). And uncomment test_build_graph.test_modular_arithmetic_rotate_final_layer_invariance.