ai-safety-foundation / sparse_autoencoder

Sparse Autoencoder for Mechanistic Interpretability
https://ai-safety-foundation.github.io/sparse_autoencoder/
MIT License
192 stars 39 forks source link

Resampler interval fix #139

Closed HoagyC closed 12 months ago

HoagyC commented 12 months ago

(My) resampling logic was wrong, and only passed tests because it assumed that resample_interval % batch_size == 0, which was true for our testing, have added a test that the previous version would have failed.

Highlights the need for a resampler test that tests the whole section end to end.

alan-cooney commented 12 months ago

Solved in #141