ai-safety-foundation / sparse_autoencoder

Sparse Autoencoder for Mechanistic Interpretability
https://ai-safety-foundation.github.io/sparse_autoencoder/
MIT License
171 stars 39 forks source link

Handling StopIteration error while generate activations #200

Closed kdkyum closed 7 months ago

kdkyum commented 7 months ago

There may be a StopIteration error depending on the source dataset. To bypass this error, use itertools.cycle.