jbloomAus / SAELens

Training Sparse Autoencoders on Language Models
https://jbloomaus.github.io/SAELens/
MIT License
193 stars 67 forks source link

HookedSAETransformer #160

Closed ckkissane closed 1 month ago

ckkissane commented 1 month ago

Description

Moving HookedSAETransformer from TransformerLens to SAELens, which I originally implemented here: https://github.com/TransformerLensOrg/TransformerLens/pull/536

Type of change

Please delete options that are not relevant.

Checklist:

You have tested formatting, typing and unit tests (acceptance tests not currently in use)

jbloomAus commented 1 month ago

Amazing! Just noting that I'm rebasing a refactor that supports this PR onto this PR so I will accept that PR when finished and close this one. It should show you as the author of those files in the history and do creditation properly.

jbloomAus commented 1 month ago

Closing this since it was already merged as part of the 3.0 refactor.