Open dtch1997 opened 2 weeks ago
Support training, loading, and inference of MLP transcoders.
MLP transcoders were trained by Jacob Dunefsky and Philippe Chlenski and have been shown to be useful.
HookedTranscoder
HookedSAE
I'm likely going to be rather hacky with the first pass of the implementation, and possibly duplicate a bunch of code in order to have maximum freedom to make changes. Refactoring can be done later.
Proposal
Support training, loading, and inference of MLP transcoders.
Motivation
MLP transcoders were trained by Jacob Dunefsky and Philippe Chlenski and have been shown to be useful.
Pitch
HookedTranscoder
class analogous toHookedSAE
and using similar functionality.Checklist