AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer
https://tuned-lens.readthedocs.io/en/latest/
MIT License
438 stars 47 forks source link

Lenses should use the Decoder class #42

Closed levmckinney closed 1 year ago

levmckinney commented 1 year ago

There is a lot of redundant code between the lens classes and the decoder class. This should probably be fixed.

norabelrose commented 1 year ago

Goooood this was my plan before I got sidetracked by ELK stuff