search

AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer
https://tuned-lens.readthedocs.io/en/latest/
MIT License
437 stars 47 forks source link

Stearing vectors #112

Closed levmckinney closed 1 year ago

levmckinney commented 1 year ago

Added a context manager to model surgery that allows for adding abitrary vectors to the residual stream of the model.

rhaps0dy commented 1 year ago

I'll review #121 instead, which seems to be the same but its diff with the main base is up to date.