Added ability to adding arbitrary vectors to the residual stream

AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer

https://tuned-lens.readthedocs.io/en/latest/

MIT License

432 stars 47 forks source link

Closed levmckinney closed 1 year ago

levmckinney commented 1 year ago

I'm not supper happy with the interface for this and I don't think this is critical for 1.0. Thus I'm closing this PR.