Reverse Logit Lense - Githubissues

jbloomAus / DecisionTransformerInterpretability

Interpreting how transformers simulate agents performing RL tasks

https://jbloomaus-decisiontransformerinterpretability-app-4edcnc.streamlit.app/

MIT License

61 stars 15 forks source link

Reverse Logit Lense #77

Open jbloomAus opened 1 year ago

jbloomAus commented 1 year ago

https://www.lesswrong.com/posts/AcKRB8wDpdaN6v6ru/interpreting-gpt-the-logit-lens

https://colab.research.google.com/drive/1MjdfK2srcerLrAJDRaJQKO0sUiZ-hQtA?usp=sharing

pip install git+https://github.com/finetuneanon/transformers/@gpt-neo-localattention