Complete QK/OV Circuit visualizations - Githubissues

jbloomAus / DecisionTransformerInterpretability

Interpreting how transformers simulate agents performing RL tasks

https://jbloomaus-decisiontransformerinterpretability-app-4edcnc.streamlit.app/

MIT License

61 stars 15 forks source link

Complete QK/OV Circuit visualizations #81

Open jbloomAus opened 1 year ago

jbloomAus commented 1 year ago

QK

[ ] State to Action.

OV

[] Fix head selection (default to all)
[ ] Find a way to automatically find axes in the OV circuit heads.