Add attention-head superposition - Githubissues

dtch1997 / tms-kit

Toy models of superposition

3 stars 0 forks source link

Add attention-head superposition #3

Open dtch1997 opened 1 month ago

dtch1997 commented 1 month ago

C.f. https://transformer-circuits.pub/2023/may-update/index.html#attention-superposition