EleutherAI / project-menu

See the issue board for the current status of active and prospective projects!
65 stars 4 forks source link

poke at logit lens #6

Closed Gurkenglas closed 1 year ago

Gurkenglas commented 3 years ago

The logit lens describes a supisciously legible pattern in GPT's internals. Let's play around with it: Can we enforce it? Can we suppress it? Call Gurkenglas on discord for rambling.