search

EleutherAI / pythia

The hub for EleutherAI's work on interpretability and learning dynamics
Apache License 2.0
2.16k stars 156 forks source link

README Update #120

Closed StellaAthena closed 9 months ago

StellaAthena commented 9 months ago

@haileyschoelkopf can you take a look at this and tell me what you think? Mostly I've cleaned up the language, reducing duplication and centering the purpose of the project, and added notable work that Pythia has enabled. One of the things I have in mind when writing this is making it so that the purpose and impact of the work is legible to policy people.

Note that a couple of the Pythia configs aren't listed because I couldn't find them... hopefully they're in the NeoX configs you have?

haileyschoelkopf commented 9 months ago

Thank you! I will add the config files, finish out the table, and re-mention that this repo also contains the "Emergent and Predictable Memorization" code more prominently. I'll think if there's anything further we need for better legibility...