EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.
MIT License
175 stars 32 forks source link

Evaluate LM output performance in `elk eval` #276

Closed norabelrose closed 1 year ago

norabelrose commented 1 year ago

Right now only elk elicit emits an lm_eval.csv but this would also be useful to have for eval