Add option to save probabilities

EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.

MIT License

175 stars 32 forks source link

Closed AlexTMallen closed 9 months ago

AlexTMallen commented 11 months ago

modifies prepare_data to return a LayerData object
adds an option to save the raw probabilities, alongside the texts, to the results dir
adds train_lr_eval.csv to results dir

norabelrose commented 9 months ago

included in #292