EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.
MIT License
182 stars 33 forks source link

Select metric choice for visualization #286

Open reaganjlee opened 1 year ago

reaganjlee commented 1 year ago

Previously, the visualization code only allowed for auroc_estimate to be visualized. This PR adds this functionality, allowing users to specify an optional --metric argument in elk plot or elk sweep