Clean up train and eval commands; do transfer eval in sweep

EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.

MIT License

178 stars 33 forks source link

Clean up train and eval commands; do transfer eval in sweep #210

Closed norabelrose closed 1 year ago

norabelrose commented 1 year ago

Merged Train and Evaluate classes into their corresponding config classes; removed duplicate code; made the sweep command also run transfer eval on all pairs