search

EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.
MIT License
186 stars 33 forks source link

simplify eval command syntax #185

Closed ChristyKoh closed 1 year ago

ChristyKoh commented 1 year ago

extract model name from config instead of making user type it into cmdline

ChristyKoh commented 1 year ago

Since we require all the arguments from Extract within Eval, and the model name is a required positional argument for the Extract dataclass, it looks like this change would require a lot of refactoring for a little convenience.