Add check for model and dataset existence before running

EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.

MIT License

175 stars 32 forks source link

Add check for model and dataset existence before running #250

Closed derpyplops closed 1 year ago

derpyplops commented 1 year ago

Fixes an annoying thing where this command only errors out AFTER the preceding models/datasets are swept through elk sweep --model EleutherAI/pythia-2b potato EleutherAI/pythia-70m --datasets imdb