search

EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.
MIT License
178 stars 33 forks source link

Add hyperparamter sweep to `sweep.py`; Fall back to `eig` when `eigh` fails #235

Closed AlexTMallen closed 1 year ago

AlexTMallen commented 1 year ago

This also incorporates my 4x smaller reporters change, and falls back to torch.linalg.eig when there's an error with eigh.