EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.
MIT License
186 stars 33 forks source link

Refactor & rename lanczos_eigsh for convergence, correctness, & speed #164

Closed norabelrose closed 1 year ago

norabelrose commented 1 year ago

Some technical changes to lanczos_eigsh which should fix convergence issues in some cases. Makes the eigsh tests more rigorous.