search

EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.
MIT License
175 stars 32 forks source link

Fixed bug with encoder only models not expecting "labels" argument in forward pass #264

Closed AugustasMacijauskas closed 1 year ago

AugustasMacijauskas commented 1 year ago

After fixing, I tested with:

All of them seemed to work as expected.

CLAassistant commented 1 year ago

CLA assistant check
All committers have signed the CLA.

artkpv commented 1 year ago

Works for me with elk elicit allenai/unifiedqa-t5-base imdb --net ccs (code at https://github.com/artkpv/elk/tree/pipenv-files)

AugustasMacijauskas commented 1 year ago

@artkpv Have you also tested with --use_encoder_states because that is what initially caused the issue for me?