search

EleutherAI / elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.
MIT License
178 stars 33 forks source link

Reduce VINC reporter file size by >1000x #219

Closed AlexTMallen closed 1 year ago

AlexTMallen commented 1 year ago

Still unsure why reporter file stores 1 remaining covariance matrix (I deduce this based on size). The python object being saved didn't appear to have any references to any covariance matrices (not even through gradients).

norabelrose commented 1 year ago

Make sure to at least add a command line argument to save the stats

AlexTMallen commented 1 year ago

Make sure to at least add a command line argument to save the stats

Updated