search

AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer
https://tuned-lens.readthedocs.io/en/latest/
MIT License
432 stars 47 forks source link

Unembeding hashes are broken #89

Closed levmckinney closed 1 year ago

levmckinney commented 1 year ago

It appears that #81 inadvertently changed the unembeding hash of nearly every model leading to annoying warnings when downloading lenses. We should add tests to ensure this does not happen again and update the hashes for each model on hugging face hub.

An alternative solution is to scrap the entire idea of the unbending hash.

levmckinney commented 1 year ago

Incorect unembeding hashes where removed https://huggingface.co/spaces/AlignmentResearch/tuned-lens/discussions/39