AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer
https://tuned-lens.readthedocs.io/en/latest/
MIT License
432 stars 47 forks source link

Generate from the lens #109

Closed levmckinney closed 1 year ago

levmckinney commented 1 year ago

Adds the ability to easily generate tokens from the tuned lens.

codecov[bot] commented 1 year ago

Codecov Report

Merging #109 (99076b6) into main (9bf1f35) will increase coverage by 0.61%. Report is 4 commits behind head on main. The diff coverage is 97.43%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #109      +/-   ##
==========================================
+ Coverage   80.95%   81.56%   +0.61%     
==========================================
  Files          32       32              
  Lines        2116     2181      +65     
==========================================
+ Hits         1713     1779      +66     
+ Misses        403      402       -1     
Files Changed Coverage Δ
tuned_lens/nn/lenses.py 92.75% <96.29%> (+0.93%) :arrow_up:
tests/test_lenses.py 88.75% <100.00%> (+1.98%) :arrow_up:

... and 6 files with indirect coverage changes