AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer
https://tuned-lens.readthedocs.io/en/latest/
MIT License
437 stars 47 forks source link

Fixes support for slow tokenizers #91

Closed levmckinney closed 1 year ago

codecov[bot] commented 1 year ago

Codecov Report

Merging #91 (f0cd345) into main (076be8f) will increase coverage by 0.12%. The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main      #91      +/-   ##
==========================================
+ Coverage   78.62%   78.74%   +0.12%     
==========================================
  Files          32       32              
  Lines        1740     1750      +10     
==========================================
+ Hits         1368     1378      +10     
  Misses        372      372              
Impacted Files Coverage Δ
tests/test_data.py 100.00% <100.00%> (ø)
tuned_lens/data.py 85.71% <100.00%> (+1.09%) :arrow_up: