AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer
https://tuned-lens.readthedocs.io/en/latest/
MIT License
426 stars 46 forks source link

Polish up the evaluation scripts #92

Closed levmckinney closed 1 year ago

levmckinney commented 1 year ago
codecov[bot] commented 1 year ago

Codecov Report

Merging #92 (47358b1) into main (1308bdd) will increase coverage by 0.51%. The diff coverage is 87.05%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main      #92      +/-   ##
==========================================
+ Coverage   79.57%   80.08%   +0.51%     
==========================================
  Files          32       32              
  Lines        1826     1888      +62     
==========================================
+ Hits         1453     1512      +59     
- Misses        373      376       +3     
Impacted Files Coverage Δ
tests/scripts/test_integration.py 100.00% <ø> (ø)
tuned_lens/scripts/ingredients.py 85.63% <75.00%> (+0.08%) :arrow_up:
tuned_lens/stats/logit_stats.py 93.10% <85.00%> (-2.65%) :arrow_down:
tuned_lens/scripts/eval_loop.py 90.24% <87.71%> (+1.54%) :arrow_up:
tuned_lens/scripts/train_loop.py 78.29% <100.00%> (+0.09%) :arrow_up:

... and 1 file with indirect coverage changes