AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer
https://tuned-lens.readthedocs.io/en/latest/
MIT License
408 stars 42 forks source link

Improved training docs #115

Closed levmckinney closed 1 year ago

levmckinney commented 1 year ago

These had become pretty out of sync with the current training interface. Fixed that and added a section on uploading lenses to hf hub. Resolves #114

codecov[bot] commented 1 year ago

Codecov Report

Merging #115 (2ea7477) into main (51e988b) will increase coverage by 0.15%. Report is 1 commits behind head on main. The diff coverage is 85.71%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #115      +/-   ##
==========================================
+ Coverage   81.08%   81.23%   +0.15%     
==========================================
  Files          32       32              
  Lines        2141     2137       -4     
==========================================
  Hits         1736     1736              
+ Misses        405      401       -4     
Files Changed Coverage Δ
tests/scripts/test_integration.py 100.00% <ø> (ø)
tuned_lens/scripts/eval_loop.py 92.59% <85.71%> (+2.23%) :arrow_up: