search

AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer
https://tuned-lens.readthedocs.io/en/latest/
MIT License
408 stars 42 forks source link

Added use_auth_token to access gated HF models #107

Closed hunarbatra closed 1 year ago

hunarbatra commented 1 year ago

This PR adds use_auth_token to be able to access gated HuggingFace models such as LLaMa2 models.

HuggingFace PR for LLaMa2-7B Tuned Lens trained over RedPajama-Data-1T-Sample: https://huggingface.co/spaces/AlignmentResearch/tuned-lens/discussions/41

codecov[bot] commented 1 year ago

Codecov Report

Merging #107 (57104a9) into main (9bf1f35) will increase coverage by 0.05%. The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #107      +/-   ##
==========================================
+ Coverage   80.95%   81.00%   +0.05%     
==========================================
  Files          32       32              
  Lines        2116     2122       +6     
==========================================
+ Hits         1713     1719       +6     
  Misses        403      403
Files Changed Coverage Δ
tuned_lens/scripts/ingredients.py 86.11% <100.00%> (+0.47%) :arrow_up: