Closed levmckinney closed 1 year ago
Merging #103 (cf8b597) into main (1308bdd) will increase coverage by
1.31%
. The diff coverage is90.13%
.
@@ Coverage Diff @@
## main #103 +/- ##
==========================================
+ Coverage 79.57% 80.88% +1.31%
==========================================
Files 32 32
Lines 1826 2077 +251
==========================================
+ Hits 1453 1680 +227
- Misses 373 397 +24
Impacted Files | Coverage Δ | |
---|---|---|
tuned_lens/nn/lenses.py | 91.81% <ø> (ø) |
|
tuned_lens/plotting/token_formatter.py | 88.00% <25.00%> (-12.00%) |
:arrow_down: |
tuned_lens/nn/unembed.py | 86.25% <71.42%> (-0.93%) |
:arrow_down: |
tuned_lens/model_surgery.py | 61.94% <83.33%> (+4.33%) |
:arrow_up: |
tuned_lens/plotting/trajectory_plotting.py | 88.37% <86.66%> (+3.26%) |
:arrow_up: |
tuned_lens/plotting/prediction_trajectory.py | 92.34% <87.61%> (-3.81%) |
:arrow_down: |
tests/plotting/test_prediction_trajectory.py | 100.00% <100.00%> (ø) |
|
tests/plotting/test_trajectory_plotting.py | 100.00% <100.00%> (ø) |
This PR adds several new features that allow for easy integration with the
TransformerLens
repo.Features:
target
and theantitarget
evolves across the trajectory.Recommending reading order
prediction_trajectories.ipynb
notebook. Note you may need to comment the thing out to get the plots to appear on your local system.combining_with_transformer_lens.ipynb
tutorial. This covers most of the new features added with some worked examples.prediction_trajectory.py
What I want feedback on
Does this interface with the transformer lens repo make sense? Is there anything obvious missing? Is the tutorial clear? Are there parts that need more explanation or might be misleading.