search

AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer
https://tuned-lens.readthedocs.io/en/latest/
MIT License
437 stars 47 forks source link

Speed up integration tests #102

Closed levmckinney closed 1 year ago

levmckinney commented 1 year ago

These are currently taking 3 to 5 minutes. PR should make them under a minute.

codecov[bot] commented 1 year ago

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@5a641ae). Click here to learn what that means. The diff coverage is 100.00%.

Impacted file tree graph

@@           Coverage Diff           @@
##             main     #102   +/-   ##
=======================================
  Coverage        ?   79.57%           
=======================================
  Files           ?       32           
  Lines           ?     1826           
  Branches        ?        0           
=======================================
  Hits            ?     1453           
  Misses          ?      373           
  Partials        ?        0
Impacted Files Coverage Δ
tests/conftest.py 100.00% <100.00%> (ø)
tests/scripts/test_integration.py 100.00% <100.00%> (ø)
levmckinney commented 1 year ago

I guess I underestimated how much this would improve things. It actually saves almost 10 mins in the CI.