TransformerLensOrg / TransformerLens

A library for mechanistic interpretability of GPT-style language models
https://transformerlensorg.github.io/TransformerLens/
MIT License
1.45k stars 283 forks source link

Unit tests loading from pretrained fill missing keys #623

Closed richardkronick closed 3 months ago

richardkronick commented 4 months ago

Description

Addition of unit tests covering the fill_missing_keys function from loading_from_pretrained.py.

Fixes # (issue)

Type of change

New unit tests.

Screenshots

Please attach before and after screenshots of the change if applicable.

Checklist:

bryce13950 commented 3 months ago

Beautiful