Added option to exclude special tokens from SAE reconstruction

adamkarvonen / SAEBench

7 stars 10 forks source link

Added option to exclude special tokens from SAE reconstruction #32

Closed curt-tigges closed 1 week ago

curt-tigges commented 1 week ago

This PR adds the ability to exclude special tokens (BOS, EOS, PAD, which are already ignored in some parts of the code) from the SAE reconstruction during Core evaluations.