EleutherAI / sae

Sparse autoencoders
MIT License
333 stars 46 forks source link

Added back in "signed" property of SaeConfig to support loading older weights #25

Closed jkminder closed 2 months ago

jkminder commented 2 months ago

SAE weights such as EleutherAI/sae-llama-3-8b-32x and EleutherAI/sae-llama-3-8b-32x-v2 still have the "signed" parameter in their config file. Removing this property from the SaeConfig, results in an error during loading these weights.

Added back in this config property.

CLAassistant commented 2 months ago

CLA assistant check
All committers have signed the CLA.

norabelrose commented 2 months ago

Thanks for pointing out this issue. I implemented a more future-proof solution in commit 323b87a.