This PR changed configs to compositional style. It includes:
Add from_flattened method for conveniently building nested configurations, by passing outer layer fields to inner layers.
Add Command Line Interface (CLI) to launch from a configuration file (.toml, .yaml, .py, etc.)
Reorganize configs files into more compositional style. Specifically, it moves SAEConfig, LanguageModelConfig, ActivationStoreConfig and TextDatasetConfig from a base class to a field.
This PR changed configs to compositional style. It includes:
from_flattened
method for conveniently building nested configurations, by passing outer layer fields to inner layers.SAEConfig
,LanguageModelConfig
,ActivationStoreConfig
andTextDatasetConfig
from a base class to a field.