taufeeque9 / codebook-features

Sparse and discrete interpretability tool for neural networks
https://huggingface.co/spaces/taufeeque/codebook-features
MIT License
52 stars 3 forks source link

Add code to train FSM toy model #3

Closed taufeeque9 closed 1 year ago

taufeeque9 commented 1 year ago

This PR adds another script train_toy_model.py, similar to train_codebook.py but for training transformer models and codebook models on the FSM sequence modeling task.