Confusion about the size of SAEs.

openai / sparse_autoencoder

MIT License

339 stars 35 forks source link

Confusion about the size of SAEs. #13

Closed Hambaobao closed 2 weeks ago

Hambaobao commented 4 months ago

Hello, may I inquire if the ‘16 million’ mentioned in your paper regarding the ‘we train a 16 million latent autoencoder’ refers to the size of the latent dimensions?