Getting Top Activating Text Excerpts Per Neuron

[baselmousi]

Hello,

Can you please clarify how do you get the top activating text excerpts per neuron? Do you average the activation values for all tokens in the text excerpt or do you sum them up?

[williamrs-openai]

We take maximum over all activations in each text excerpt, then take the text excerpts with the highest maximum activation value.