openai / automated-interpretability

940 stars 110 forks source link

Dataset for neuron activation #19

Closed hanningzhang closed 1 year ago

hanningzhang commented 1 year ago

Hi.

I am wondering where can I get all the random samples you used to calculate the activation, instead of opening tens of thousands of JSON files to get them. I am trying to use the same random samples on other LLMs.

Thanks.

BiEchi commented 7 months ago

You can try use a script to download all the JSONs with a Python script.

clclclaiggg commented 1 week ago

Hello, can you share the script? Thank you.