openai / automated-interpretability

977 stars 117 forks source link

Dataset for neuron activation #19

Closed hanningzhang closed 1 year ago

hanningzhang commented 1 year ago

Hi.

I am wondering where can I get all the random samples you used to calculate the activation, instead of opening tens of thousands of JSON files to get them. I am trying to use the same random samples on other LLMs.

Thanks.

BiEchi commented 10 months ago

You can try use a script to download all the JSONs with a Python script.

clclclaiggg commented 3 months ago

Hello, can you share the script? Thank you.