EleutherAI / lm-scope

4 stars 1 forks source link

More advanced queries #13

Open jmerizia opened 2 years ago

jmerizia commented 2 years ago

In order to support more advanced queries without loading too much on the browser, we should use a database with indices. There queries can be grouped into two general categories:

  1. Based on some collection of prompts (i.e., that match a certain pattern), visualize some aspect of the model (i.e., a specific attention head)
  2. Based on a behavior of the model (i.e., a specific attention head) find all the prompts that exhibit (or don't exhibit) this behavior.