search

interpreting-rl-behavior / interpreting-rl-behavior.github.io

Code for the site https://interpreting-rl-behavior.github.io/
Creative Commons Attribution 4.0 International
0 stars 0 forks source link

Customise the samples and saliency type shown in each panel #55

Closed danbraunai closed 2 years ago

danbraunai commented 2 years ago

Instead of each panel defaulting to the same sample, and allowing a dropdown of the same samples, customise these for each panel.

leesharkey commented 2 years ago

Related to this:

Sometimes we'll have a story in the text that says "Look at panel X and see that this {saliency map/ set of samples/activations} exhibit property A_X". For example "The panel below shows that direction 12 is to a jump controller"

But we'll also want to be able to say: "Look at this set of panels. In each panel {Y,Z,Q etc} we see that they exhibit property {P_Y, P_Z, P_Q}". For example "The set of panels below shows panels for samples where we've maximised the activations individual hx neurons. It shows they don't have much semantic meaning".

Maybe best to chat about this. I'm not sure how best to present we should present this kind of thing.

danbraunai commented 2 years ago

Maybe we should just present this as a single panel with radio buttons (or something similar where all samples are displayed clearly) for the different samples as opposed to a dropdown? The downside is that it won't allow the user to select other samples to compare against.

leesharkey commented 2 years ago

If I've understood you correctly (and i'm not sure I have), the issue with this might be that: 1) we can't display all the samples at once in some cases if we want to also refer to e.g. saliency + the observation 2) There might be a lot of samples Think we should call on it to make sure we're talking about the same thing though

leesharkey commented 2 years ago

@danbraunai IIRC you've done this, right? Closing. Reopen if not.

danbraunai commented 2 years ago

@leesharkey I don't think this is really an issue. When it is time for writing the paper and selecting the samples we want to show in each panel, it is easy to do so.