Watts-Lab / commonsense-platform

Commonsense platform
https://commonsense.seas.upenn.edu
1 stars 0 forks source link

Dashboard improvements #82

Closed markwhiting closed 5 months ago

markwhiting commented 9 months ago
amirrr commented 7 months ago

UI overhaul and dashboard plot ideas (Help wanted!)

Screenshot 2023-11-20 at 4 37 58 in the afternoon
markwhiting commented 7 months ago

I think the histogram and your position on it remains good — so let's keep that as the main score presentation. We can of course improve styling on it.

I like the spider diagram though I think it will be hard to populate because in many cases, e.g., the design point experiment, we will only have statements with one of the two dimensions. We could try to say something like "predicted accuracy" and use a model to estimate out of sample accuracies. But I think that might be tricky until we have more design point data.

I wonder if a PQ commonsense plot for them compared with others in their treatment would be an interesting option?

Overall, I'm not too worried about just the histogram, though adding other things could be interesting. But perhaps we can see how people use the histogram and see what other data people seem to wonder about and update then?