Devographics / surveys

YAML config files for the Devographics surveys
43 stars 8 forks source link

Idea: Organizing features by priority, rather than category, with "Ask me about more" functionality #38

Open LeaVerou opened 1 year ago

LeaVerou commented 1 year ago

Right now the CSS features we ask about are organized in categories like Layout, Typography etc, and everybody is asked the same set of questions. There are several discussions about which features to add, and eventually we're not going to be able to add all of them, simply to not make the survey too long and cause fatigue.

However, I'd wager that some people may actually be fine answering a longer survey, and may even like being exposed to multiple different features they may or may not have heard about.

But here's a crazy idea: what if instead of organizing the features in these thematic categories, we ranked them by priority, and initially showed every respondent a subset of N features that we ranked with the highest priority, with a button "Ask me about more features" that would progressively reveal more? Then everything we consider valuable could get in, and the only hard decision would be how to rank it, not whether to include it at all.

The main caveat being self-selection bias: The kinds of people that click "show me more" may not be a representative sample. Maybe they're more into CSS, or have more time in their hands because they are not fully employed or are younger etc. There are many ways in which this simple decision gets you a less representative group. Not sure if this is enough of a concern to not do this though.

SachaG commented 1 year ago

I think that might be outside the scope of what we're able to do for this next edition, but it could be interesting down the road. I would still like to keep the current categories though, but maybe prioritize within that?