web-platform-dx / developer-research

Development of research on developer needs to inform improvements in Web Platform Developer Experience
30 stars 3 forks source link

How many web developers are there? What are the demographics? #7

Open foolip opened 2 years ago

foolip commented 2 years ago

Many discussions about web developer research or surveys raise questions around representation and bias. To help answer questions like this, it would be great to have a good idea about what the global population of web developers looks like, as a point of comparison. (This is not to say all research needs to strive to target the global population.)

Here's what I found when looking into this in October 2020:

World:

Reachable by surveys:

Europe:

USA:

foolip commented 2 years ago

At that time I was mostly focusing on how many web developers there are. I think more important is to understand the basic demographics. Surveys (example) often ask about these some of these demographics:

It would be useful gather and make accessible what we know (and don't know) about these. By gathering many examples, we could start to say what is an outlier and what is typical for some of these demographics. One step further would be to set confidence intervals for what the "true" numbers in the global developers audience is, which is probably not the same as the typical numbers in all the surveys. Specifically, I strongly suspect that men are overrepresented in most web developer surveys, but by how much?

bkardell commented 2 months ago

I brought this up in the meeting today, but I was thinking that it might be worth running a random survey on MDN - just a quick 1-3 questions that takes almost no time and see what it looks like.

The reason being that it is an extremely widely pointed at, very key and independent resource - the documentation of the commons. It's equally useful to novices and experts. So, it's not likely to have many of the other kinds of biases that have to do with companies, skill levels, who follows who or something geographic, and keeping it short should help avoid the "this is really a better measure of people who are willing to fill in 20 minute questionnaires" problem. Like, at a minimum it would be interesting to see how it correlates to other data.

In the meeting it was also mentioned that there was data from the MDN DNA survey from 2020