ComputationalMystics / ResearchProject

Baseline Set of OSS Project Health Indicators
MIT License
7 stars 7 forks source link

Web-Based Dashboard with Community Metrics (Hannemann et al. 2014) #29

Open GeorgLink opened 7 years ago

GeorgLink commented 7 years ago

I an interesting paper that asked community members about metrics they'd like to see...

Especially interesting for our work motivation is that data from GitHub for community metrics was asked for by survey participants (p. 18).

The paper presents interesting findings: "... a strong interest of OSS developers in visualization of community statistics. Especially, the network graph visualization of the communities was recognized as the most interesting metric. The developers are more interested in aggregated statistics in order to avoid the feeling of being observed among the project participants. On contrary, sentiment analysis did not get much attention, which might be a result of a poor description or little awareness of the analysis method." (p. 19)

We might learn from the paper:

Here are the results to a preliminary survey: image

Here is a screenshot of the metrics dashboard presented in the paper: image

Reference: Hannemann, A., Liiva, K., & Klamma, R. (2014). Navigation Support in Evolving Open-Source Communities by a Web-Based Dashboard. In L. Corral, A. Sillitti, G. Succi, J. Vlasenko, & A. I. Wasserman (Eds.), Open Source Software: Mobile Open Source Technologies (pp. 11–20). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-55128-4_2

germonprez commented 7 years ago

Thanks. Is the image just for reference? Hard to read.

matt

On Wed, Apr 12, 2017 at 10:49 AM, Georg J.P. Link notifications@github.com wrote:

I an interesting paper that asked community members about metrics they'd like to see...

Especially interesting for our work motivation is that data from GitHub for community metrics was asked for by survey participants (p. 18).

The paper presents interesting findings: "... a strong interest of OSS developers in visualization of community statistics. Especially, the network graph visualization of the communities was recognized as the most interesting metric. The developers are more interested in aggregated statistics in order to avoid the feeling of being observed among the project participants. On contrary, sentiment analysis did not get much attention, which might be a result of a poor description or little awareness of the analysis method." (p. 19)

We might learn from the paper:

  • Add a community graph metric to our list (with a time play feature to show evolution).
  • Do not provide developer specific metrics; always aggregate to the project level.
  • Describe each metric well and provide examples for its use (metrics detail page (template) fulfills this).

Here are the results to a preliminary survey: [image: image] https://cloud.githubusercontent.com/assets/8862021/24966162/d22f3fc8-1f6b-11e7-8f58-fc9fb7c233fa.png

Here is a screenshot of the metrics dashboard presented in the paper: [image: image] https://cloud.githubusercontent.com/assets/8862021/24966256/0a419dac-1f6c-11e7-9da4-f70fd27041e3.png

Reference: Hannemann, A., Liiva, K., & Klamma, R. (2014). Navigation Support in Evolving Open-Source Communities by a Web-Based Dashboard. In L. Corral, A. Sillitti, G. Succi, J. Vlasenko, & A. I. Wasserman (Eds.), Open Source Software: Mobile Open Source Technologies (pp. 11–20). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-55128-4_2

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/OSSHealth/ResearchProject/issues/29, or mute the thread https://github.com/notifications/unsubscribe-auth/AAoDUAQYFrQXzk-T9zTvDELu3EqlPh16ks5rvPKDgaJpZM4M7nbU .

-- Mutual of Omaha Associate Professor Information Systems College of Information Science & Technology University of Nebraska Omaha http://faculty.ist.unomaha.edu/mgermonprez/cv.txt

GeorgLink commented 7 years ago

Yes, screenshot just to give an idea of what a different implementation looks like.

The quality in the paper is better.

GeorgLink commented 7 years ago

The dashboard is no longer online, but a blog post linked to from the paper talks about the network component: http://bytesizebio.net/2013/09/07/bio-projects-a-history-in-graphs/