Create a report of Github Demographics research

[missaugustina]

Population:

(important to do but kind of a stretch goal, basically verifies my assumptions from the previous study about the overall event population I'm sampling from)

• [x] Determine population to sample
• [x] Initial population analytics (to compare with samples, fill this in when I know what they are)

GBQ Events:

• [x] Take a random sample of 100 events per event type for report
• [x] Get all events for repos in samples 2017, 2016

Repos from same owner

• [x] All Sample
• [x] Create Sample
• [x] Fork Sample
• [x] Push Sample
• [x] Release Sample
• [x] Watch Sample

Events per actor percent log frequency

• [x] All Sample
• [x] Create Sample
• [x] Fork Sample
• [x] Push Sample
• [x] Release Sample
• [x] Watch Sample

event type frequency

• [x] All Sample
• [x] Create Sample
• [x] Fork Sample
• [x] Push Sample
• [x] Release Sample
• [x] Watch Sample

Repos per Actor frequency

• [x] All Sample
• [x] Create Sample
• [x] Fork Sample
• [x] Push Sample
• [x] Release Sample
• [x] Watch Sample

Github API:

• [x] Get Github API data for the repos in the sample
• [x] Upload Github API data to GBQ datasets
• [x] Analytics on Github repo data (tbd)
• [x] Age of repo
• [x] Languages
• [x] Has CI? (check readme? search payloads?)

Repos Age and updated since

• [x] All Sample
• [x] Create Sample
• [x] Fork Sample
• [x] Push Sample
• [x] Release Sample
• [x] Watch Sample

Language Freq, Language Pct Freq

• [x] All Sample
• [x] Create Sample
• [x] Fork Sample
• [x] Push Sample
• [x] Release Sample
• [x] Watch Sample

Build Status Tag in Readme Freq (preliminary has CI)

• [x] All Sample
• [x] Create Sample
• [x] Fork Sample
• [x] Push Sample
• [x] Release Sample
• [x] Watch Sample

Deliverables:

• [x] Write report
• [x] Generate PNGs for slide deck
• [x] Generate report output files

[missaugustina]

I decided to do the month of February and the month of March up to the 21st when I took the samples. I have the Github API data in JSON format. I've also started performing initial analysis on the population I sampled from. Currently dealing with a shuffleboard issue to get the CSV's together properly.

[missaugustina]

Had to fix an issue where a) repo slug was reversed and b) 3 repos had missing data either due to deletion or going private since creation. Issue #72

[missaugustina]

Added summaries to compare the different samples in one plot. Only one left at this point is the README size. Not going to do summaries for Languages and Build Status in README due to time contraints.

[missaugustina]

R was being stupid and I was having issues generating the files so I moved this into blocked. This issue has been fixed and the HTML output has been generated.