Measure impact of project

[oindrillac]

As data scientists promoting this work, we want to track the engagement for this project to measure the response of our outreach efforts. In order to measure and gauge the growth of the AI4CI community, we need to define and track relevant metrics which can be obtained from various data sources.

From the following data sources, we can derive metrics that can be used to quantify the growth of the project and the impact of outreach efforts over time.

1. Github Insights - number of forks, number of views over time, number of contributions etc
2. Google Analytics - interactions, Views, New Users etc

[oindrillac]

@cdolfi We would like to use Augur to get Github Insights related metrics for this repository such as Visitors, unique visitors, Referring Sites, Forks, Stars, Views per page. What would be the way to achieve that?

[cdolfi]

@oindrillac Not sure about visitors or views I would have to look into that. Forks and stars yes. What are referring sites?

[oindrillac]

thanks @cdolfi Referring sites are also a part of the Traffic section in the repository insights along with unique visitors and page views, https://github.com/aicoe-aiops/ocp-ci-analysis/graphs/traffic

[aakankshaduggal]

For storing the traffic data for more than 2 weeks : This GitHub action can allow us to store the repository traffic and clones past the default 2 week period. https://github.com/marketplace/actions/repository-traffic

Collecting Metrics

We also tried out https://github.com/gomesfernanda/some-github-metrics.git for collecting some metrics for the existing data(past 14 days) As of now, we have the following metric data for all aicoe-aiops repositories :

• Git clones per day and unique git clone per day
• Code frequency - Weekly additions, deletions, commits, author, is-a member
• Community Engagement - Total number of forks, stars, commits, and collaborators
• Views per day and unique views per day

What's missing

• Referring Sites
• Content
• Views per page
• Forks and stars are currently static, we need this metric over time

cc - @oindrillac

[oindrillac]

@xtuchyna we are trying to collect github insights and traffic related info on a periodic basis for this repo and store it. Does https://github.com/thoth-station/mi-scheduler capabilities allow us to get Github traffic related insights as well?

[cdolfi]

@oindrillac this link: https://github.com/aicoe-aiops/ocp-ci-analysis/graphs/traffic does not work for me. Is there some type of access that I need?

@aakankshaduggal Forks and stars can definitely be viewed over time. Referring sites and views per page are not currently scraped but a feature request can be made on the augur repo

[oindrillac]

@oindrillac this link: https://github.com/aicoe-aiops/ocp-ci-analysis/graphs/traffic does not work for me. Is there some type of access that I need?

@cdolfi my bad. I think you probably need access to this repo to view that. https://docs.github.com/en/repositories/viewing-activity-and-data-for-your-repository/viewing-traffic-to-a-repository

@aakankshaduggal Forks and stars can definitely be viewed over time. Referring sites and views per page are not currently scraped but a feature request can be made on the augur repo

I see. Thanks for checking @cdolfi . Can you please point us to the repo where we can open a feature request?

[cdolfi]

@oindrillac https://github.com/chaoss/augur/issues/new/choose