ros_metrics

Publicly Available

ROS Users

• Downloads tar archives
• Sorts by Topic (roughly), Post and User
• No method exists for getting historical number of subscribers
• TODO: Use https://github.com/zapier/email-reply-parser to remove replies from raw text

answers.ros.org

• Uses askbot API for info on users and questions.

packages.ros.org

• Scrape HTML from the pages and gather
  • Overall traffic (hits, bandwidth, number of visitors)
  • Breakdown by url, country and operating system
• Statistics by month/year.

rosdistro

• Examines Github repo
• Determines type of change for each commit
• Counts the number of repositories contained in the distributions per commit
• Tracks which repos are present in each distro through time

Multi-Repo Stats

• Statistics based on the repositories listed in the rosdistro
• Scores Github repositories based on stars, forks and subscribers.
• Gathers information on the issues/pull requests opened and closed.
• Counts the total number of commits
• TODO:
  • [ ] Determine number of packages per repository/commit
  • [ ] General git stats
  • lines of code
  • authors
  • languages

Google Scholar Citations

• Uses resources from scholarly Python library
• Counts citations per year

ROS Wiki

• Uses a combination of the publicly available mirror data and the DocBook format downloads.
• Tracks the number of editors, pages and revisions.
• Raw number of users is not publicly available and drawn from the official Metrics report.
• TODO:
  • [ ] Special case for ROS2
  • [ ] How are wiki edits spread across users?
  • [ ] How big are wiki edits?
  • [ ] Number of wiki tutorial pages under in any package
  • [ ] Content per language/namespace
  • [ ] Integrate users

Privately Available

The following data sources can only be crawled via use of an API key (or other special authentication)

discourse.ros.org

• Crawled using Discourse API
• Retrieves info on
  • users
  • categories
  • topics
  • posts

Web Traffic

• Analytics available for
  • wiki.ros.org
  • answers.ros.org
  • discourse.ros.org
  • index.ros.org
• Uses Google Analytics API
• Overall number of unique pageviews, users and sessions gathered by month/year.
• Pageviews breakdown by url, country and operating system done by year.