ipfs / ipfs-gui

Creating standards and patterns for IPFS that are simple, accessible, reusable, and beautiful
104 stars 19 forks source link

Create and document process for generating all-hands reports #126

Closed SgtPooki closed 1 year ago

SgtPooki commented 1 year ago

generate an easy-to-consume report we can present at our weekly All-Hands meetings.

Questions we will answer with Metrics

Data to provide in the generated report

Note that we can potentially get aggregated data across all projects using app consolidation: https://support.count.ly/hc/en-us/articles/900004464043-Consolidate

Not including users who opt-out

  1. How many daily/weekly/monthly active users(unique) does have?
  2. How long do users typically keep open when using it? (session length/duration)
  3. What is the WoW/MoM trend of user session times in ?
  4. What are the most viewed pages within ?
  5. What is the WoW/MoM trend of active users(unique) for ?
  6. Error count on the frontend (optional)
  7. Performance metrics (optional)

Including users who opt-out or do not upgrade.

  1. What is the size of the total users of ? (we will know the answer here because a single event is sent informing us that a user has opted out of metrics)
    • How many users benefit from our products?
  2. How many open issues do we have as a team? (see https://github.com/SgtPooki/github-issue-stats)
  3. What is the lead time from issue open to issue close? (see https://github.com/SgtPooki/github-issue-stats)

Other data that is not confirmed to be possible, but is desired

  1. How many daily/weekly/monthly active users(unique) are there across all s?
  2. What is the total WoW/MoM trend of active users across all s?
tinytb commented 1 year ago

Some ideas for product-specific questions (thanks @whizzzkid) --

gateway-checker (Can this benefit as a tool for everyone including local gateways?)

companion (Impact on user browsing? do we slow them? do we provide an easy transition to ipfs?)

desktop (is the UI adding value and providing users meaningful ways to interact with IPFS?)

SgtPooki commented 1 year ago

Note that our metrics dashboard page is created, though still in progress, at https://pl-strflt.notion.site/IPFS-Ignite-Metrics-Dashboard-dee2ada6225e4e01a172673496851210

SgtPooki commented 1 year ago

This issue is useful for historical purposes and tracking metrics/data we may want to add/report on moving forward, but for the sake of the "telemetry project" from the Ignite team, this issue will be closed once https://github.com/ipfs-shipyard/ignite-metrics/pull/86 is merged.

SgtPooki commented 1 year ago

In addition to the count of intercepted URLs, here are some ipfs-companion metrics I've been thinking would be nice: