opensource-observer / oso

Measuring the impact of open source software
https://opensource.observer
Apache License 2.0
74 stars 16 forks source link

Catalog current state of timeseries metrics #2275

Closed ccerv1 closed 1 month ago

ccerv1 commented 2 months ago

What is it?

All metrics should be available for artifacts, projects, and collections. For example, commits_monthly applied to a project would be represented as commits_monthly_to_project.

We also plan to have variants for some metrics based on different "from" entity types (e.g., user groups). For example, commits_monthly_to_project_from_trusted_developers. See also #1997

We currently want to implement three types of time-series metrics:

So far, we've only considered the first two types, though here is an example of the third type #837

The table below provides an update to #2004 in terms of metric requirements:

Event Source Metric Time-Series Type User Group
GitHub repository_count Point-in-Time N/A
GitHub first_commit_date Point-in-Time N/A
GitHub last_commit_date Point-in-Time N/A
GitHub star_count Point-in-Time N/A
GitHub fork_count Point-in-Time N/A
GitHub contributor_count Point-in-Time N/A
GitHub contributor_count_6_months Interval N/A
GitHub new_contributor_count_6_months Interval N/A
GitHub fulltime_developer_average_6_months Interval N/A
GitHub active_developer_count_6_months Interval N/A
GitHub commit_count_6_months Interval N/A
GitHub opened_pull_request_count_6_months Interval N/A
GitHub merged_pull_request_count_6_months Interval N/A
GitHub opened_issue_count_6_months Interval N/A
GitHub closed_issue_count_6_months Interval N/A
Onchain days_since_first_transaction Point-in-Time N/A
Onchain active_contract_count_90_days Interval N/A
Onchain gas_fees_sum Point-in-Time N/A
Onchain gas_fees_sum_6_months Interval N/A
Onchain transaction_count Point-in-Time N/A
Onchain transaction_count_6_months Interval N/A
Onchain address_count Point-in-Time N/A
Onchain recurring_addresses Point-in-Time N/A
Onchain address_count_90_days Interval N/A
Onchain daily_active_addresses Interval N/A
Onchain monthly_active_addresses Interval N/A
Onchain new_address_count_90_days Interval N/A
Onchain returning_address_count_90_days Interval N/A
Onchain power_user_addresses Point-in-Time Power User
Onchain openrank_trusted_users Point-in-Time Trusted User
Onchain trusted_transaction_count Interval Trusted User
Onchain trusted_daily_active_users Interval Trusted User
Onchain trusted_monthly_active_users Interval Trusted User
Onchain trusted_recurring_users Interval Trusted User
Onchain trusted_users_onboarded Interval Trusted User
Onchain high_activity_address_count_90_days Interval High Activity
Onchain medium_activity_address_count_90_days Interval Medium Activity
Onchain low_activity_address_count_90_days Interval Low Activity
Onchain multi_project_address_count_90_days Interval Multi-Project
ccerv1 commented 2 months ago

Based on the metrics listed above, here is where we currently stand:

Complete

Event Source Metric Time-Series Type User Group
GitHub star_count Point-in-Time N/A
GitHub fork_count Point-in-Time N/A
GitHub commit_count_6_months Interval N/A
GitHub opened_pull_request_count_6_months Interval N/A
GitHub merged_pull_request_count_6_months Interval N/A
GitHub opened_issue_count_6_months Interval N/A
GitHub closed_issue_count_6_months Interval N/A
Onchain gas_fees_sum_6_months Interval N/A
Onchain transaction_count_6_months Interval N/A
Onchain address_count_90_days Interval N/A
Onchain daily_active_addresses Interval N/A
Onchain monthly_active_addresses Interval N/A

Has Bug

(see #2274)

Event Source Metric Time-Series Type User Group
GitHub contributor_count_6_months Interval N/A
GitHub fulltime_developer_average_6_months Interval N/A
GitHub active_developer_count_6_months Interval N/A

Not Done

Event Source Metric Time-Series Type User Group
GitHub repository_count Point-in-Time N/A
GitHub first_commit_date Point-in-Time N/A
GitHub last_commit_date Point-in-Time N/A
GitHub contributor_count Point-in-Time N/A
Onchain transaction_count Point-in-Time N/A
Onchain address_count Point-in-Time N/A
Onchain gas_fees_sum Point-in-Time N/A
GitHub new_contributor_count_6_months Interval N/A
Onchain days_since_first_transaction Point-in-Time N/A
Onchain active_contract_count_90_days Interval N/A
Onchain recurring_addresses Point-in-Time N/A
Onchain new_address_count_90_days Interval N/A
Onchain returning_address_count_90_days Interval N/A

Blocked on Usergroup Models

Event Source Metric Time-Series Type User Group
Onchain power_user_addresses Point-in-Time Power User
Onchain openrank_trusted_users Point-in-Time Trusted User
Onchain trusted_transaction_count Interval Trusted User
Onchain trusted_daily_active_users Interval Trusted User
Onchain trusted_monthly_active_users Interval Trusted User
Onchain trusted_recurring_users Interval Trusted User
Onchain trusted_users_onboarded Interval Trusted User
Onchain high_activity_address_count_90_days Interval High Activity
Onchain medium_activity_address_count_90_days Interval Medium Activity
Onchain low_activity_address_count_90_days Interval Low Activity
Onchain multi_project_address_count_90_days Interval Multi-Project