chaoss / wg-evolution

Working Group focused on Evolution metrics (for software development projects)
MIT License
39 stars 62 forks source link

New metric: Change Request Commits #435

Closed vinodkahuja closed 2 years ago

vinodkahuja commented 2 years ago

This issue is created to collect comments about the rolling release of Change Request Commits metric

This metric can be found here: https://docs.google.com/document/d/19hWI-j7vCXHUfopw-4-iNWyu5wO0Udg3pf__GLJGnag/edit

See all release candidates: https://chaoss.community/metrics/

CHAOSS Metric Quality Checklist

This checklist is used for new and updated metrics to ensure we follow CHAOSS quality standards and processes. Below checklist items don’t have to be completed all at once: create the metric release candidate issue first and then start working on the checklist.

Process

When above steps are completed:

Content Quality

Technical Requirements

rpaik commented 2 years ago

A few questions.

foundjem commented 2 years ago

@rpaik, are your comments still relevant after reading the metric documentation and description? I am curious if we should do more iterations over these practical concerns.

bhack commented 2 years ago

If it's to demonstrate the diversity of contributors in the change request, wouldn't we want to also factor in how many people have provided reviews?

I think that it Is also important to measure the reviewers diversity and approval diversity/fairness (do we have a bias related on who propose the PR and who approve the PR?). This could be also related, when possibile, to the codeowners diversity also If currently we stil don't have a metric about the codeownership coverage and transparency of the repo and the diversity of its gatekeepers. Probably on this topic we could interact more strictly with https://github.com/chaoss/wg-dei/issues/402

germonprez commented 2 years ago

@sgoggins, I"m not sure if this metric is ready for release. Have you had a chance to check out the comments?

klumb commented 2 years ago

The goal of this metric is to measure the number of commits in a PR. As an atomic metric that measures a specific activity, it can inform complexity and diversity however it doesn't measure it. Complexity and Diversity are likely models that could include this metric.

klumb commented 2 years ago

I believe this is ready for release.