thoth-station / core

Using Artificial Intelligence to analyse and recommend Software Stacks for Artificial Intelligence applications.
https://thoth-station.github.io/
GNU General Public License v3.0
28 stars 25 forks source link

Gather user feedback/opinions on useful Scorecard metrics #442

Closed mayaCostantini closed 2 years ago

mayaCostantini commented 2 years ago

This issue is part of the following EPIC: https://github.com/thoth-station/core/issues/434

4. Implement the global scoring logic

For example, if a software stack is in the 95th percentile of packages with the best development practices (CI/CD, testing...), score it as "A" for this category. Compute a global score from the different category scores.

Gather user feedback/opinions on what metrics would be the most relevant to them

Next steps:

sesheta commented 2 years ago

@mayaCostantini: This issue is currently awaiting triage. If a refinement session determines this is a relevant issue, it will accept the issue by applying the triage/accepted label and provide further guidance.

The triage/accepted label can be added by org members by writing /triage accepted in a comment.

Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
mayaCostantini commented 2 years ago

/sig user-experience /priority critical-urgent

goern commented 2 years ago

/kind feature

Gkrumbach07 commented 2 years ago

/triage accepted

create a google form and send it to teams that use Thoth and aggregate results. Scorecards also give importance information for each metric they provide.

goern commented 2 years ago

let's assume that some scorecard metrics are more useful than others, see https://github.com/ossf/scorecard/blob/main/docs/checks.md so we include