DSACMS / metrics

Experimentations in Open Source Repository Metrics
https://dsacms.github.io/metrics/
Other
6 stars 2 forks source link

Use a Matrix Job Configuration workflow to separate each organization data update operation #157

Closed IsaacMilarky closed 3 weeks ago

IsaacMilarky commented 3 weeks ago

Use a Matrix Job Configuration workflow to separate each organization data update operation

Problem

Previously, all update operations happened in one job before being pushed to the main branch. This used up a lot of GitHub workflow execution time on a single job.

Solution

Now, update operations are separated by organization. This makes it so that data is updated when it is done gathering it for a specific repository instead of having to wait for all data to be gathered. This also reduces the execution time burden of these jobs as they are now lesser in execution time.

Result

closes #143

Test Plan

I have tested it locally but I might test the GitHub workflow further on my fork.