Dataset, Source, Job Metrics

[phixMe]

Problem

https://github.com/user-attachments/assets/1894c875-822a-4b2d-9bd9-d05650a16ad0

This adds metrics for sources, datasets, and jobs.

• [ ] Add Migrations for created_at on the corresponding tables that are used with the number is known before a merge.

Solution

Various generate_series style queries to aggregate metrics cumulatively.

One-line summary: Three endpoints that return Intervals of counts for daily and weekly graphs on the new dashboard.

Checklist

• [x] You've signed-off your work
• [ ] Your changes are accompanied by tests (if relevant)
• [ ] Your change contains a small diff and is self-contained
• [ ] You've updated any relevant documentation (if relevant)
• [ ] You've included a one-line summary of your change for the CHANGELOG.md (Depending on the change, this may not be necessary).
• [ ] You've versioned your .sql database schema migration according to Flyway's naming convention (if relevant)
• [ ] You've included a header in any source code files (if relevant)

[netlify[bot]]

✅ Deploy Preview for peppy-sprite-186812 canceled.

Name	Link
🔨 Latest commit	166f4b49b272e83eb26f8dd35e32f6e4dd10ae49
🔍 Latest deploy log	https://app.netlify.com/sites/peppy-sprite-186812/deploys/6705bffbf830730008a34b07

[codecov[bot]]

Codecov Report

Attention: Patch coverage is 77.77778% with 6 lines in your changes missing coverage. Please review.

Project coverage is 83.08%. Comparing base (d180f24) to head (166f4b4). Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
...pi/src/main/java/marquez/service/StatsService.java	0.00%	6 Missing :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #2906 +/- ## ============================================ + Coverage 81.02% 83.08% +2.06% - Complexity 241 1500 +1259 ============================================ Files 43 265 +222 Lines 996 6888 +5892 Branches 40 320 +280 ============================================ + Hits 807 5723 +4916 - Misses 160 1007 +847 - Partials 29 158 +129 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

[wslulciuc]

PR #2906 - Chart for Dataset, Source, and Job counts